Jun 09 19:40:48.206971 ip-10-0-140-8 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 19:40:48.206981 ip-10-0-140-8 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 19:40:48.206988 ip-10-0-140-8 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 19:40:48.207119 ip-10-0-140-8 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 19:40:58.457858 ip-10-0-140-8 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 19:40:58.457874 ip-10-0-140-8 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot e95b98a286f64a16bb0862373ca6a9d4 -- Jun 09 19:43:34.634457 ip-10-0-140-8 systemd[1]: Starting Kubernetes Kubelet... Jun 09 19:43:35.085419 ip-10-0-140-8 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 19:43:35.085419 ip-10-0-140-8 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 19:43:35.085419 ip-10-0-140-8 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 19:43:35.085419 ip-10-0-140-8 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 19:43:35.085419 ip-10-0-140-8 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 19:43:35.087403 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.087322 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 19:43:35.092148 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092122 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 19:43:35.092148 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092148 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092153 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092156 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092165 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092168 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092171 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092173 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092176 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092179 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092182 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092184 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092187 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092190 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092192 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092195 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092197 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092200 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092203 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092207 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 19:43:35.092209 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092209 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092212 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092215 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092218 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092220 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092223 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092226 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092228 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092231 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092233 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092236 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092241 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092244 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092247 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092250 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092254 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092258 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092262 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092264 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 19:43:35.092661 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092267 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092269 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092272 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092274 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092277 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092279 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092282 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092284 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092287 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092289 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092292 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092294 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092297 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092299 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092302 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092305 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092308 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092310 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092313 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092315 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 19:43:35.093147 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092318 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092320 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092323 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092325 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092328 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092331 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092333 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092336 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092338 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092341 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092343 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092346 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092349 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092351 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092354 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092356 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092360 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092362 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092365 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092367 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092370 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 19:43:35.093630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092372 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092374 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092377 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092379 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092382 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092386 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092390 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092393 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092396 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092398 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092401 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092403 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092406 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092408 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092411 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092413 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092416 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092418 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.092421 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 19:43:35.094153 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093154 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093165 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093169 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093173 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093178 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093181 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093184 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093188 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093190 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093193 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093196 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093198 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093201 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093203 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093206 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093209 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093211 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093213 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093217 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093220 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 19:43:35.094662 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093222 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093225 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093229 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093233 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093236 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093239 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093242 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093245 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093247 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093250 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093253 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093256 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093258 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093261 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093263 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093266 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093268 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093271 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093273 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 19:43:35.095171 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093276 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093279 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093281 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093284 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093286 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093289 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093291 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093293 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093296 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093298 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093301 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093305 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093309 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093312 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093314 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093317 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093319 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093322 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093324 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093327 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 19:43:35.095881 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093329 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093332 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093337 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093339 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093342 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093345 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093347 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093350 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093353 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093355 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093358 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093361 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093364 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093367 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093371 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093373 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093376 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093378 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093381 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 19:43:35.096541 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093383 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093386 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093388 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093391 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093395 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093398 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093400 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093403 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093405 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093408 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093411 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093414 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093416 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093419 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093421 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093424 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093426 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093430 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093434 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093437 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 19:43:35.097007 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093440 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093860 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093865 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093868 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093873 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093877 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093880 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093884 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093887 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093890 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093894 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093897 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093899 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093902 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093905 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093909 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093912 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093915 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093917 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 19:43:35.097511 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093920 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093923 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093926 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093928 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093931 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093934 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093937 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093939 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093942 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093945 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093947 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093950 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093953 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093956 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093958 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093961 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093963 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093966 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093969 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093971 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093974 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 19:43:35.097972 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093977 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093979 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093982 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093985 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093987 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093990 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093993 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093996 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.093999 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094001 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094004 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094006 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094009 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094012 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094014 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094017 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094020 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094022 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094025 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094027 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 19:43:35.098495 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094030 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094032 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094035 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094037 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094040 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094042 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094045 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094047 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094051 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094054 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094057 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094060 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094063 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094065 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094068 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094070 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094073 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094076 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094079 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 19:43:35.098987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094081 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094084 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094087 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094089 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094092 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094095 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094097 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094099 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094102 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094105 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094107 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094110 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094112 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094114 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094117 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094119 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094122 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094140 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094144 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094148 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 19:43:35.099494 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094151 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094215 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094221 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094227 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094232 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094236 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094239 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094243 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094247 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094250 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094253 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094257 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094260 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094267 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094271 2573 flags.go:64] FLAG: --cgroup-root="" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094274 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094277 2573 flags.go:64] FLAG: --client-ca-file="" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094280 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094283 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094287 2573 flags.go:64] FLAG: --cluster-domain="" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094290 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094298 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094301 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094305 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 19:43:35.099973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094308 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094311 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094314 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094318 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094320 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094323 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094327 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094331 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094334 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094341 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094344 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094347 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094350 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094354 2573 flags.go:64] FLAG: --enable-server="true" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094357 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094361 2573 flags.go:64] FLAG: --event-burst="100" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094364 2573 flags.go:64] FLAG: --event-qps="50" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094367 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094370 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094373 2573 flags.go:64] FLAG: --eviction-hard="" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094376 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094380 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094383 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094386 2573 flags.go:64] FLAG: --eviction-soft="" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094389 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 19:43:35.100566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094391 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094394 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094397 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094400 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094404 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094407 2573 flags.go:64] FLAG: --feature-gates="" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094410 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094413 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094416 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094419 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094429 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094433 2573 flags.go:64] FLAG: --help="false" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094437 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094440 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094443 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094446 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094449 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094453 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094456 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094458 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094462 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094468 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094471 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094474 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 19:43:35.101193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094477 2573 flags.go:64] FLAG: --kube-reserved="" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094480 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094483 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094486 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094490 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094493 2573 flags.go:64] FLAG: --lock-file="" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094496 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094499 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094502 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094508 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094511 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094514 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094518 2573 flags.go:64] FLAG: --logging-format="text" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094521 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094524 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094527 2573 flags.go:64] FLAG: --manifest-url="" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094530 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094534 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094537 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094541 2573 flags.go:64] FLAG: --max-pods="110" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094544 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094547 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094550 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094553 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094557 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 19:43:35.101793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094560 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094563 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094569 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094572 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094576 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094579 2573 flags.go:64] FLAG: --pod-cidr="" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094582 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094587 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094590 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094593 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094596 2573 flags.go:64] FLAG: --port="10250" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094599 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094603 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0abc06383a9fbdf8d" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094606 2573 flags.go:64] FLAG: --qos-reserved="" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094609 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094612 2573 flags.go:64] FLAG: --register-node="true" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094615 2573 flags.go:64] FLAG: --register-with-taints="" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094618 2573 flags.go:64] FLAG: --registry-burst="10" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094621 2573 flags.go:64] FLAG: --registry-qps="5" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094625 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094628 2573 flags.go:64] FLAG: --reserved-memory="" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094631 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094635 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094638 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094641 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 19:43:35.102440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094644 2573 flags.go:64] FLAG: --runonce="false" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094646 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094649 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094652 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094655 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094658 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094661 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094664 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094667 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094670 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094673 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094676 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094679 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094682 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094685 2573 flags.go:64] FLAG: --system-cgroups="" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094688 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094693 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094696 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094699 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094704 2573 flags.go:64] FLAG: --tls-min-version="" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094707 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094709 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094712 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094715 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094718 2573 flags.go:64] FLAG: --v="2" Jun 09 19:43:35.103042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094721 2573 flags.go:64] FLAG: --version="false" Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094726 2573 flags.go:64] FLAG: --vmodule="" Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094730 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.094733 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094850 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094854 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094858 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094860 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094864 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094866 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094869 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094871 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094874 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094876 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094879 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094881 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094884 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094886 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094888 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094891 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 19:43:35.103684 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094894 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094897 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094901 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094905 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094908 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094910 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094914 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094916 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094920 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094922 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094925 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094928 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094930 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094934 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094937 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094940 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094943 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094945 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094947 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094950 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 19:43:35.104177 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094952 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094955 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094957 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094960 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094963 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094965 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094968 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094970 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094973 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094975 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094978 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094980 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094983 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094985 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094989 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094992 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094994 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.094998 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095001 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 19:43:35.104664 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095004 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095007 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095010 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095013 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095016 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095018 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095022 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095025 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095027 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095030 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095033 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095035 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095038 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095040 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095043 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095045 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095048 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095051 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095054 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095056 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 19:43:35.105121 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095059 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095061 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095064 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095067 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095069 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095072 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095075 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095079 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095082 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095085 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095087 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095090 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095093 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095095 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095098 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095100 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095103 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095105 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095110 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 19:43:35.105620 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095113 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095115 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095117 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095120 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.095123 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.095143 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.103774 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.103789 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.103809 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.103815 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103868 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103873 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103876 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103879 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 19:43:35.106090 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103882 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103885 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103888 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103891 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103893 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103896 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103899 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103901 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103904 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103907 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103909 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103912 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103915 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103917 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103920 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103923 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103925 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103928 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103931 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103933 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 19:43:35.106499 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103936 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103939 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103941 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103944 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103950 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103954 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103956 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103959 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103962 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103964 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103967 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103970 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103972 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103975 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103978 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103980 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103983 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103986 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103990 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103994 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 19:43:35.106987 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.103997 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104000 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104003 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104006 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104009 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104011 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104014 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104017 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104019 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104022 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104025 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104028 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104031 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104034 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104037 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104039 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104042 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104046 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104049 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 19:43:35.107611 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104052 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104054 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104057 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104060 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104064 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104067 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104070 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104073 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104076 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104079 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104082 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104084 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104087 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104091 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104095 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104100 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104103 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104106 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104109 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 19:43:35.108183 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104111 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104114 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104117 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104120 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104122 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104141 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104145 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104148 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104150 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104153 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104156 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104159 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104162 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104164 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104167 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104170 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 19:43:35.108630 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104173 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.104178 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104296 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104301 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104304 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104307 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104310 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104313 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104316 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104319 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104321 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104324 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104327 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104330 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104334 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 19:43:35.109013 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104336 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104339 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104342 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104344 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104347 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104349 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104352 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104354 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104357 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104360 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104362 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104365 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104368 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104371 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104374 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104376 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104379 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104381 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104384 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 19:43:35.109430 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104386 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104389 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104391 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104394 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104397 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104399 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104402 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104404 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104407 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104409 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104413 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104417 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104420 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104423 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104425 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104428 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104430 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104432 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104435 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 19:43:35.109886 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104438 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104440 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104442 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104445 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104449 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104452 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104456 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104460 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104463 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104466 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104469 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104472 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104475 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104477 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104480 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104483 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104485 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104488 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104490 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 19:43:35.110358 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104493 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104495 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104498 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104500 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104503 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104506 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104508 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104511 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104514 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104517 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104519 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104522 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104524 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104527 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104529 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104532 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104534 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104537 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104540 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 19:43:35.110827 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104542 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104546 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104549 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104552 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104555 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104557 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104560 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104563 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104565 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:35.104568 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.104573 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.104689 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.107927 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.109662 2573 server.go:1019] "Starting client certificate rotation" Jun 09 19:43:35.111345 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.109766 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 19:43:35.111694 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.109797 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 19:43:35.113201 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.113187 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 19:43:35.116063 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.116044 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 19:43:35.126861 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.126842 2573 log.go:25] "Validated CRI v1 runtime API" Jun 09 19:43:35.129806 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.129791 2573 log.go:25] "Validated CRI v1 image API" Jun 09 19:43:35.130585 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.130570 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 19:43:35.133165 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.133145 2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ae8ebe3d-b569-423b-9cbe-7ceb539e6623:/dev/nvme0n1p4 f8aa3577-7be3-43c0-8ce1-8e90da2212f6:/dev/nvme0n1p3] Jun 09 19:43:35.133237 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.133162 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 19:43:35.138273 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.138254 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 19:43:35.139190 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.139072 2573 manager.go:216] Machine: {Timestamp:2026-06-09 19:43:35.138589882 +0000 UTC m=+0.376755484 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098955 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24d63f178ac1866c15b7b941a714ff SystemUUID:ec24d63f-178a-c186-6c15-b7b941a714ff BootID:e95b98a2-86f6-4a16-bb08-62373ca6a9d4 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:30:3c:e0:42:07 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:30:3c:e0:42:07 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ba:9e:1f:fe:14:f2 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 19:43:35.139190 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.139188 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 19:43:35.139291 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.139258 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 19:43:35.142937 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.142914 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 19:43:35.143067 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.142940 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 19:43:35.143775 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.143765 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 19:43:35.143813 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.143778 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 19:43:35.143813 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.143786 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 19:43:35.144634 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.144623 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 19:43:35.145904 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.145894 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 19:43:35.150984 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.150971 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 09 19:43:35.151104 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.151095 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 19:43:35.151149 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.151135 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 09 19:43:35.151149 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.151145 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 19:43:35.151209 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.151158 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 19:43:35.151209 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.151167 2573 kubelet.go:398] "Adding apiserver pod source" Jun 09 19:43:35.151209 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.151176 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 19:43:35.151571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.151560 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 19:43:35.151603 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.151578 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 19:43:35.153814 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.153794 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 19:43:35.155475 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.155462 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 19:43:35.155524 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.155492 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 19:43:35.156877 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156866 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 19:43:35.156950 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156881 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 19:43:35.156950 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156887 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 19:43:35.156950 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156893 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 19:43:35.156950 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156902 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 19:43:35.156950 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156908 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 19:43:35.156950 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156917 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 19:43:35.156950 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156922 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 19:43:35.156950 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156929 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 19:43:35.156950 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156935 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 19:43:35.156950 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156943 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 19:43:35.156950 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.156948 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 19:43:35.157867 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.157857 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 19:43:35.157867 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.157866 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 19:43:35.161040 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.161028 2573 server.go:1268] "Started kubelet" Jun 09 19:43:35.161194 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.161167 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 19:43:35.161194 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.161187 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vp44v" Jun 09 19:43:35.161307 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.161226 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 19:43:35.161307 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.161298 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 19:43:35.161839 ip-10-0-140-8 systemd[1]: Started Kubernetes Kubelet. Jun 09 19:43:35.162329 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.162036 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 19:43:35.162329 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.162174 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 19:43:35.162329 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.162221 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 19:43:35.164326 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.164310 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 09 19:43:35.166435 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.166409 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 19:43:35.168436 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.167274 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-8.ec2.internal.18b7812eaf7cf0d4 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-8.ec2.internal,UID:ip-10-0-140-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-8.ec2.internal,},FirstTimestamp:2026-06-09 19:43:35.161000148 +0000 UTC m=+0.399165749,LastTimestamp:2026-06-09 19:43:35.161000148 +0000 UTC m=+0.399165749,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-8.ec2.internal,}" Jun 09 19:43:35.168519 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.168490 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vp44v" Jun 09 19:43:35.168903 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.168884 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 19:43:35.173703 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.173684 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 19:43:35.173703 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.173694 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 19:43:35.173844 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.173748 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 09 19:43:35.174286 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174260 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 19:43:35.174286 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174264 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 19:43:35.174450 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174297 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 19:43:35.174450 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174424 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 09 19:43:35.174450 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174432 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 09 19:43:35.174615 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174542 2573 factory.go:55] Registering systemd factory Jun 09 19:43:35.174615 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174556 2573 factory.go:223] Registration of the systemd container factory successfully Jun 09 19:43:35.174826 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174800 2573 factory.go:153] Registering CRI-O factory Jun 09 19:43:35.174826 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174820 2573 factory.go:223] Registration of the crio container factory successfully Jun 09 19:43:35.174942 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174873 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 19:43:35.174942 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174897 2573 factory.go:103] Registering Raw factory Jun 09 19:43:35.174942 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.174911 2573 manager.go:1196] Started watching for new ooms in manager Jun 09 19:43:35.175337 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.175323 2573 manager.go:349] Starting recovery of all containers Jun 09 19:43:35.176337 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.176306 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 19:43:35.176476 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.176450 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 19:43:35.185645 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.185490 2573 manager.go:354] Recovery completed Jun 09 19:43:35.190475 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.190463 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 19:43:35.192929 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.192914 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 19:43:35.193023 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.192947 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 19:43:35.193023 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.192961 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 19:43:35.193478 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.193462 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 19:43:35.193478 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.193478 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 19:43:35.193596 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.193487 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 19:43:35.193596 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.193496 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 09 19:43:35.194111 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.194098 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 19:43:35.194177 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.194138 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 19:43:35.194177 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.194152 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 19:43:35.195630 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.195620 2573 policy_none.go:49] "None policy: Start" Jun 09 19:43:35.195673 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.195634 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 19:43:35.195673 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.195645 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 19:43:35.197386 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.197375 2573 policy_none.go:47] "Start" Jun 09 19:43:35.237669 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.237654 2573 manager.go:337] "Starting Device Plugin manager" Jun 09 19:43:35.237761 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.237687 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 19:43:35.237761 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.237699 2573 server.go:87] "Starting device plugin registration server" Jun 09 19:43:35.237947 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.237929 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 19:43:35.238201 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.237946 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 19:43:35.238201 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.238036 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 19:43:35.238201 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.238106 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 19:43:35.238201 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.238117 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 19:43:35.238719 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.238699 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 19:43:35.238781 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.238746 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-8.ec2.internal\" not found" Jun 09 19:43:35.254672 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.254649 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 19:43:35.263954 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.255754 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 19:43:35.263954 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.255783 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 19:43:35.263954 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.255817 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 19:43:35.263954 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.255855 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 19:43:35.263954 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.257781 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 19:43:35.338719 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.338636 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 19:43:35.339762 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.339743 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 19:43:35.339836 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.339783 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 19:43:35.339836 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.339796 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 19:43:35.339836 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.339821 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.347047 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.347023 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.347187 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.347057 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-8.ec2.internal\": node \"ip-10-0-140-8.ec2.internal\" not found" Jun 09 19:43:35.355936 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.355910 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal"] Jun 09 19:43:35.356039 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.355973 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 19:43:35.356757 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.356742 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 19:43:35.356846 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.356774 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 19:43:35.356846 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.356790 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 19:43:35.358650 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.358631 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 09 19:43:35.359359 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.359347 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 19:43:35.359473 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.359456 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.359511 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.359496 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 19:43:35.359969 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.359952 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 19:43:35.360044 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.359977 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 19:43:35.360044 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.359987 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 19:43:35.360044 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.359952 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 19:43:35.360153 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.360058 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 19:43:35.360153 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.360071 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 19:43:35.362248 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.362234 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.362298 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.362258 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 19:43:35.362831 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.362817 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientMemory" Jun 09 19:43:35.362920 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.362840 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 19:43:35.362920 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.362853 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeHasSufficientPID" Jun 09 19:43:35.376484 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.376468 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.376558 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.376496 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.376558 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.376513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98bac051df6d1eb92d9dcd6f09edbb90-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"98bac051df6d1eb92d9dcd6f09edbb90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.387736 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.387714 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-8.ec2.internal\" not found" node="ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.392010 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.391995 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-8.ec2.internal\" not found" node="ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.459188 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.459157 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 09 19:43:35.477554 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.477526 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98bac051df6d1eb92d9dcd6f09edbb90-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"98bac051df6d1eb92d9dcd6f09edbb90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.477554 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.477554 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.477716 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.477573 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.477716 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.477620 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/98bac051df6d1eb92d9dcd6f09edbb90-config\") pod \"kube-apiserver-proxy-ip-10-0-140-8.ec2.internal\" (UID: \"98bac051df6d1eb92d9dcd6f09edbb90\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.477716 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.477635 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.477716 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.477681 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/05c829215119f6b730755cdeec6d1f30-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal\" (UID: \"05c829215119f6b730755cdeec6d1f30\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.560062 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.560030 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 09 19:43:35.660847 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.660823 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 09 19:43:35.694339 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.694313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.698759 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:35.698739 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 09 19:43:35.761272 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.761236 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 09 19:43:35.861703 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.861685 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 09 19:43:35.962226 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:35.962166 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 09 19:43:36.062661 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.062628 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-8.ec2.internal\" not found" Jun 09 19:43:36.086226 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.086198 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 19:43:36.087693 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.087676 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 19:43:36.108937 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.108914 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 19:43:36.109052 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.109034 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 19:43:36.109107 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.109048 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 19:43:36.109107 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.109052 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 19:43:36.152291 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.152262 2573 apiserver.go:52] "Watching apiserver" Jun 09 19:43:36.171356 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.171328 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 19:43:36.171644 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.171623 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-sprsl","openshift-multus/multus-pfptq","kube-system/global-pull-secret-syncer-9phnt","kube-system/konnectivity-agent-2d4sj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4","openshift-image-registry/node-ca-bvf2b","openshift-multus/network-metrics-daemon-74jvx","openshift-network-diagnostics/network-check-target-zb4lc","openshift-network-operator/iptables-alerter-ldw6d","openshift-ovn-kubernetes/ovnkube-node-ql628","openshift-cluster-node-tuning-operator/tuned-nq9nl","openshift-dns/node-resolver-xpmj4"] Jun 09 19:43:36.173985 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.173946 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" Jun 09 19:43:36.173985 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.173971 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 19:43:36.174177 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.174026 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.175967 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.175947 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.176291 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.176239 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 19:38:35 +0000 UTC" deadline="2027-12-09 10:43:54.87440091 +0000 UTC" Jun 09 19:43:36.176291 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.176284 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13143h0m18.698119116s" Jun 09 19:43:36.176488 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.176422 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 19:43:36.176488 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.176443 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-q8krc\"" Jun 09 19:43:36.176591 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.176494 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 19:43:36.176591 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.176561 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 19:43:36.176591 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.176561 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 19:43:36.176750 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.176562 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 19:43:36.177866 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.177849 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:36.177939 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.177919 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:36.178086 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.178071 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 19:43:36.178489 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.178476 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xtbhk\"" Jun 09 19:43:36.179756 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.179743 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:43:36.181186 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181167 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ltb7\" (UniqueName: \"kubernetes.io/projected/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-kube-api-access-2ltb7\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181232 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181196 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-cni-dir\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181232 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181214 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-hostroot\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181232 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181230 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-etc-kubernetes\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181376 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181246 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-system-cni-dir\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.181376 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181280 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65742759-dc96-475d-aebd-9b748549a587-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.181376 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181313 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-cnibin\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181376 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181340 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-run-k8s-cni-cncf-io\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181376 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181364 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-run-netns\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181521 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-var-lib-cni-multus\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181521 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181415 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-conf-dir\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181521 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181438 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-daemon-config\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181521 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-cnibin\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.181521 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181513 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65742759-dc96-475d-aebd-9b748549a587-cni-binary-copy\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.181747 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181552 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.181747 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181569 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-system-cni-dir\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181747 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-os-release\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181747 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181602 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-socket-dir-parent\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181747 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181623 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-qfn6q\"" Jun 09 19:43:36.181747 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181632 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-run-multus-certs\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.181747 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-os-release\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.181747 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181698 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65742759-dc96-475d-aebd-9b748549a587-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.181747 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181726 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhl2c\" (UniqueName: \"kubernetes.io/projected/65742759-dc96-475d-aebd-9b748549a587-kube-api-access-fhl2c\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.181747 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181740 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-cni-binary-copy\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.182160 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-var-lib-cni-bin\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.182160 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181780 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-var-lib-kubelet\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.182160 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181808 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 19:43:36.182160 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.181825 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.182160 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.182149 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 19:43:36.182160 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.182156 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 19:43:36.183152 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.183122 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 19:43:36.183233 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.183217 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" Jun 09 19:43:36.183739 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.183720 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bvf2b" Jun 09 19:43:36.184246 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.184230 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 19:43:36.184329 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.184265 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 19:43:36.184456 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.184441 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 19:43:36.184509 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.184479 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-9mwlp\"" Jun 09 19:43:36.185859 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.185705 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 19:43:36.186313 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.185985 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kgvck\"" Jun 09 19:43:36.186313 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.186018 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 19:43:36.186313 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.186158 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 19:43:36.186512 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.186411 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:36.186512 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.186470 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:36.188493 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.188478 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 19:43:36.188692 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.188676 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:36.188768 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.188748 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:36.190764 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.190745 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ldw6d" Jun 09 19:43:36.193487 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.193238 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 19:43:36.193785 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.193768 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.193855 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.193838 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 19:43:36.194517 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.194494 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wtltv\"" Jun 09 19:43:36.195595 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.195540 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 19:43:36.196346 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.196306 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 19:43:36.196971 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.196950 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f99l6\"" Jun 09 19:43:36.197111 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.197094 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 19:43:36.197802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.197158 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 19:43:36.197802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.197198 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 19:43:36.197802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.197221 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 19:43:36.197802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.197409 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 19:43:36.197802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.197564 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.199550 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.199534 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 19:43:36.199846 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.199830 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-6rf6h\"" Jun 09 19:43:36.199962 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.199942 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 19:43:36.200033 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.199994 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal"] Jun 09 19:43:36.200033 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.200029 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal"] Jun 09 19:43:36.200097 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.200048 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xpmj4" Jun 09 19:43:36.202191 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.202173 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n75cx\"" Jun 09 19:43:36.202314 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.202205 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 19:43:36.202314 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.202237 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 19:43:36.202438 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.202419 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-c7jw9" Jun 09 19:43:36.208810 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.208794 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-c7jw9" Jun 09 19:43:36.275216 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.275199 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 19:43:36.280431 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:36.280407 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05c829215119f6b730755cdeec6d1f30.slice/crio-eae9e7043f63e1052128bec3df7075b0e5205843ea7d253bf0a6398849f3daee WatchSource:0}: Error finding container eae9e7043f63e1052128bec3df7075b0e5205843ea7d253bf0a6398849f3daee: Status 404 returned error can't find the container with id eae9e7043f63e1052128bec3df7075b0e5205843ea7d253bf0a6398849f3daee Jun 09 19:43:36.280627 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:36.280610 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98bac051df6d1eb92d9dcd6f09edbb90.slice/crio-fce95b25d26c9ee30e9d74a1305d45c1843430b38484d6544cfb64a7dde54b76 WatchSource:0}: Error finding container fce95b25d26c9ee30e9d74a1305d45c1843430b38484d6544cfb64a7dde54b76: Status 404 returned error can't find the container with id fce95b25d26c9ee30e9d74a1305d45c1843430b38484d6544cfb64a7dde54b76 Jun 09 19:43:36.282083 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282065 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-os-release\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.282190 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282098 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhl2c\" (UniqueName: \"kubernetes.io/projected/65742759-dc96-475d-aebd-9b748549a587-kube-api-access-fhl2c\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.282190 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-kubernetes\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.282291 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282194 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acc1d971-051b-4cf1-ac84-768d60732d3c-konnectivity-ca\") pod \"konnectivity-agent-2d4sj\" (UID: \"acc1d971-051b-4cf1-ac84-768d60732d3c\") " pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:43:36.282291 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282214 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-os-release\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.282386 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282293 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5a3d736-aaad-4c34-b800-4d9d6579adaf-kubelet-config\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:36.282386 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282322 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-var-lib-openvswitch\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.282386 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282353 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-cnibin\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.282386 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282382 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-etc-kubernetes\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.282554 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282414 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-cnibin\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.282554 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282447 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-log-socket\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.282554 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282467 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-etc-kubernetes\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.282554 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282496 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-modprobe-d\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.282554 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282520 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-ovnkube-config\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.282554 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282538 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-sysconfig\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.282554 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282553 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22cj6\" (UniqueName: \"kubernetes.io/projected/f8c2937d-ae68-425d-a9b2-7d2970afbcbf-kube-api-access-22cj6\") pod \"node-ca-bvf2b\" (UID: \"f8c2937d-ae68-425d-a9b2-7d2970afbcbf\") " pod="openshift-image-registry/node-ca-bvf2b" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282570 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mpks\" (UniqueName: \"kubernetes.io/projected/70cf497e-8c3e-4fb1-8981-cb9754626d08-kube-api-access-2mpks\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65742759-dc96-475d-aebd-9b748549a587-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282616 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-var-lib-kubelet\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282632 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/852e770d-264a-4e28-ae4b-1473059e79f0-host-slash\") pod \"iptables-alerter-ldw6d\" (UID: \"852e770d-264a-4e28-ae4b-1473059e79f0\") " pod="openshift-network-operator/iptables-alerter-ldw6d" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282647 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-device-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282668 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8c2937d-ae68-425d-a9b2-7d2970afbcbf-serviceca\") pod \"node-ca-bvf2b\" (UID: \"f8c2937d-ae68-425d-a9b2-7d2970afbcbf\") " pod="openshift-image-registry/node-ca-bvf2b" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282689 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-var-lib-kubelet\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282690 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-hostroot\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282754 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/852e770d-264a-4e28-ae4b-1473059e79f0-iptables-alerter-script\") pod \"iptables-alerter-ldw6d\" (UID: \"852e770d-264a-4e28-ae4b-1473059e79f0\") " pod="openshift-network-operator/iptables-alerter-ldw6d" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282753 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-hostroot\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282780 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282806 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-env-overrides\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282821 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/348c38f8-24b2-4945-9f4b-ad74e29e669c-tmp\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.282856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282837 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-system-cni-dir\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282852 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-run-k8s-cni-cncf-io\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282917 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-system-cni-dir\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282955 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-run-netns\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282970 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-run-k8s-cni-cncf-io\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.282979 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-sys-fs\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283013 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-run-netns\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-run-netns\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283063 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-node-log\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283094 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-run-ovn-kubernetes\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr5j5\" (UniqueName: \"kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5\") pod \"network-check-target-zb4lc\" (UID: \"a499920d-ce03-48e4-b65a-52380b7373fd\") " pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283151 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-cnibin\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283170 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65742759-dc96-475d-aebd-9b748549a587-cni-binary-copy\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283185 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a-hosts-file\") pod \"node-resolver-xpmj4\" (UID: \"da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a\") " pod="openshift-dns/node-resolver-xpmj4" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283198 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a-tmp-dir\") pod \"node-resolver-xpmj4\" (UID: \"da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a\") " pod="openshift-dns/node-resolver-xpmj4" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283204 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/65742759-dc96-475d-aebd-9b748549a587-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283215 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:36.283571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-cnibin\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283325 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-etc-openvswitch\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283359 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-var-lib-cni-bin\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283390 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-var-lib-cni-bin\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283386 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndgnq\" (UniqueName: \"kubernetes.io/projected/852e770d-264a-4e28-ae4b-1473059e79f0-kube-api-access-ndgnq\") pod \"iptables-alerter-ldw6d\" (UID: \"852e770d-264a-4e28-ae4b-1473059e79f0\") " pod="openshift-network-operator/iptables-alerter-ldw6d" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283414 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-cni-netd\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-ovn-node-metrics-cert\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283465 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-ovnkube-script-lib\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283498 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-host\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283524 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-cni-dir\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283552 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5a3d736-aaad-4c34-b800-4d9d6579adaf-dbus\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283585 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-cni-dir\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283593 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-etc-selinux\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283618 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-systemd-units\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283637 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/65742759-dc96-475d-aebd-9b748549a587-cni-binary-copy\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283641 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7k7k\" (UniqueName: \"kubernetes.io/projected/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-kube-api-access-q7k7k\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283686 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-sysctl-d\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.284378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283708 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-run\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283729 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acc1d971-051b-4cf1-ac84-768d60732d3c-agent-certs\") pod \"konnectivity-agent-2d4sj\" (UID: \"acc1d971-051b-4cf1-ac84-768d60732d3c\") " pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283755 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-var-lib-cni-multus\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283795 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-conf-dir\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283818 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-daemon-config\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283843 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-var-lib-cni-multus\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283925 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-conf-dir\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283949 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-kubelet-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.283980 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-run-systemd\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284005 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-run-ovn\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284045 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-system-cni-dir\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284070 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-os-release\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-socket-dir-parent\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284099 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-system-cni-dir\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284120 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-run-multus-certs\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh5rk\" (UniqueName: \"kubernetes.io/projected/b839b141-9e3e-4a4c-b1c9-413b4d32c048-kube-api-access-gh5rk\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284178 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-os-release\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.284959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284190 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-lib-modules\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284167 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-socket-dir-parent\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284203 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-host-run-multus-certs\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-cni-binary-copy\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ltb7\" (UniqueName: \"kubernetes.io/projected/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-kube-api-access-2ltb7\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284262 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-socket-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-cni-bin\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284306 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-systemd\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284340 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-var-lib-kubelet\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284343 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-multus-daemon-config\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284367 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-registration-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284404 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-kubelet\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-slash\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284456 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-sysctl-conf\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284499 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-sys\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284525 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-tuned\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284551 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65742759-dc96-475d-aebd-9b748549a587-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.285449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284578 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-679p7\" (UniqueName: \"kubernetes.io/projected/da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a-kube-api-access-679p7\") pod \"node-resolver-xpmj4\" (UID: \"da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a\") " pod="openshift-dns/node-resolver-xpmj4" Jun 09 19:43:36.285905 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284603 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-run-openvswitch\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.285905 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284625 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8c2937d-ae68-425d-a9b2-7d2970afbcbf-host\") pod \"node-ca-bvf2b\" (UID: \"f8c2937d-ae68-425d-a9b2-7d2970afbcbf\") " pod="openshift-image-registry/node-ca-bvf2b" Jun 09 19:43:36.285905 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284676 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.285905 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284703 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h88hm\" (UniqueName: \"kubernetes.io/projected/348c38f8-24b2-4945-9f4b-ad74e29e669c-kube-api-access-h88hm\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.285905 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284725 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-cni-binary-copy\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.285905 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.284839 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/65742759-dc96-475d-aebd-9b748549a587-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.285905 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.285029 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/65742759-dc96-475d-aebd-9b748549a587-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.287666 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.287641 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 19:43:36.288495 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.288479 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 19:43:36.290974 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.290948 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhl2c\" (UniqueName: \"kubernetes.io/projected/65742759-dc96-475d-aebd-9b748549a587-kube-api-access-fhl2c\") pod \"multus-additional-cni-plugins-sprsl\" (UID: \"65742759-dc96-475d-aebd-9b748549a587\") " pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.291232 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.291217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ltb7\" (UniqueName: \"kubernetes.io/projected/41b5cd67-f64b-45b1-94c1-0f253e1ac8f1-kube-api-access-2ltb7\") pod \"multus-pfptq\" (UID: \"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1\") " pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.385535 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385509 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-log-socket\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.385535 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385537 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-modprobe-d\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.385698 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385551 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-ovnkube-config\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.385698 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385566 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-sysconfig\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.385698 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385580 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22cj6\" (UniqueName: \"kubernetes.io/projected/f8c2937d-ae68-425d-a9b2-7d2970afbcbf-kube-api-access-22cj6\") pod \"node-ca-bvf2b\" (UID: \"f8c2937d-ae68-425d-a9b2-7d2970afbcbf\") " pod="openshift-image-registry/node-ca-bvf2b" Jun 09 19:43:36.385698 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385604 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mpks\" (UniqueName: \"kubernetes.io/projected/70cf497e-8c3e-4fb1-8981-cb9754626d08-kube-api-access-2mpks\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:36.385698 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385627 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/852e770d-264a-4e28-ae4b-1473059e79f0-host-slash\") pod \"iptables-alerter-ldw6d\" (UID: \"852e770d-264a-4e28-ae4b-1473059e79f0\") " pod="openshift-network-operator/iptables-alerter-ldw6d" Jun 09 19:43:36.385698 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385653 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-device-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.385698 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385652 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-sysconfig\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.385698 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385667 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-modprobe-d\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.385698 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385684 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/852e770d-264a-4e28-ae4b-1473059e79f0-host-slash\") pod \"iptables-alerter-ldw6d\" (UID: \"852e770d-264a-4e28-ae4b-1473059e79f0\") " pod="openshift-network-operator/iptables-alerter-ldw6d" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385700 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-log-socket\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385715 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-device-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8c2937d-ae68-425d-a9b2-7d2970afbcbf-serviceca\") pod \"node-ca-bvf2b\" (UID: \"f8c2937d-ae68-425d-a9b2-7d2970afbcbf\") " pod="openshift-image-registry/node-ca-bvf2b" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385798 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385815 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/852e770d-264a-4e28-ae4b-1473059e79f0-iptables-alerter-script\") pod \"iptables-alerter-ldw6d\" (UID: \"852e770d-264a-4e28-ae4b-1473059e79f0\") " pod="openshift-network-operator/iptables-alerter-ldw6d" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385831 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-env-overrides\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385895 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/348c38f8-24b2-4945-9f4b-ad74e29e669c-tmp\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385931 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-sys-fs\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385956 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-run-netns\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385895 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.385984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-node-log\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.385999 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386019 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-sys-fs\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386046 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-run-netns\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386057 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-node-log\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386122 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.386069 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs podName:70cf497e-8c3e-4fb1-8981-cb9754626d08 nodeName:}" failed. No retries permitted until 2026-06-09 19:43:36.886048495 +0000 UTC m=+2.124214088 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs") pod "network-metrics-daemon-74jvx" (UID: "70cf497e-8c3e-4fb1-8981-cb9754626d08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386086 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-run-ovn-kubernetes\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386111 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5j5\" (UniqueName: \"kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5\") pod \"network-check-target-zb4lc\" (UID: \"a499920d-ce03-48e4-b65a-52380b7373fd\") " pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386154 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a-hosts-file\") pod \"node-resolver-xpmj4\" (UID: \"da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a\") " pod="openshift-dns/node-resolver-xpmj4" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-run-ovn-kubernetes\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386199 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-ovnkube-config\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a-tmp-dir\") pod \"node-resolver-xpmj4\" (UID: \"da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a\") " pod="openshift-dns/node-resolver-xpmj4" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386277 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a-hosts-file\") pod \"node-resolver-xpmj4\" (UID: \"da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a\") " pod="openshift-dns/node-resolver-xpmj4" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386292 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f8c2937d-ae68-425d-a9b2-7d2970afbcbf-serviceca\") pod \"node-ca-bvf2b\" (UID: \"f8c2937d-ae68-425d-a9b2-7d2970afbcbf\") " pod="openshift-image-registry/node-ca-bvf2b" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386317 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-etc-openvswitch\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386337 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-env-overrides\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-etc-openvswitch\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386352 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndgnq\" (UniqueName: \"kubernetes.io/projected/852e770d-264a-4e28-ae4b-1473059e79f0-kube-api-access-ndgnq\") pod \"iptables-alerter-ldw6d\" (UID: \"852e770d-264a-4e28-ae4b-1473059e79f0\") " pod="openshift-network-operator/iptables-alerter-ldw6d" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386383 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/852e770d-264a-4e28-ae4b-1473059e79f0-iptables-alerter-script\") pod \"iptables-alerter-ldw6d\" (UID: \"852e770d-264a-4e28-ae4b-1473059e79f0\") " pod="openshift-network-operator/iptables-alerter-ldw6d" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386394 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-cni-netd\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.386391 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-ovn-node-metrics-cert\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.386963 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386458 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-ovnkube-script-lib\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.386471 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret podName:d5a3d736-aaad-4c34-b800-4d9d6579adaf nodeName:}" failed. No retries permitted until 2026-06-09 19:43:36.886453398 +0000 UTC m=+2.124618988 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret") pod "global-pull-secret-syncer-9phnt" (UID: "d5a3d736-aaad-4c34-b800-4d9d6579adaf") : object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386479 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-cni-netd\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386500 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-host\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386529 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5a3d736-aaad-4c34-b800-4d9d6579adaf-dbus\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386543 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-host\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386556 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-etc-selinux\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386578 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-systemd-units\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386598 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7k7k\" (UniqueName: \"kubernetes.io/projected/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-kube-api-access-q7k7k\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386655 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d5a3d736-aaad-4c34-b800-4d9d6579adaf-dbus\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386680 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-etc-selinux\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386699 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-systemd-units\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386714 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-sysctl-d\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386731 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-run\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acc1d971-051b-4cf1-ac84-768d60732d3c-agent-certs\") pod \"konnectivity-agent-2d4sj\" (UID: \"acc1d971-051b-4cf1-ac84-768d60732d3c\") " pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-kubelet-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386777 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-run-systemd\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.387829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386808 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-run-ovn\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386846 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh5rk\" (UniqueName: \"kubernetes.io/projected/b839b141-9e3e-4a4c-b1c9-413b4d32c048-kube-api-access-gh5rk\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386869 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-lib-modules\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386874 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-sysctl-d\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386892 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-socket-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386914 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-cni-bin\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386917 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-run-ovn\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386913 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-ovnkube-script-lib\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-systemd\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386956 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-run-systemd\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386966 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-cni-bin\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.386977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-var-lib-kubelet\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387003 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-registration-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-kubelet\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387050 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-slash\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387062 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-socket-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387073 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-sysctl-conf\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388397 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387080 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-lib-modules\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387095 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-sys\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387115 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-kubelet-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387151 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-systemd\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387172 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-sys\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387223 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-var-lib-kubelet\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387258 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-kubelet\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387175 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-tuned\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387301 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-sysctl-conf\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387305 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b839b141-9e3e-4a4c-b1c9-413b4d32c048-registration-dir\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-679p7\" (UniqueName: \"kubernetes.io/projected/da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a-kube-api-access-679p7\") pod \"node-resolver-xpmj4\" (UID: \"da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a\") " pod="openshift-dns/node-resolver-xpmj4" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387346 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-run-openvswitch\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387371 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8c2937d-ae68-425d-a9b2-7d2970afbcbf-host\") pod \"node-ca-bvf2b\" (UID: \"f8c2937d-ae68-425d-a9b2-7d2970afbcbf\") " pod="openshift-image-registry/node-ca-bvf2b" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387397 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h88hm\" (UniqueName: \"kubernetes.io/projected/348c38f8-24b2-4945-9f4b-ad74e29e669c-kube-api-access-h88hm\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-kubernetes\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387452 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acc1d971-051b-4cf1-ac84-768d60732d3c-konnectivity-ca\") pod \"konnectivity-agent-2d4sj\" (UID: \"acc1d971-051b-4cf1-ac84-768d60732d3c\") " pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387477 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5a3d736-aaad-4c34-b800-4d9d6579adaf-kubelet-config\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-var-lib-openvswitch\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.388917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387552 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a-tmp-dir\") pod \"node-resolver-xpmj4\" (UID: \"da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a\") " pod="openshift-dns/node-resolver-xpmj4" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-var-lib-openvswitch\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387620 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-run-openvswitch\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387632 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-run\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387641 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-kubernetes\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387670 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f8c2937d-ae68-425d-a9b2-7d2970afbcbf-host\") pod \"node-ca-bvf2b\" (UID: \"f8c2937d-ae68-425d-a9b2-7d2970afbcbf\") " pod="openshift-image-registry/node-ca-bvf2b" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387691 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d5a3d736-aaad-4c34-b800-4d9d6579adaf-kubelet-config\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.387739 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-host-slash\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.388117 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/acc1d971-051b-4cf1-ac84-768d60732d3c-konnectivity-ca\") pod \"konnectivity-agent-2d4sj\" (UID: \"acc1d971-051b-4cf1-ac84-768d60732d3c\") " pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.388834 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-ovn-node-metrics-cert\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.388850 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/348c38f8-24b2-4945-9f4b-ad74e29e669c-tmp\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.389049 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/348c38f8-24b2-4945-9f4b-ad74e29e669c-etc-tuned\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.389498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.389470 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/acc1d971-051b-4cf1-ac84-768d60732d3c-agent-certs\") pod \"konnectivity-agent-2d4sj\" (UID: \"acc1d971-051b-4cf1-ac84-768d60732d3c\") " pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:43:36.391936 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.391919 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 19:43:36.391982 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.391947 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 19:43:36.391982 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.391959 2573 projected.go:196] Error preparing data for projected volume kube-api-access-xr5j5 for pod openshift-network-diagnostics/network-check-target-zb4lc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:36.392048 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.392025 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5 podName:a499920d-ce03-48e4-b65a-52380b7373fd nodeName:}" failed. No retries permitted until 2026-06-09 19:43:36.892009343 +0000 UTC m=+2.130174933 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xr5j5" (UniqueName: "kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5") pod "network-check-target-zb4lc" (UID: "a499920d-ce03-48e4-b65a-52380b7373fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:36.393721 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.393694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22cj6\" (UniqueName: \"kubernetes.io/projected/f8c2937d-ae68-425d-a9b2-7d2970afbcbf-kube-api-access-22cj6\") pod \"node-ca-bvf2b\" (UID: \"f8c2937d-ae68-425d-a9b2-7d2970afbcbf\") " pod="openshift-image-registry/node-ca-bvf2b" Jun 09 19:43:36.394311 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.394291 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mpks\" (UniqueName: \"kubernetes.io/projected/70cf497e-8c3e-4fb1-8981-cb9754626d08-kube-api-access-2mpks\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:36.394811 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.394783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndgnq\" (UniqueName: \"kubernetes.io/projected/852e770d-264a-4e28-ae4b-1473059e79f0-kube-api-access-ndgnq\") pod \"iptables-alerter-ldw6d\" (UID: \"852e770d-264a-4e28-ae4b-1473059e79f0\") " pod="openshift-network-operator/iptables-alerter-ldw6d" Jun 09 19:43:36.394943 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.394930 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7k7k\" (UniqueName: \"kubernetes.io/projected/0a3b2f89-f143-4ae5-ad5c-63606fef5bec-kube-api-access-q7k7k\") pod \"ovnkube-node-ql628\" (UID: \"0a3b2f89-f143-4ae5-ad5c-63606fef5bec\") " pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.395413 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.395394 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h88hm\" (UniqueName: \"kubernetes.io/projected/348c38f8-24b2-4945-9f4b-ad74e29e669c-kube-api-access-h88hm\") pod \"tuned-nq9nl\" (UID: \"348c38f8-24b2-4945-9f4b-ad74e29e669c\") " pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.395533 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.395518 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh5rk\" (UniqueName: \"kubernetes.io/projected/b839b141-9e3e-4a4c-b1c9-413b4d32c048-kube-api-access-gh5rk\") pod \"aws-ebs-csi-driver-node-frfn4\" (UID: \"b839b141-9e3e-4a4c-b1c9-413b4d32c048\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.395777 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.395764 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-679p7\" (UniqueName: \"kubernetes.io/projected/da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a-kube-api-access-679p7\") pod \"node-resolver-xpmj4\" (UID: \"da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a\") " pod="openshift-dns/node-resolver-xpmj4" Jun 09 19:43:36.484653 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.484585 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 19:43:36.498818 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.498799 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sprsl" Jun 09 19:43:36.508261 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:36.508239 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65742759_dc96_475d_aebd_9b748549a587.slice/crio-47c9954404ecbd5b28b84acd8dd53e84aaec00714057f40c1c9fad7723eadb60 WatchSource:0}: Error finding container 47c9954404ecbd5b28b84acd8dd53e84aaec00714057f40c1c9fad7723eadb60: Status 404 returned error can't find the container with id 47c9954404ecbd5b28b84acd8dd53e84aaec00714057f40c1c9fad7723eadb60 Jun 09 19:43:36.514838 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.514814 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pfptq" Jun 09 19:43:36.522469 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:36.522450 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b5cd67_f64b_45b1_94c1_0f253e1ac8f1.slice/crio-dafb4f3551e15ef9af7c015afc969f42d3e80c9b282cb0178cab07cf17d9649e WatchSource:0}: Error finding container dafb4f3551e15ef9af7c015afc969f42d3e80c9b282cb0178cab07cf17d9649e: Status 404 returned error can't find the container with id dafb4f3551e15ef9af7c015afc969f42d3e80c9b282cb0178cab07cf17d9649e Jun 09 19:43:36.533102 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.533086 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:43:36.540677 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:36.540652 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc1d971_051b_4cf1_ac84_768d60732d3c.slice/crio-5467aa74ce356e9dfc236814138595e579cf2235bad14f9fd165e28e5ff1aa32 WatchSource:0}: Error finding container 5467aa74ce356e9dfc236814138595e579cf2235bad14f9fd165e28e5ff1aa32: Status 404 returned error can't find the container with id 5467aa74ce356e9dfc236814138595e579cf2235bad14f9fd165e28e5ff1aa32 Jun 09 19:43:36.551847 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.551816 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" Jun 09 19:43:36.562292 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:36.562266 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb839b141_9e3e_4a4c_b1c9_413b4d32c048.slice/crio-3ca4a8c05b1d4ffa70085f9dca34bab75b06903b14ba1efccac0159a9ac82572 WatchSource:0}: Error finding container 3ca4a8c05b1d4ffa70085f9dca34bab75b06903b14ba1efccac0159a9ac82572: Status 404 returned error can't find the container with id 3ca4a8c05b1d4ffa70085f9dca34bab75b06903b14ba1efccac0159a9ac82572 Jun 09 19:43:36.588284 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.588260 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bvf2b" Jun 09 19:43:36.595976 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:36.595954 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c2937d_ae68_425d_a9b2_7d2970afbcbf.slice/crio-ea372648261116966323c1dedaa74c1ff62862c2128c80361efe6cb4798d156e WatchSource:0}: Error finding container ea372648261116966323c1dedaa74c1ff62862c2128c80361efe6cb4798d156e: Status 404 returned error can't find the container with id ea372648261116966323c1dedaa74c1ff62862c2128c80361efe6cb4798d156e Jun 09 19:43:36.600888 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.600872 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ldw6d" Jun 09 19:43:36.608048 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.608027 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:43:36.608193 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:36.608173 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod852e770d_264a_4e28_ae4b_1473059e79f0.slice/crio-ab07fb1c78508564169acb3cbc6d61859c6233934d496dd011ba02a00f98e084 WatchSource:0}: Error finding container ab07fb1c78508564169acb3cbc6d61859c6233934d496dd011ba02a00f98e084: Status 404 returned error can't find the container with id ab07fb1c78508564169acb3cbc6d61859c6233934d496dd011ba02a00f98e084 Jun 09 19:43:36.612770 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.612750 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" Jun 09 19:43:36.616041 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:36.615971 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3b2f89_f143_4ae5_ad5c_63606fef5bec.slice/crio-3d04afc1c5586d6d469a5192d1e2f83e8c6e4c2d10b40d303c3e52d20aa0cc46 WatchSource:0}: Error finding container 3d04afc1c5586d6d469a5192d1e2f83e8c6e4c2d10b40d303c3e52d20aa0cc46: Status 404 returned error can't find the container with id 3d04afc1c5586d6d469a5192d1e2f83e8c6e4c2d10b40d303c3e52d20aa0cc46 Jun 09 19:43:36.616703 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.616687 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-xpmj4" Jun 09 19:43:36.621297 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:36.621279 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod348c38f8_24b2_4945_9f4b_ad74e29e669c.slice/crio-865aaf3dc7590601588fb5f407655a165ba38f9e81267543c1f42b77d715a8cf WatchSource:0}: Error finding container 865aaf3dc7590601588fb5f407655a165ba38f9e81267543c1f42b77d715a8cf: Status 404 returned error can't find the container with id 865aaf3dc7590601588fb5f407655a165ba38f9e81267543c1f42b77d715a8cf Jun 09 19:43:36.625492 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:43:36.625467 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2dc5fe_acfa_4eb4_81bb_fd5e8f01ee2a.slice/crio-c7c4312b4fee1c2799d594a910860dab90af734a2d2eed9a644f32fe6102eabd WatchSource:0}: Error finding container c7c4312b4fee1c2799d594a910860dab90af734a2d2eed9a644f32fe6102eabd: Status 404 returned error can't find the container with id c7c4312b4fee1c2799d594a910860dab90af734a2d2eed9a644f32fe6102eabd Jun 09 19:43:36.891046 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.891009 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:36.891239 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.891088 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:36.891239 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.891218 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:36.891362 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.891281 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs podName:70cf497e-8c3e-4fb1-8981-cb9754626d08 nodeName:}" failed. No retries permitted until 2026-06-09 19:43:37.891260398 +0000 UTC m=+3.129425993 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs") pod "network-metrics-daemon-74jvx" (UID: "70cf497e-8c3e-4fb1-8981-cb9754626d08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:36.891635 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.891530 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:36.891635 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.891603 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret podName:d5a3d736-aaad-4c34-b800-4d9d6579adaf nodeName:}" failed. No retries permitted until 2026-06-09 19:43:37.891585477 +0000 UTC m=+3.129751087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret") pod "global-pull-secret-syncer-9phnt" (UID: "d5a3d736-aaad-4c34-b800-4d9d6579adaf") : object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:36.992279 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:36.992241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5j5\" (UniqueName: \"kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5\") pod \"network-check-target-zb4lc\" (UID: \"a499920d-ce03-48e4-b65a-52380b7373fd\") " pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:36.992464 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.992445 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 19:43:36.992699 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.992471 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 19:43:36.992699 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.992484 2573 projected.go:196] Error preparing data for projected volume kube-api-access-xr5j5 for pod openshift-network-diagnostics/network-check-target-zb4lc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:36.992699 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:36.992538 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5 podName:a499920d-ce03-48e4-b65a-52380b7373fd nodeName:}" failed. No retries permitted until 2026-06-09 19:43:37.992520474 +0000 UTC m=+3.230686067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr5j5" (UniqueName: "kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5") pod "network-check-target-zb4lc" (UID: "a499920d-ce03-48e4-b65a-52380b7373fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:37.211569 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.211466 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 19:38:36 +0000 UTC" deadline="2028-02-01 14:35:25.175435499 +0000 UTC" Jun 09 19:43:37.211569 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.211528 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14442h51m47.963912314s" Jun 09 19:43:37.259012 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.258981 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:37.259200 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:37.259114 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:37.264573 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.264553 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 19:43:37.284794 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.284691 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" event={"ID":"98bac051df6d1eb92d9dcd6f09edbb90","Type":"ContainerStarted","Data":"fce95b25d26c9ee30e9d74a1305d45c1843430b38484d6544cfb64a7dde54b76"} Jun 09 19:43:37.290254 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.290186 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xpmj4" event={"ID":"da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a","Type":"ContainerStarted","Data":"c7c4312b4fee1c2799d594a910860dab90af734a2d2eed9a644f32fe6102eabd"} Jun 09 19:43:37.303443 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.303416 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" event={"ID":"348c38f8-24b2-4945-9f4b-ad74e29e669c","Type":"ContainerStarted","Data":"865aaf3dc7590601588fb5f407655a165ba38f9e81267543c1f42b77d715a8cf"} Jun 09 19:43:37.323983 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.323954 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ldw6d" event={"ID":"852e770d-264a-4e28-ae4b-1473059e79f0","Type":"ContainerStarted","Data":"ab07fb1c78508564169acb3cbc6d61859c6233934d496dd011ba02a00f98e084"} Jun 09 19:43:37.332251 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.332173 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" event={"ID":"b839b141-9e3e-4a4c-b1c9-413b4d32c048","Type":"ContainerStarted","Data":"3ca4a8c05b1d4ffa70085f9dca34bab75b06903b14ba1efccac0159a9ac82572"} Jun 09 19:43:37.339232 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.339207 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sprsl" event={"ID":"65742759-dc96-475d-aebd-9b748549a587","Type":"ContainerStarted","Data":"47c9954404ecbd5b28b84acd8dd53e84aaec00714057f40c1c9fad7723eadb60"} Jun 09 19:43:37.367830 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.367801 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"05c829215119f6b730755cdeec6d1f30","Type":"ContainerStarted","Data":"eae9e7043f63e1052128bec3df7075b0e5205843ea7d253bf0a6398849f3daee"} Jun 09 19:43:37.387334 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.387304 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" event={"ID":"0a3b2f89-f143-4ae5-ad5c-63606fef5bec","Type":"ContainerStarted","Data":"3d04afc1c5586d6d469a5192d1e2f83e8c6e4c2d10b40d303c3e52d20aa0cc46"} Jun 09 19:43:37.409003 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.408931 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bvf2b" event={"ID":"f8c2937d-ae68-425d-a9b2-7d2970afbcbf","Type":"ContainerStarted","Data":"ea372648261116966323c1dedaa74c1ff62862c2128c80361efe6cb4798d156e"} Jun 09 19:43:37.424581 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.424554 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2d4sj" event={"ID":"acc1d971-051b-4cf1-ac84-768d60732d3c","Type":"ContainerStarted","Data":"5467aa74ce356e9dfc236814138595e579cf2235bad14f9fd165e28e5ff1aa32"} Jun 09 19:43:37.445464 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.445377 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pfptq" event={"ID":"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1","Type":"ContainerStarted","Data":"dafb4f3551e15ef9af7c015afc969f42d3e80c9b282cb0178cab07cf17d9649e"} Jun 09 19:43:37.900826 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.900762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:37.900996 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:37.900885 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:37.901075 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:37.901007 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:37.901075 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:37.901064 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs podName:70cf497e-8c3e-4fb1-8981-cb9754626d08 nodeName:}" failed. No retries permitted until 2026-06-09 19:43:39.901046883 +0000 UTC m=+5.139212479 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs") pod "network-metrics-daemon-74jvx" (UID: "70cf497e-8c3e-4fb1-8981-cb9754626d08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:37.901211 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:37.901139 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:37.901211 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:37.901178 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret podName:d5a3d736-aaad-4c34-b800-4d9d6579adaf nodeName:}" failed. No retries permitted until 2026-06-09 19:43:39.901164904 +0000 UTC m=+5.139330493 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret") pod "global-pull-secret-syncer-9phnt" (UID: "d5a3d736-aaad-4c34-b800-4d9d6579adaf") : object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:38.002015 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:38.001958 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5j5\" (UniqueName: \"kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5\") pod \"network-check-target-zb4lc\" (UID: \"a499920d-ce03-48e4-b65a-52380b7373fd\") " pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:38.002417 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:38.002213 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 19:43:38.002417 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:38.002247 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 19:43:38.002417 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:38.002260 2573 projected.go:196] Error preparing data for projected volume kube-api-access-xr5j5 for pod openshift-network-diagnostics/network-check-target-zb4lc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:38.002417 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:38.002337 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5 podName:a499920d-ce03-48e4-b65a-52380b7373fd nodeName:}" failed. No retries permitted until 2026-06-09 19:43:40.002309623 +0000 UTC m=+5.240475213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr5j5" (UniqueName: "kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5") pod "network-check-target-zb4lc" (UID: "a499920d-ce03-48e4-b65a-52380b7373fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:38.211889 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:38.211804 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 19:38:36 +0000 UTC" deadline="2027-11-15 13:50:24.026521152 +0000 UTC" Jun 09 19:43:38.211889 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:38.211839 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12570h6m45.814686652s" Jun 09 19:43:38.256260 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:38.256230 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:38.256427 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:38.256357 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:38.256768 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:38.256747 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:38.256935 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:38.256876 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:38.480165 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:38.480071 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 19:43:39.259426 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:39.257917 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:39.259426 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:39.258041 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:39.260884 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:39.260549 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 19:43:39.919635 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:39.918586 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:39.919635 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:39.918707 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:39.919635 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:39.918900 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:39.919635 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:39.919003 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret podName:d5a3d736-aaad-4c34-b800-4d9d6579adaf nodeName:}" failed. No retries permitted until 2026-06-09 19:43:43.918983 +0000 UTC m=+9.157148604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret") pod "global-pull-secret-syncer-9phnt" (UID: "d5a3d736-aaad-4c34-b800-4d9d6579adaf") : object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:39.919635 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:39.919533 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:39.919635 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:39.919609 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs podName:70cf497e-8c3e-4fb1-8981-cb9754626d08 nodeName:}" failed. No retries permitted until 2026-06-09 19:43:43.91957066 +0000 UTC m=+9.157736278 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs") pod "network-metrics-daemon-74jvx" (UID: "70cf497e-8c3e-4fb1-8981-cb9754626d08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:40.019965 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:40.019928 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5j5\" (UniqueName: \"kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5\") pod \"network-check-target-zb4lc\" (UID: \"a499920d-ce03-48e4-b65a-52380b7373fd\") " pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:40.020164 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:40.020075 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 19:43:40.020164 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:40.020099 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 19:43:40.020164 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:40.020110 2573 projected.go:196] Error preparing data for projected volume kube-api-access-xr5j5 for pod openshift-network-diagnostics/network-check-target-zb4lc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:40.020330 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:40.020182 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5 podName:a499920d-ce03-48e4-b65a-52380b7373fd nodeName:}" failed. No retries permitted until 2026-06-09 19:43:44.020163336 +0000 UTC m=+9.258328928 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr5j5" (UniqueName: "kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5") pod "network-check-target-zb4lc" (UID: "a499920d-ce03-48e4-b65a-52380b7373fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:40.256347 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:40.256269 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:40.256515 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:40.256388 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:40.256515 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:40.256398 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:40.256515 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:40.256491 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:41.257241 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:41.257210 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:41.257753 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:41.257378 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:42.256112 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:42.256079 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:42.256312 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:42.256236 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:42.256495 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:42.256080 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:42.256644 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:42.256592 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:43.257154 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:43.257092 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:43.257583 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:43.257367 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:43.952601 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:43.952562 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:43.952788 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:43.952625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:43.952788 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:43.952724 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:43.952788 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:43.952784 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret podName:d5a3d736-aaad-4c34-b800-4d9d6579adaf nodeName:}" failed. No retries permitted until 2026-06-09 19:43:51.952766559 +0000 UTC m=+17.190932156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret") pod "global-pull-secret-syncer-9phnt" (UID: "d5a3d736-aaad-4c34-b800-4d9d6579adaf") : object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:43.952929 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:43.952724 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:43.952929 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:43.952844 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs podName:70cf497e-8c3e-4fb1-8981-cb9754626d08 nodeName:}" failed. No retries permitted until 2026-06-09 19:43:51.952831922 +0000 UTC m=+17.190997516 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs") pod "network-metrics-daemon-74jvx" (UID: "70cf497e-8c3e-4fb1-8981-cb9754626d08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:44.053893 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:44.053855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5j5\" (UniqueName: \"kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5\") pod \"network-check-target-zb4lc\" (UID: \"a499920d-ce03-48e4-b65a-52380b7373fd\") " pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:44.054065 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:44.054013 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 19:43:44.054065 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:44.054033 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 19:43:44.054065 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:44.054047 2573 projected.go:196] Error preparing data for projected volume kube-api-access-xr5j5 for pod openshift-network-diagnostics/network-check-target-zb4lc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:44.054267 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:44.054104 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5 podName:a499920d-ce03-48e4-b65a-52380b7373fd nodeName:}" failed. No retries permitted until 2026-06-09 19:43:52.054085772 +0000 UTC m=+17.292251399 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr5j5" (UniqueName: "kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5") pod "network-check-target-zb4lc" (UID: "a499920d-ce03-48e4-b65a-52380b7373fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:44.256784 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:44.256708 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:44.256940 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:44.256840 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:44.256940 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:44.256900 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:44.257080 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:44.256951 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:45.257783 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:45.257650 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:45.257783 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:45.257754 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:46.256877 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:46.256846 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:46.256877 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:46.256883 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:46.257105 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:46.256974 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:46.257105 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:46.257091 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:47.256403 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:47.256366 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:47.256888 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:47.256508 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:48.256905 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:48.256825 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:48.257350 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:48.256944 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:48.257350 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:48.256981 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:48.257350 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:48.257053 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:49.256500 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:49.256468 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:49.256648 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:49.256584 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:50.256313 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:50.256278 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:50.256772 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:50.256447 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:50.256772 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:50.256505 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:50.256772 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:50.256612 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:51.260033 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:51.260006 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:51.260490 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:51.260139 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:52.012564 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:52.012388 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:52.012698 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:52.012589 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:52.012698 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:52.012509 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:52.012698 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:52.012684 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs podName:70cf497e-8c3e-4fb1-8981-cb9754626d08 nodeName:}" failed. No retries permitted until 2026-06-09 19:44:08.012668226 +0000 UTC m=+33.250833845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs") pod "network-metrics-daemon-74jvx" (UID: "70cf497e-8c3e-4fb1-8981-cb9754626d08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:43:52.012698 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:52.012688 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:52.012829 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:52.012726 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret podName:d5a3d736-aaad-4c34-b800-4d9d6579adaf nodeName:}" failed. No retries permitted until 2026-06-09 19:44:08.012715483 +0000 UTC m=+33.250881076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret") pod "global-pull-secret-syncer-9phnt" (UID: "d5a3d736-aaad-4c34-b800-4d9d6579adaf") : object "kube-system"/"original-pull-secret" not registered Jun 09 19:43:52.113347 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:52.113310 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5j5\" (UniqueName: \"kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5\") pod \"network-check-target-zb4lc\" (UID: \"a499920d-ce03-48e4-b65a-52380b7373fd\") " pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:52.113516 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:52.113493 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 19:43:52.113594 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:52.113518 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 19:43:52.113594 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:52.113531 2573 projected.go:196] Error preparing data for projected volume kube-api-access-xr5j5 for pod openshift-network-diagnostics/network-check-target-zb4lc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:52.113690 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:52.113599 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5 podName:a499920d-ce03-48e4-b65a-52380b7373fd nodeName:}" failed. No retries permitted until 2026-06-09 19:44:08.113577262 +0000 UTC m=+33.351742851 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr5j5" (UniqueName: "kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5") pod "network-check-target-zb4lc" (UID: "a499920d-ce03-48e4-b65a-52380b7373fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:43:52.256466 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:52.256388 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:52.256624 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:52.256531 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:52.256624 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:52.256578 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:52.256744 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:52.256697 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:53.260265 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:53.260234 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:53.260700 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:53.260237 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:53.260700 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:53.260340 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:53.260700 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:53.260391 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:54.256482 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:54.256447 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:54.256647 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:54.256585 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:55.256878 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:55.256842 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:55.257317 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:55.256931 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:55.257317 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:55.257310 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:55.257436 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:55.257409 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:56.256921 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:56.256897 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:56.257206 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:56.256997 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:56.487882 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:56.487857 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pfptq" event={"ID":"41b5cd67-f64b-45b1-94c1-0f253e1ac8f1","Type":"ContainerStarted","Data":"b327b96d8a0bd407c11944d1f700078703172a823c593fab875c44986c9a7c1f"} Jun 09 19:43:56.489367 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:56.489339 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" event={"ID":"98bac051df6d1eb92d9dcd6f09edbb90","Type":"ContainerStarted","Data":"b2d29634e2f9b777951a098645c366674e0f2728b5dc36dee7424c4a70eb66f6"} Jun 09 19:43:56.491331 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:56.491309 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" event={"ID":"348c38f8-24b2-4945-9f4b-ad74e29e669c","Type":"ContainerStarted","Data":"ef29835f772414f42356c1764fc4501bc9f893549cc860271345bc5860065b75"} Jun 09 19:43:56.505087 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:56.504569 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pfptq" podStartSLOduration=1.662338106 podStartE2EDuration="21.504552838s" totalImagesPullingTime="19.842214732s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:43:56.504188099 +0000 UTC m=+21.742353711" watchObservedRunningTime="2026-06-09 19:43:56.504552838 +0000 UTC m=+21.742718449" Jun 09 19:43:56.518340 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:56.518294 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nq9nl" podStartSLOduration=1.936998935 podStartE2EDuration="21.518276199s" totalImagesPullingTime="19.581277264s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:43:56.51819867 +0000 UTC m=+21.756364281" watchObservedRunningTime="2026-06-09 19:43:56.518276199 +0000 UTC m=+21.756441812" Jun 09 19:43:56.531205 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:56.531157 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-8.ec2.internal" podStartSLOduration=20.531115276 podStartE2EDuration="20.531115276s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:43:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:43:56.530601658 +0000 UTC m=+21.768767269" watchObservedRunningTime="2026-06-09 19:43:56.531115276 +0000 UTC m=+21.769280887" Jun 09 19:43:57.258859 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.258454 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:57.259432 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.258532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:57.259432 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:57.258950 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:57.259432 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:57.259035 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:57.494364 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.494284 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2d4sj" event={"ID":"acc1d971-051b-4cf1-ac84-768d60732d3c","Type":"ContainerStarted","Data":"0f67018e109f6e1d170289d454711c7a5bfc566007fb38083b54f51a8c4044fe"} Jun 09 19:43:57.495771 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.495738 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-xpmj4" event={"ID":"da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a","Type":"ContainerStarted","Data":"c7dfd908c85c209524665605b4bbcb93d8e796a081790f1f49808819207919db"} Jun 09 19:43:57.497105 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.497076 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" event={"ID":"b839b141-9e3e-4a4c-b1c9-413b4d32c048","Type":"ContainerStarted","Data":"bf580b9f333ff735026893274ae1fb97fb8efbc0fcc2a7f421ce0a79a60f057d"} Jun 09 19:43:57.498525 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.498505 2573 generic.go:356] "Generic (PLEG): container finished" podID="65742759-dc96-475d-aebd-9b748549a587" containerID="aca6f959adb88646d9794ec3de1c257f1a1e4667b5370298a212d35088ef717d" exitCode=0 Jun 09 19:43:57.498631 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.498564 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sprsl" event={"ID":"65742759-dc96-475d-aebd-9b748549a587","Type":"ContainerDied","Data":"aca6f959adb88646d9794ec3de1c257f1a1e4667b5370298a212d35088ef717d"} Jun 09 19:43:57.499987 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.499950 2573 generic.go:356] "Generic (PLEG): container finished" podID="05c829215119f6b730755cdeec6d1f30" containerID="6fbac26bb872daeb3e8ccbaa291a3a3a33490122c094163b3799d165b0d549f6" exitCode=0 Jun 09 19:43:57.500087 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.499988 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"05c829215119f6b730755cdeec6d1f30","Type":"ContainerDied","Data":"6fbac26bb872daeb3e8ccbaa291a3a3a33490122c094163b3799d165b0d549f6"} Jun 09 19:43:57.503069 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.503044 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" event={"ID":"0a3b2f89-f143-4ae5-ad5c-63606fef5bec","Type":"ContainerStarted","Data":"5584de5af3a48148782b8366d11795909e3ca5bd6fcaffde1e193ca936372d88"} Jun 09 19:43:57.503157 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.503096 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" event={"ID":"0a3b2f89-f143-4ae5-ad5c-63606fef5bec","Type":"ContainerStarted","Data":"6fcff8fcb352c679c6d6ca0b7b4fc6464756c97203fc8a1ea84e6553ed820618"} Jun 09 19:43:57.503157 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.503149 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" event={"ID":"0a3b2f89-f143-4ae5-ad5c-63606fef5bec","Type":"ContainerStarted","Data":"02d4d5ae5e3129f52c591599f5529831d851f254af5eae5b40fe7d8bb3bb1cb9"} Jun 09 19:43:57.503239 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.503191 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" event={"ID":"0a3b2f89-f143-4ae5-ad5c-63606fef5bec","Type":"ContainerStarted","Data":"0659dce5b3c7c6ef557c87965a1d64b6a7ce4b206b9a600b39926bd9f4a8ec7d"} Jun 09 19:43:57.503277 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.503226 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" event={"ID":"0a3b2f89-f143-4ae5-ad5c-63606fef5bec","Type":"ContainerStarted","Data":"0951e568b40bc02c4cdd2948cfcea35bb3dcc8d8cd6b36d1a2ad17b1be15fc65"} Jun 09 19:43:57.503318 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.503292 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" event={"ID":"0a3b2f89-f143-4ae5-ad5c-63606fef5bec","Type":"ContainerStarted","Data":"3bfa19255a73ce8542274f436d2ec223274a5cacc36c6d25eba5c390fd3b6e59"} Jun 09 19:43:57.504343 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.504320 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bvf2b" event={"ID":"f8c2937d-ae68-425d-a9b2-7d2970afbcbf","Type":"ContainerStarted","Data":"43535bc2997c80d262d7221d748a43ab7b7f90d94f2c914f142ddafc2622c225"} Jun 09 19:43:57.509170 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.509110 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2d4sj" podStartSLOduration=7.4571696339999995 podStartE2EDuration="22.509098876s" totalImagesPullingTime="15.051929242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:43:57.508751277 +0000 UTC m=+22.746916889" watchObservedRunningTime="2026-06-09 19:43:57.509098876 +0000 UTC m=+22.747264517" Jun 09 19:43:57.522114 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.522074 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-xpmj4" podStartSLOduration=2.9510976319999997 podStartE2EDuration="22.522063155s" totalImagesPullingTime="19.570965523s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:43:57.521753169 +0000 UTC m=+22.759918781" watchObservedRunningTime="2026-06-09 19:43:57.522063155 +0000 UTC m=+22.760228765" Jun 09 19:43:57.567055 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.566488 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bvf2b" podStartSLOduration=2.965960814 podStartE2EDuration="22.566469006s" totalImagesPullingTime="19.600508192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:43:57.566015645 +0000 UTC m=+22.804181256" watchObservedRunningTime="2026-06-09 19:43:57.566469006 +0000 UTC m=+22.804634622" Jun 09 19:43:57.777578 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.777456 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:43:57.778112 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:57.778088 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:43:58.256982 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:58.256952 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:43:58.257298 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:58.257073 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:43:58.508577 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:58.508510 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ldw6d" event={"ID":"852e770d-264a-4e28-ae4b-1473059e79f0","Type":"ContainerStarted","Data":"707652bef708c625025cc07f85ddb3cb6d382ccdc6d13a264d334089d49636f6"} Jun 09 19:43:58.510703 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:58.510645 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" event={"ID":"05c829215119f6b730755cdeec6d1f30","Type":"ContainerStarted","Data":"bccf6f4839a7a37dfb7f3b2ab8d4b7a880f00b2ce3d9bbd4525cdc54d8d5f02f"} Jun 09 19:43:58.522428 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:58.522375 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ldw6d" podStartSLOduration=3.933762383 podStartE2EDuration="23.522358241s" totalImagesPullingTime="19.588595858s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:43:58.522020333 +0000 UTC m=+23.760185943" watchObservedRunningTime="2026-06-09 19:43:58.522358241 +0000 UTC m=+23.760523853" Jun 09 19:43:58.535720 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:58.535676 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-8.ec2.internal" podStartSLOduration=22.535660313 podStartE2EDuration="22.535660313s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:43:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:43:58.535305911 +0000 UTC m=+23.773471522" watchObservedRunningTime="2026-06-09 19:43:58.535660313 +0000 UTC m=+23.773825926" Jun 09 19:43:58.540036 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:58.540018 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 19:43:59.251834 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:59.251717 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T19:43:58.540032586Z","UUID":"b703d0ab-821a-4598-8db4-b94e08cf812a","Handler":null,"Name":"","Endpoint":""} Jun 09 19:43:59.254164 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:59.253733 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 19:43:59.254164 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:59.253776 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 19:43:59.257082 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:59.256664 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:43:59.257082 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:59.256664 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:43:59.257082 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:59.256771 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:43:59.257082 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:43:59.256866 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:43:59.518646 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:59.518609 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" event={"ID":"0a3b2f89-f143-4ae5-ad5c-63606fef5bec","Type":"ContainerStarted","Data":"102512e485387e1c65ab6f139af90e80f636552a1f8a5a7eefd8b410e948c12a"} Jun 09 19:43:59.521494 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:59.521015 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 19:43:59.521494 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:59.521478 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" event={"ID":"b839b141-9e3e-4a4c-b1c9-413b4d32c048","Type":"ContainerStarted","Data":"12d489201e66804f96c9f477e7327310d138e796741b45c99ec912e708cc00fe"} Jun 09 19:43:59.936467 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:43:59.936432 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:00.010282 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:00.010189 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:00.256334 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:00.256299 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:44:00.256491 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:00.256442 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:44:00.525722 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:00.525684 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" event={"ID":"b839b141-9e3e-4a4c-b1c9-413b4d32c048","Type":"ContainerStarted","Data":"b4a54586e79ea8b651eec8ea6813ba9ad8dda5efc0e536ccac7dfb9f50436e41"} Jun 09 19:44:00.550442 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:00.550373 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-frfn4" podStartSLOduration=3.549417444 podStartE2EDuration="25.55035849s" totalImagesPullingTime="22.000941046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:44:00.550174749 +0000 UTC m=+25.788340375" watchObservedRunningTime="2026-06-09 19:44:00.55035849 +0000 UTC m=+25.788524100" Jun 09 19:44:01.256197 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:01.256158 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:44:01.256375 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:01.256207 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:44:01.256375 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:01.256288 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:44:01.256457 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:01.256423 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:44:02.256772 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:02.256597 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:44:02.257434 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:02.256853 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:44:02.531722 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:02.531647 2573 generic.go:356] "Generic (PLEG): container finished" podID="65742759-dc96-475d-aebd-9b748549a587" containerID="b6f87bf481dec577145a02b236a571316b663050746ab7ee0e94fc20760e0cf0" exitCode=0 Jun 09 19:44:02.531722 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:02.531704 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sprsl" event={"ID":"65742759-dc96-475d-aebd-9b748549a587","Type":"ContainerDied","Data":"b6f87bf481dec577145a02b236a571316b663050746ab7ee0e94fc20760e0cf0"} Jun 09 19:44:02.535657 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:02.535635 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" event={"ID":"0a3b2f89-f143-4ae5-ad5c-63606fef5bec","Type":"ContainerStarted","Data":"1024dc7a96ece0e4c8f81f183d464da1094cd5cb990009c0bb094f06b39bede4"} Jun 09 19:44:02.535866 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:02.535841 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:44:02.535976 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:02.535914 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:44:02.535976 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:02.535968 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:44:02.551301 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:02.551277 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:44:02.551422 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:02.551379 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:44:02.573933 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:02.573886 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" podStartSLOduration=7.713222269 podStartE2EDuration="27.573873374s" totalImagesPullingTime="19.860651105s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:44:02.573281294 +0000 UTC m=+27.811446896" watchObservedRunningTime="2026-06-09 19:44:02.573873374 +0000 UTC m=+27.812038984" Jun 09 19:44:03.256385 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.256359 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:44:03.256745 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:03.256484 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:44:03.256745 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.256533 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:44:03.256745 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:03.256629 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:44:03.830804 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.830506 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zb4lc"] Jun 09 19:44:03.830804 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.830795 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:44:03.831015 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:03.830878 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:44:03.833481 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.833459 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9phnt"] Jun 09 19:44:03.833620 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.833543 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:44:03.833677 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:03.833640 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:44:03.834299 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.834277 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-74jvx"] Jun 09 19:44:03.834405 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.834359 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:44:03.834471 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:03.834439 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:44:03.835761 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.835741 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:44:03.835877 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.835819 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 19:44:03.836301 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.836278 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2d4sj" Jun 09 19:44:03.890577 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:03.890545 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:04.173687 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:04.173648 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:04.221517 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:04.221488 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:04.542760 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:04.542678 2573 generic.go:356] "Generic (PLEG): container finished" podID="65742759-dc96-475d-aebd-9b748549a587" containerID="6bda96de6402dca0dad2e67df2abde8f8d74e0187503e1cc28d072371ab34aba" exitCode=0 Jun 09 19:44:04.543194 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:04.542758 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sprsl" event={"ID":"65742759-dc96-475d-aebd-9b748549a587","Type":"ContainerDied","Data":"6bda96de6402dca0dad2e67df2abde8f8d74e0187503e1cc28d072371ab34aba"} Jun 09 19:44:04.862044 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:04.861974 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:04.907217 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:04.907189 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:05.256866 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:05.256838 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:44:05.257046 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:05.256921 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:44:05.257046 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:05.256942 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:44:05.257178 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:05.257039 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:44:05.257178 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:05.257072 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:44:05.257281 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:05.257179 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:44:06.549712 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:06.549636 2573 generic.go:356] "Generic (PLEG): container finished" podID="65742759-dc96-475d-aebd-9b748549a587" containerID="99c28522745efce1dc2634ce37cd000e07c62f38b52321dc6c3d210a1832b5b2" exitCode=0 Jun 09 19:44:06.549712 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:06.549689 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sprsl" event={"ID":"65742759-dc96-475d-aebd-9b748549a587","Type":"ContainerDied","Data":"99c28522745efce1dc2634ce37cd000e07c62f38b52321dc6c3d210a1832b5b2"} Jun 09 19:44:07.256408 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:07.256369 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:44:07.256584 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:07.256369 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:44:07.256584 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:07.256492 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:44:07.256584 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:07.256388 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:44:07.256584 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:07.256574 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zb4lc" podUID="a499920d-ce03-48e4-b65a-52380b7373fd" Jun 09 19:44:07.256820 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:07.256619 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9phnt" podUID="d5a3d736-aaad-4c34-b800-4d9d6579adaf" Jun 09 19:44:08.031697 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:08.031659 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:44:08.032148 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:08.031717 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:44:08.032148 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:08.031845 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 19:44:08.032148 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:08.031863 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:44:08.032148 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:08.031894 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret podName:d5a3d736-aaad-4c34-b800-4d9d6579adaf nodeName:}" failed. No retries permitted until 2026-06-09 19:44:40.031880923 +0000 UTC m=+65.270046512 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret") pod "global-pull-secret-syncer-9phnt" (UID: "d5a3d736-aaad-4c34-b800-4d9d6579adaf") : object "kube-system"/"original-pull-secret" not registered Jun 09 19:44:08.032148 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:08.031923 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs podName:70cf497e-8c3e-4fb1-8981-cb9754626d08 nodeName:}" failed. No retries permitted until 2026-06-09 19:44:40.031905191 +0000 UTC m=+65.270070781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs") pod "network-metrics-daemon-74jvx" (UID: "70cf497e-8c3e-4fb1-8981-cb9754626d08") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 19:44:08.132447 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:08.132416 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5j5\" (UniqueName: \"kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5\") pod \"network-check-target-zb4lc\" (UID: \"a499920d-ce03-48e4-b65a-52380b7373fd\") " pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:44:08.132604 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:08.132589 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 19:44:08.132649 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:08.132612 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 19:44:08.132649 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:08.132623 2573 projected.go:196] Error preparing data for projected volume kube-api-access-xr5j5 for pod openshift-network-diagnostics/network-check-target-zb4lc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:44:08.132715 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:08.132684 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5 podName:a499920d-ce03-48e4-b65a-52380b7373fd nodeName:}" failed. No retries permitted until 2026-06-09 19:44:40.132665941 +0000 UTC m=+65.370831549 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xr5j5" (UniqueName: "kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5") pod "network-check-target-zb4lc" (UID: "a499920d-ce03-48e4-b65a-52380b7373fd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 19:44:09.040427 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.040208 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-8.ec2.internal" event="NodeReady" Jun 09 19:44:09.040860 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.040545 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 19:44:09.082327 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.082297 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hwhdb"] Jun 09 19:44:09.084808 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.084787 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fmtbl"] Jun 09 19:44:09.084940 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.084913 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.086609 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.086584 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmtbl" Jun 09 19:44:09.087505 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.087485 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 19:44:09.087650 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.087632 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-88s58\"" Jun 09 19:44:09.087714 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.087629 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 19:44:09.088753 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.088727 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 19:44:09.088908 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.088886 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nxwnv\"" Jun 09 19:44:09.089114 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.089100 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 19:44:09.089220 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.089163 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 19:44:09.093897 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.093852 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hwhdb"] Jun 09 19:44:09.097225 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.097185 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmtbl"] Jun 09 19:44:09.185680 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.185651 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:09.233691 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.233665 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:09.239637 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.239613 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05b48888-07bb-43ac-a02e-87c8e52020d5-tmp-dir\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.239765 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.239659 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74d2baf0-98cd-4c3e-a79a-a63b8db23646-cert\") pod \"ingress-canary-fmtbl\" (UID: \"74d2baf0-98cd-4c3e-a79a-a63b8db23646\") " pod="openshift-ingress-canary/ingress-canary-fmtbl" Jun 09 19:44:09.239765 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.239680 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzc9c\" (UniqueName: \"kubernetes.io/projected/74d2baf0-98cd-4c3e-a79a-a63b8db23646-kube-api-access-xzc9c\") pod \"ingress-canary-fmtbl\" (UID: \"74d2baf0-98cd-4c3e-a79a-a63b8db23646\") " pod="openshift-ingress-canary/ingress-canary-fmtbl" Jun 09 19:44:09.239765 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.239695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.239765 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.239745 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05b48888-07bb-43ac-a02e-87c8e52020d5-config-volume\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.239917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.239778 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mls6f\" (UniqueName: \"kubernetes.io/projected/05b48888-07bb-43ac-a02e-87c8e52020d5-kube-api-access-mls6f\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.256775 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.256754 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:44:09.256895 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.256755 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:44:09.256895 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.256875 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:44:09.261150 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.260670 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rx2qz\"" Jun 09 19:44:09.261150 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.261065 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 19:44:09.261315 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.261202 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d8jnq\"" Jun 09 19:44:09.261981 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.261551 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 19:44:09.261981 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.261718 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 19:44:09.261981 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.261966 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 19:44:09.341044 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.341005 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74d2baf0-98cd-4c3e-a79a-a63b8db23646-cert\") pod \"ingress-canary-fmtbl\" (UID: \"74d2baf0-98cd-4c3e-a79a-a63b8db23646\") " pod="openshift-ingress-canary/ingress-canary-fmtbl" Jun 09 19:44:09.341243 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.341058 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzc9c\" (UniqueName: \"kubernetes.io/projected/74d2baf0-98cd-4c3e-a79a-a63b8db23646-kube-api-access-xzc9c\") pod \"ingress-canary-fmtbl\" (UID: \"74d2baf0-98cd-4c3e-a79a-a63b8db23646\") " pod="openshift-ingress-canary/ingress-canary-fmtbl" Jun 09 19:44:09.341243 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.341086 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.341243 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.341119 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05b48888-07bb-43ac-a02e-87c8e52020d5-config-volume\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.341243 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.341165 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mls6f\" (UniqueName: \"kubernetes.io/projected/05b48888-07bb-43ac-a02e-87c8e52020d5-kube-api-access-mls6f\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.341464 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.341246 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05b48888-07bb-43ac-a02e-87c8e52020d5-tmp-dir\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.341464 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:09.341266 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 19:44:09.341464 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:09.341340 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls podName:05b48888-07bb-43ac-a02e-87c8e52020d5 nodeName:}" failed. No retries permitted until 2026-06-09 19:44:09.841319385 +0000 UTC m=+35.079484993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls") pod "dns-default-hwhdb" (UID: "05b48888-07bb-43ac-a02e-87c8e52020d5") : secret "dns-default-metrics-tls" not found Jun 09 19:44:09.341591 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.341543 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/05b48888-07bb-43ac-a02e-87c8e52020d5-tmp-dir\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.341784 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.341762 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/05b48888-07bb-43ac-a02e-87c8e52020d5-config-volume\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.345820 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.345780 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/74d2baf0-98cd-4c3e-a79a-a63b8db23646-cert\") pod \"ingress-canary-fmtbl\" (UID: \"74d2baf0-98cd-4c3e-a79a-a63b8db23646\") " pod="openshift-ingress-canary/ingress-canary-fmtbl" Jun 09 19:44:09.349611 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.349564 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mls6f\" (UniqueName: \"kubernetes.io/projected/05b48888-07bb-43ac-a02e-87c8e52020d5-kube-api-access-mls6f\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.349992 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.349968 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzc9c\" (UniqueName: \"kubernetes.io/projected/74d2baf0-98cd-4c3e-a79a-a63b8db23646-kube-api-access-xzc9c\") pod \"ingress-canary-fmtbl\" (UID: \"74d2baf0-98cd-4c3e-a79a-a63b8db23646\") " pod="openshift-ingress-canary/ingress-canary-fmtbl" Jun 09 19:44:09.404941 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.404913 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmtbl" Jun 09 19:44:09.846332 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:09.846240 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:09.846500 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:09.846385 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 19:44:09.846500 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:09.846466 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls podName:05b48888-07bb-43ac-a02e-87c8e52020d5 nodeName:}" failed. No retries permitted until 2026-06-09 19:44:10.846446397 +0000 UTC m=+36.084611986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls") pod "dns-default-hwhdb" (UID: "05b48888-07bb-43ac-a02e-87c8e52020d5") : secret "dns-default-metrics-tls" not found Jun 09 19:44:10.532403 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:10.532360 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:10.548681 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:10.548507 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmtbl"] Jun 09 19:44:10.551363 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:44:10.551332 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74d2baf0_98cd_4c3e_a79a_a63b8db23646.slice/crio-e7a5269c20aa03e31915afc39afa35e019778860b84b2811d6009372c1061d49 WatchSource:0}: Error finding container e7a5269c20aa03e31915afc39afa35e019778860b84b2811d6009372c1061d49: Status 404 returned error can't find the container with id e7a5269c20aa03e31915afc39afa35e019778860b84b2811d6009372c1061d49 Jun 09 19:44:10.559842 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:10.559814 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmtbl" event={"ID":"74d2baf0-98cd-4c3e-a79a-a63b8db23646","Type":"ContainerStarted","Data":"e7a5269c20aa03e31915afc39afa35e019778860b84b2811d6009372c1061d49"} Jun 09 19:44:10.562695 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:10.562666 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sprsl" event={"ID":"65742759-dc96-475d-aebd-9b748549a587","Type":"ContainerStarted","Data":"3029dd4a2828df161bc167e9d98d776153184c648c72187f11980f6e492bcf0b"} Jun 09 19:44:10.587630 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:10.587602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:10.854065 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:10.853948 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:10.854228 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:10.854087 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 19:44:10.854228 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:10.854162 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls podName:05b48888-07bb-43ac-a02e-87c8e52020d5 nodeName:}" failed. No retries permitted until 2026-06-09 19:44:12.854143792 +0000 UTC m=+38.092309404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls") pod "dns-default-hwhdb" (UID: "05b48888-07bb-43ac-a02e-87c8e52020d5") : secret "dns-default-metrics-tls" not found Jun 09 19:44:11.486734 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:11.486695 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:11.568078 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:11.568042 2573 generic.go:356] "Generic (PLEG): container finished" podID="65742759-dc96-475d-aebd-9b748549a587" containerID="3029dd4a2828df161bc167e9d98d776153184c648c72187f11980f6e492bcf0b" exitCode=0 Jun 09 19:44:11.568530 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:11.568089 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sprsl" event={"ID":"65742759-dc96-475d-aebd-9b748549a587","Type":"ContainerDied","Data":"3029dd4a2828df161bc167e9d98d776153184c648c72187f11980f6e492bcf0b"} Jun 09 19:44:11.587957 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:11.587929 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:12.571944 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:12.571829 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmtbl" event={"ID":"74d2baf0-98cd-4c3e-a79a-a63b8db23646","Type":"ContainerStarted","Data":"d6e92074948063a2575bf61696a8da201871c7482d625e3e030d6510aac47883"} Jun 09 19:44:12.574838 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:12.574811 2573 generic.go:356] "Generic (PLEG): container finished" podID="65742759-dc96-475d-aebd-9b748549a587" containerID="ba23201afae19be198ac40c96d3c2029a5a7b1fc7d971b8d7f61b49f99cf60d2" exitCode=0 Jun 09 19:44:12.574947 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:12.574863 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sprsl" event={"ID":"65742759-dc96-475d-aebd-9b748549a587","Type":"ContainerDied","Data":"ba23201afae19be198ac40c96d3c2029a5a7b1fc7d971b8d7f61b49f99cf60d2"} Jun 09 19:44:12.586042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:12.585999 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fmtbl" podStartSLOduration=1.9013831350000001 podStartE2EDuration="3.58598586s" totalImagesPullingTime="1.684602725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:44:12.585687215 +0000 UTC m=+37.823852826" watchObservedRunningTime="2026-06-09 19:44:12.58598586 +0000 UTC m=+37.824151471" Jun 09 19:44:12.874101 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:12.874027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:12.874261 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:12.874186 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 19:44:12.874261 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:12.874264 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls podName:05b48888-07bb-43ac-a02e-87c8e52020d5 nodeName:}" failed. No retries permitted until 2026-06-09 19:44:16.874245017 +0000 UTC m=+42.112410624 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls") pod "dns-default-hwhdb" (UID: "05b48888-07bb-43ac-a02e-87c8e52020d5") : secret "dns-default-metrics-tls" not found Jun 09 19:44:13.578602 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:13.578520 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:13.581229 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:13.581200 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sprsl" event={"ID":"65742759-dc96-475d-aebd-9b748549a587","Type":"ContainerStarted","Data":"aeecafa23b4e9f264c22bf68004f86f7fd2979c03bccb92bfc955418feac9c85"} Jun 09 19:44:13.617895 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:13.617842 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sprsl" podStartSLOduration=8.837911835 podStartE2EDuration="38.6178226s" totalImagesPullingTime="29.779910765s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:44:13.617333279 +0000 UTC m=+38.855498893" watchObservedRunningTime="2026-06-09 19:44:13.6178226 +0000 UTC m=+38.855988212" Jun 09 19:44:13.682491 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:13.682464 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:13.784481 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:13.784424 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:13.835582 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:13.835486 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:14.438805 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:14.438775 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:14.538647 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:14.538614 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:16.901608 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:16.901578 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:16.901944 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:16.901740 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 19:44:16.901944 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:16.901802 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls podName:05b48888-07bb-43ac-a02e-87c8e52020d5 nodeName:}" failed. No retries permitted until 2026-06-09 19:44:24.901786066 +0000 UTC m=+50.139951656 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls") pod "dns-default-hwhdb" (UID: "05b48888-07bb-43ac-a02e-87c8e52020d5") : secret "dns-default-metrics-tls" not found Jun 09 19:44:24.959694 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:24.959655 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:24.960248 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:24.959789 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 19:44:24.960248 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:24.959854 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls podName:05b48888-07bb-43ac-a02e-87c8e52020d5 nodeName:}" failed. No retries permitted until 2026-06-09 19:44:40.959835815 +0000 UTC m=+66.198001423 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls") pod "dns-default-hwhdb" (UID: "05b48888-07bb-43ac-a02e-87c8e52020d5") : secret "dns-default-metrics-tls" not found Jun 09 19:44:26.188100 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:26.188065 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:26.288038 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:26.287999 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:31.559474 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:31.559439 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:31.611873 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:31.611843 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:32.251795 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:32.251759 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:32.299574 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:32.299539 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:34.564253 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:34.564229 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ql628" Jun 09 19:44:34.710802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:34.710769 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:34.810509 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:34.810474 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:35.458652 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.458623 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z"] Jun 09 19:44:35.462036 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.462016 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf"] Jun 09 19:44:35.462203 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.462185 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" Jun 09 19:44:35.463817 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.463796 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.464702 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.464678 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 19:44:35.465871 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.465846 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-q6z6g\"" Jun 09 19:44:35.465871 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.465852 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 19:44:35.466021 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.465868 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 19:44:35.466021 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.465874 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 19:44:35.466251 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.466222 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 19:44:35.466487 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.466470 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 19:44:35.466686 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.466543 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 19:44:35.466686 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.466545 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 19:44:35.470823 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.470794 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z"] Jun 09 19:44:35.477740 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.477713 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf"] Jun 09 19:44:35.528344 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.528313 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.528505 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.528346 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tn4nk\" (UniqueName: \"kubernetes.io/projected/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-kube-api-access-tn4nk\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.528505 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.528387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-hub\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.528505 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.528420 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d2e61dd-b914-4ad1-990e-f10fad2bd810-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-995947768-mtd2z\" (UID: \"9d2e61dd-b914-4ad1-990e-f10fad2bd810\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" Jun 09 19:44:35.528505 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.528439 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45gpc\" (UniqueName: \"kubernetes.io/projected/9d2e61dd-b914-4ad1-990e-f10fad2bd810-kube-api-access-45gpc\") pod \"managed-serviceaccount-addon-agent-995947768-mtd2z\" (UID: \"9d2e61dd-b914-4ad1-990e-f10fad2bd810\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" Jun 09 19:44:35.528505 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.528464 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.528505 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.528481 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-ca\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.528689 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.528517 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.629080 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.629051 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.629526 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.629088 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.629526 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.629115 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tn4nk\" (UniqueName: \"kubernetes.io/projected/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-kube-api-access-tn4nk\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.629526 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.629181 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-hub\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.629526 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.629210 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d2e61dd-b914-4ad1-990e-f10fad2bd810-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-995947768-mtd2z\" (UID: \"9d2e61dd-b914-4ad1-990e-f10fad2bd810\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" Jun 09 19:44:35.629526 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.629239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45gpc\" (UniqueName: \"kubernetes.io/projected/9d2e61dd-b914-4ad1-990e-f10fad2bd810-kube-api-access-45gpc\") pod \"managed-serviceaccount-addon-agent-995947768-mtd2z\" (UID: \"9d2e61dd-b914-4ad1-990e-f10fad2bd810\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" Jun 09 19:44:35.629526 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.629281 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.629526 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.629307 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-ca\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.630389 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.630016 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.633063 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.633044 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-ca\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.633063 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.633055 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.633210 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.633046 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-hub\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.633210 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.633204 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.633276 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.633232 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9d2e61dd-b914-4ad1-990e-f10fad2bd810-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-995947768-mtd2z\" (UID: \"9d2e61dd-b914-4ad1-990e-f10fad2bd810\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" Jun 09 19:44:35.636509 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.636489 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45gpc\" (UniqueName: \"kubernetes.io/projected/9d2e61dd-b914-4ad1-990e-f10fad2bd810-kube-api-access-45gpc\") pod \"managed-serviceaccount-addon-agent-995947768-mtd2z\" (UID: \"9d2e61dd-b914-4ad1-990e-f10fad2bd810\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" Jun 09 19:44:35.636653 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.636637 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tn4nk\" (UniqueName: \"kubernetes.io/projected/0df84bb3-d2bd-4653-ae82-8e75c44c9fdf-kube-api-access-tn4nk\") pod \"cluster-proxy-proxy-agent-6f9f498c4f-4lmzf\" (UID: \"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.782694 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.782613 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" Jun 09 19:44:35.786977 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.786957 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:44:35.910256 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.910227 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z"] Jun 09 19:44:35.913389 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:44:35.913364 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d2e61dd_b914_4ad1_990e_f10fad2bd810.slice/crio-7fc1b7baa894965160cb607ef5258b915e63f6ac417fceb6d7163687cc835355 WatchSource:0}: Error finding container 7fc1b7baa894965160cb607ef5258b915e63f6ac417fceb6d7163687cc835355: Status 404 returned error can't find the container with id 7fc1b7baa894965160cb607ef5258b915e63f6ac417fceb6d7163687cc835355 Jun 09 19:44:35.924725 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:35.924703 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf"] Jun 09 19:44:35.927736 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:44:35.927700 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0df84bb3_d2bd_4653_ae82_8e75c44c9fdf.slice/crio-91cc0dcabd0a7ab9f7d6ebf46ee93d92ed7a0b067145dd1b1f1ddc00f878852f WatchSource:0}: Error finding container 91cc0dcabd0a7ab9f7d6ebf46ee93d92ed7a0b067145dd1b1f1ddc00f878852f: Status 404 returned error can't find the container with id 91cc0dcabd0a7ab9f7d6ebf46ee93d92ed7a0b067145dd1b1f1ddc00f878852f Jun 09 19:44:36.634770 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:36.634736 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" event={"ID":"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf","Type":"ContainerStarted","Data":"91cc0dcabd0a7ab9f7d6ebf46ee93d92ed7a0b067145dd1b1f1ddc00f878852f"} Jun 09 19:44:36.635761 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:36.635727 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" event={"ID":"9d2e61dd-b914-4ad1-990e-f10fad2bd810","Type":"ContainerStarted","Data":"7fc1b7baa894965160cb607ef5258b915e63f6ac417fceb6d7163687cc835355"} Jun 09 19:44:40.064363 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.064317 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:44:40.064863 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.064398 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:44:40.067115 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.067089 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 19:44:40.067115 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.067109 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 19:44:40.075269 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:40.075243 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 19:44:40.075369 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:40.075320 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs podName:70cf497e-8c3e-4fb1-8981-cb9754626d08 nodeName:}" failed. No retries permitted until 2026-06-09 19:45:44.075296708 +0000 UTC m=+129.313462299 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs") pod "network-metrics-daemon-74jvx" (UID: "70cf497e-8c3e-4fb1-8981-cb9754626d08") : secret "metrics-daemon-secret" not found Jun 09 19:44:40.078294 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.078243 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d5a3d736-aaad-4c34-b800-4d9d6579adaf-original-pull-secret\") pod \"global-pull-secret-syncer-9phnt\" (UID: \"d5a3d736-aaad-4c34-b800-4d9d6579adaf\") " pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:44:40.165510 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.165469 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr5j5\" (UniqueName: \"kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5\") pod \"network-check-target-zb4lc\" (UID: \"a499920d-ce03-48e4-b65a-52380b7373fd\") " pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:44:40.168047 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.168025 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 19:44:40.177289 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.177268 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9phnt" Jun 09 19:44:40.178316 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.178290 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 19:44:40.189195 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.189161 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr5j5\" (UniqueName: \"kubernetes.io/projected/a499920d-ce03-48e4-b65a-52380b7373fd-kube-api-access-xr5j5\") pod \"network-check-target-zb4lc\" (UID: \"a499920d-ce03-48e4-b65a-52380b7373fd\") " pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:44:40.384382 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.384349 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9phnt"] Jun 09 19:44:40.473196 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.473161 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rx2qz\"" Jun 09 19:44:40.481450 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.481429 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:44:40.971426 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:40.971375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:44:40.971600 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:40.971517 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 19:44:40.971600 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:44:40.971591 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls podName:05b48888-07bb-43ac-a02e-87c8e52020d5 nodeName:}" failed. No retries permitted until 2026-06-09 19:45:12.971568536 +0000 UTC m=+98.209734129 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls") pod "dns-default-hwhdb" (UID: "05b48888-07bb-43ac-a02e-87c8e52020d5") : secret "dns-default-metrics-tls" not found Jun 09 19:44:41.478857 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:44:41.478821 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5a3d736_aaad_4c34_b800_4d9d6579adaf.slice/crio-e47366d3615729cc56d3180521aebbdfb05a121d5959a699174eabd05df03724 WatchSource:0}: Error finding container e47366d3615729cc56d3180521aebbdfb05a121d5959a699174eabd05df03724: Status 404 returned error can't find the container with id e47366d3615729cc56d3180521aebbdfb05a121d5959a699174eabd05df03724 Jun 09 19:44:41.596839 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:41.596811 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zb4lc"] Jun 09 19:44:41.599505 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:44:41.599467 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda499920d_ce03_48e4_b65a_52380b7373fd.slice/crio-17fd53a1623e2e12703f543b7429450a39da8c39191dbab1f0c9cd996ba4dea1 WatchSource:0}: Error finding container 17fd53a1623e2e12703f543b7429450a39da8c39191dbab1f0c9cd996ba4dea1: Status 404 returned error can't find the container with id 17fd53a1623e2e12703f543b7429450a39da8c39191dbab1f0c9cd996ba4dea1 Jun 09 19:44:41.651944 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:41.651910 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zb4lc" event={"ID":"a499920d-ce03-48e4-b65a-52380b7373fd","Type":"ContainerStarted","Data":"17fd53a1623e2e12703f543b7429450a39da8c39191dbab1f0c9cd996ba4dea1"} Jun 09 19:44:41.653563 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:41.653527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" event={"ID":"9d2e61dd-b914-4ad1-990e-f10fad2bd810","Type":"ContainerStarted","Data":"5cf0fbcd493639e931cbd304bb3d35913986e95de0777125e7d58700a0d46d98"} Jun 09 19:44:41.654773 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:41.654748 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9phnt" event={"ID":"d5a3d736-aaad-4c34-b800-4d9d6579adaf","Type":"ContainerStarted","Data":"e47366d3615729cc56d3180521aebbdfb05a121d5959a699174eabd05df03724"} Jun 09 19:44:41.666709 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:41.666671 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" podStartSLOduration=2.281381928 podStartE2EDuration="6.666658294s" totalImagesPullingTime="4.385276366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:44:41.666614095 +0000 UTC m=+66.904779706" watchObservedRunningTime="2026-06-09 19:44:41.666658294 +0000 UTC m=+66.904823904" Jun 09 19:44:42.413650 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:42.413590 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:42.464825 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:42.464749 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:42.661549 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:42.661261 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" event={"ID":"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf","Type":"ContainerStarted","Data":"0036321f2b81748d4edbee32744b11d31348c826a293cea6aab04253dcced878"} Jun 09 19:44:42.661549 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:42.661313 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" event={"ID":"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf","Type":"ContainerStarted","Data":"5905191b5ad766446a46e720b86bdaf63120f161752138eed6500ab9f7599c88"} Jun 09 19:44:42.661549 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:42.661331 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" event={"ID":"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf","Type":"ContainerStarted","Data":"69abb83599610c51823187fd3a5234dc04cdd6b6724bdcc84be4a21502a79834"} Jun 09 19:44:42.680869 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:42.680708 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" podStartSLOduration=1.642743264 podStartE2EDuration="7.68068901s" totalImagesPullingTime="6.037945746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:44:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:44:42.67847253 +0000 UTC m=+67.916638142" watchObservedRunningTime="2026-06-09 19:44:42.68068901 +0000 UTC m=+67.918854622" Jun 09 19:44:46.674676 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:46.674637 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9phnt" event={"ID":"d5a3d736-aaad-4c34-b800-4d9d6579adaf","Type":"ContainerStarted","Data":"025bf92aeaca7edeefd2f8b15c2c31160ae510bb528ac57c1df48e394b1e8708"} Jun 09 19:44:46.676096 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:46.676071 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zb4lc" event={"ID":"a499920d-ce03-48e4-b65a-52380b7373fd","Type":"ContainerStarted","Data":"344a7d8b6138f9f04ddc9e504e312c41153382bad209953145fee8f58bf09a11"} Jun 09 19:44:46.676226 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:46.676169 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:44:46.704146 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:46.704070 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9phnt" podStartSLOduration=67.276686297 podStartE2EDuration="1m11.704057974s" totalImagesPullingTime="4.427371677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:44:46.689588978 +0000 UTC m=+71.927754611" watchObservedRunningTime="2026-06-09 19:44:46.704057974 +0000 UTC m=+71.942223599" Jun 09 19:44:46.704494 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:46.704465 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zb4lc" podStartSLOduration=67.401761601 podStartE2EDuration="1m11.704455669s" totalImagesPullingTime="4.302694068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:44:46.703429476 +0000 UTC m=+71.941595088" watchObservedRunningTime="2026-06-09 19:44:46.704455669 +0000 UTC m=+71.942621295" Jun 09 19:44:57.532294 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:57.532251 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:44:57.585332 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:44:57.585299 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:45:12.997184 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:45:12.997123 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:45:12.997577 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:45:12.997280 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 19:45:12.997577 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:45:12.997347 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls podName:05b48888-07bb-43ac-a02e-87c8e52020d5 nodeName:}" failed. No retries permitted until 2026-06-09 19:46:16.997330783 +0000 UTC m=+162.235496388 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls") pod "dns-default-hwhdb" (UID: "05b48888-07bb-43ac-a02e-87c8e52020d5") : secret "dns-default-metrics-tls" not found Jun 09 19:45:17.682939 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:45:17.682907 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zb4lc" Jun 09 19:45:44.110961 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:45:44.110923 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:45:44.111394 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:45:44.111076 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 19:45:44.111394 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:45:44.111163 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs podName:70cf497e-8c3e-4fb1-8981-cb9754626d08 nodeName:}" failed. No retries permitted until 2026-06-09 19:47:46.111141524 +0000 UTC m=+251.349307126 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs") pod "network-metrics-daemon-74jvx" (UID: "70cf497e-8c3e-4fb1-8981-cb9754626d08") : secret "metrics-daemon-secret" not found Jun 09 19:46:12.098520 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:46:12.098470 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hwhdb" podUID="05b48888-07bb-43ac-a02e-87c8e52020d5" Jun 09 19:46:12.283821 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:46:12.283779 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:46:12.923739 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:46:12.923710 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hwhdb" Jun 09 19:46:17.026608 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:46:17.026511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:46:17.026975 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:46:17.026635 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 19:46:17.026975 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:46:17.026694 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls podName:05b48888-07bb-43ac-a02e-87c8e52020d5 nodeName:}" failed. No retries permitted until 2026-06-09 19:48:19.026675958 +0000 UTC m=+284.264841550 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls") pod "dns-default-hwhdb" (UID: "05b48888-07bb-43ac-a02e-87c8e52020d5") : secret "dns-default-metrics-tls" not found Jun 09 19:46:23.256975 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:46:23.256938 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:46:42.001934 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:46:42.001847 2573 generic.go:356] "Generic (PLEG): container finished" podID="9d2e61dd-b914-4ad1-990e-f10fad2bd810" containerID="5cf0fbcd493639e931cbd304bb3d35913986e95de0777125e7d58700a0d46d98" exitCode=255 Jun 09 19:46:42.002313 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:46:42.001922 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" event={"ID":"9d2e61dd-b914-4ad1-990e-f10fad2bd810","Type":"ContainerDied","Data":"5cf0fbcd493639e931cbd304bb3d35913986e95de0777125e7d58700a0d46d98"} Jun 09 19:46:42.002313 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:46:42.002242 2573 scope.go:117] "RemoveContainer" containerID="5cf0fbcd493639e931cbd304bb3d35913986e95de0777125e7d58700a0d46d98" Jun 09 19:46:43.007612 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:46:43.006971 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-995947768-mtd2z" event={"ID":"9d2e61dd-b914-4ad1-990e-f10fad2bd810","Type":"ContainerStarted","Data":"060bb9a47cb60bc8861f1ad064fb4acdd90b6067e62525511fba783ddc699e67"} Jun 09 19:46:52.362308 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:46:52.362276 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:15.245814 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:15.245775 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:38.424369 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:38.424332 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:38.478030 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:38.477991 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:40.626284 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:40.626250 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:40.675433 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:40.675400 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:42.552898 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:42.552866 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:42.862552 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:42.862461 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:42.914135 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:42.914088 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:43.263991 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:43.263958 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:43.311646 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:43.311606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:43.552556 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:43.552472 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:43.602626 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:43.602597 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:43.780727 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:43.780693 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:43.874879 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:43.874779 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:43.975439 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:43.975381 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:44.707288 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:44.707256 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xpmj4_da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a/dns-node-resolver/0.log" Jun 09 19:47:45.180889 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:45.180853 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:45.307523 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:45.307499 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bvf2b_f8c2937d-ae68-425d-a9b2-7d2970afbcbf/node-ca/0.log" Jun 09 19:47:45.646841 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:45.646809 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:45.748492 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:45.748453 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:45.995479 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:45.995367 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:46.105433 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:46.105401 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fmtbl_74d2baf0-98cd-4c3e-a79a-a63b8db23646/serve-healthcheck-canary/0.log" Jun 09 19:47:46.131734 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:46.131695 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:47:46.131857 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:47:46.131836 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 19:47:46.131902 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:47:46.131891 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs podName:70cf497e-8c3e-4fb1-8981-cb9754626d08 nodeName:}" failed. No retries permitted until 2026-06-09 19:49:48.131876567 +0000 UTC m=+373.370042156 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs") pod "network-metrics-daemon-74jvx" (UID: "70cf497e-8c3e-4fb1-8981-cb9754626d08") : secret "metrics-daemon-secret" not found Jun 09 19:47:48.448683 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:48.448649 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:48.873620 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:48.873527 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:49.047779 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:49.047744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:49.148364 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:49.148325 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:49.193414 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:49.193377 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:49.248842 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:49.248810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:49.372913 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:49.372862 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:49.769228 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:49.769191 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:49.967735 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:49.967689 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:50.970690 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:50.970657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:51.372912 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:51.372812 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:51.569494 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:51.569462 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:51.774015 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:51.773978 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:51.972560 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:51.972529 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:52.777098 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:52.777065 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:52.831372 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:52.831336 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:53.037023 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:53.036911 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:53.168890 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:53.168862 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:53.375277 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:53.375167 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:53.574612 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:53.574567 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:53.768402 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:53.768366 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:53.971353 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:53.971320 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:54.966973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:54.966931 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:55.178557 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:55.178523 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:55.373567 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:55.373474 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:55.475577 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:55.475537 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:55.575552 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:55.575523 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:55.770432 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:55.770400 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:56.366926 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:56.366892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:56.792678 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:56.792639 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:57.211022 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:57.210987 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:57.577567 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:57.577473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:57.767611 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:57.767581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:58.365911 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:58.365875 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:58.771186 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:58.771151 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:58.968537 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:58.968499 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:59.367183 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:59.367147 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:59.467614 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:59.467584 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:59.567898 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:59.567870 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:47:59.614612 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:47:59.614581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:03.444920 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.444886 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:03.549787 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.549749 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:03.624169 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.624110 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:03.729280 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.729198 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-57hwp"] Jun 09 19:48:03.732255 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.732235 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.734736 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.734682 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 19:48:03.734835 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.734708 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 19:48:03.735870 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.735852 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 19:48:03.735919 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.735869 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-g2fxf\"" Jun 09 19:48:03.735919 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.735861 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 19:48:03.749552 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.749531 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-57hwp"] Jun 09 19:48:03.783468 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.783442 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:03.859783 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.859759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-crio-socket\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.859899 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.859833 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-data-volume\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.859899 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.859854 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.859899 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.859870 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rm2px\" (UniqueName: \"kubernetes.io/projected/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-kube-api-access-rm2px\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.859899 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.859886 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.880296 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.880264 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:03.961233 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.961203 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-data-volume\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.961233 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.961237 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.961442 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.961255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rm2px\" (UniqueName: \"kubernetes.io/projected/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-kube-api-access-rm2px\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.961442 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.961272 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.961442 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.961293 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-crio-socket\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.961442 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.961358 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-crio-socket\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.961645 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.961620 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-data-volume\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.961928 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.961908 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.963539 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.963520 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.968904 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.968880 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rm2px\" (UniqueName: \"kubernetes.io/projected/f9bc14ef-85cb-410a-8eb8-7d1076d594c9-kube-api-access-rm2px\") pod \"insights-runtime-extractor-57hwp\" (UID: \"f9bc14ef-85cb-410a-8eb8-7d1076d594c9\") " pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:03.984603 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:03.984553 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:04.040830 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:04.040811 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-57hwp" Jun 09 19:48:04.120230 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:04.120196 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:04.160635 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:04.160609 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-57hwp"] Jun 09 19:48:04.163104 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:48:04.163080 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9bc14ef_85cb_410a_8eb8_7d1076d594c9.slice/crio-43aed5c260ac0d7703863172ff33eaef47ed00617e2718ddd40dd88bccecb08a WatchSource:0}: Error finding container 43aed5c260ac0d7703863172ff33eaef47ed00617e2718ddd40dd88bccecb08a: Status 404 returned error can't find the container with id 43aed5c260ac0d7703863172ff33eaef47ed00617e2718ddd40dd88bccecb08a Jun 09 19:48:04.187318 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:04.187290 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:04.237156 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:04.237059 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57hwp" event={"ID":"f9bc14ef-85cb-410a-8eb8-7d1076d594c9","Type":"ContainerStarted","Data":"661bbe7255be314ad2a7452c336a3e1c1412d2b75773c69b9b4889472c57a165"} Jun 09 19:48:04.237156 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:04.237111 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57hwp" event={"ID":"f9bc14ef-85cb-410a-8eb8-7d1076d594c9","Type":"ContainerStarted","Data":"43aed5c260ac0d7703863172ff33eaef47ed00617e2718ddd40dd88bccecb08a"} Jun 09 19:48:04.321784 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:04.321751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:04.369662 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:04.369629 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:05.241500 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:05.241471 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57hwp" event={"ID":"f9bc14ef-85cb-410a-8eb8-7d1076d594c9","Type":"ContainerStarted","Data":"ef6434dfdce9b5b8b10f0123c60f84e9e0a486b30fe4c468c791312ea670f177"} Jun 09 19:48:05.333627 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:05.333583 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:05.531445 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:05.531352 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:05.744717 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:05.744681 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:05.793519 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:05.793432 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:06.084103 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:06.083986 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:07.084534 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:07.084501 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:07.184983 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:07.184950 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:07.250115 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:07.250082 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57hwp" event={"ID":"f9bc14ef-85cb-410a-8eb8-7d1076d594c9","Type":"ContainerStarted","Data":"8ed3140cf807ae46ec782f5117834714d3f75d7c98cface59630910a18a2c79d"} Jun 09 19:48:07.268267 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:07.268220 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-57hwp" podStartSLOduration=2.181162671 podStartE2EDuration="4.268206874s" totalImagesPullingTime="2.087044203s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 19:48:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:48:07.266658044 +0000 UTC m=+272.504823655" watchObservedRunningTime="2026-06-09 19:48:07.268206874 +0000 UTC m=+272.506372492" Jun 09 19:48:10.573291 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:10.573257 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:10.670242 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:10.670212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:11.563597 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.563567 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86bb6cc6f-r7k77"] Jun 09 19:48:11.566613 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.566596 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.568820 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.568802 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 19:48:11.568968 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.568943 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 19:48:11.569235 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.569218 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 19:48:11.570122 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.570100 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 19:48:11.570253 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.570160 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 19:48:11.570253 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.570162 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 19:48:11.570374 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.570178 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 19:48:11.570374 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.570276 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tjzsf\"" Jun 09 19:48:11.579604 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.579580 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86bb6cc6f-r7k77"] Jun 09 19:48:11.609425 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.609399 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwpc6\" (UniqueName: \"kubernetes.io/projected/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-kube-api-access-kwpc6\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.609523 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.609432 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-serving-cert\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.609523 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.609449 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-service-ca\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.609605 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.609529 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-oauth-config\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.609605 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.609547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-oauth-serving-cert\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.609605 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.609564 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-config\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.710259 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.710203 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwpc6\" (UniqueName: \"kubernetes.io/projected/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-kube-api-access-kwpc6\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.710452 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.710274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-serving-cert\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.710452 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.710297 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-service-ca\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.710452 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.710370 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-oauth-config\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.710452 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.710391 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-oauth-serving-cert\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.710452 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.710413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-config\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.711185 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.711155 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-config\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.711308 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.711255 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-service-ca\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.711308 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.711265 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-oauth-serving-cert\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.712737 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.712716 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-oauth-config\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.712819 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.712774 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-serving-cert\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.718468 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.718438 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwpc6\" (UniqueName: \"kubernetes.io/projected/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-kube-api-access-kwpc6\") pod \"console-86bb6cc6f-r7k77\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.879212 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.879186 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:11.998482 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:11.998457 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86bb6cc6f-r7k77"] Jun 09 19:48:12.000432 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:48:12.000406 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfaf2db7_18bd_4b36_b8c1_4bad34d7a85b.slice/crio-fa419e67509d71547dcc9da56a36544187a01781abbf6a8e59b37f9eb32a5b88 WatchSource:0}: Error finding container fa419e67509d71547dcc9da56a36544187a01781abbf6a8e59b37f9eb32a5b88: Status 404 returned error can't find the container with id fa419e67509d71547dcc9da56a36544187a01781abbf6a8e59b37f9eb32a5b88 Jun 09 19:48:12.265435 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:12.265349 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bb6cc6f-r7k77" event={"ID":"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b","Type":"ContainerStarted","Data":"fa419e67509d71547dcc9da56a36544187a01781abbf6a8e59b37f9eb32a5b88"} Jun 09 19:48:12.995609 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:12.995579 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:13.095640 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:13.095603 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:13.154680 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:13.154643 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:13.473576 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:13.473371 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:13.788394 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:13.788317 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:13.842404 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:13.842364 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:15.276449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:15.276408 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bb6cc6f-r7k77" event={"ID":"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b","Type":"ContainerStarted","Data":"32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5"} Jun 09 19:48:15.293304 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:15.293255 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86bb6cc6f-r7k77" podStartSLOduration=1.102454968 podStartE2EDuration="4.293238168s" totalImagesPullingTime="3.1907832s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:48:15.291107261 +0000 UTC m=+280.529272873" watchObservedRunningTime="2026-06-09 19:48:15.293238168 +0000 UTC m=+280.531403779" Jun 09 19:48:15.925198 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:48:15.925155 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hwhdb" podUID="05b48888-07bb-43ac-a02e-87c8e52020d5" Jun 09 19:48:16.176172 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:16.176073 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:16.243675 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:16.243627 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:16.278773 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:16.278744 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hwhdb" Jun 09 19:48:16.310009 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:16.309969 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:18.014537 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:18.014499 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:18.349651 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:18.349563 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:19.067360 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:19.067326 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:48:19.069695 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:19.069672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/05b48888-07bb-43ac-a02e-87c8e52020d5-metrics-tls\") pod \"dns-default-hwhdb\" (UID: \"05b48888-07bb-43ac-a02e-87c8e52020d5\") " pod="openshift-dns/dns-default-hwhdb" Jun 09 19:48:19.282583 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:19.282551 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-88s58\"" Jun 09 19:48:19.290354 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:19.290333 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hwhdb" Jun 09 19:48:19.408971 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:19.408927 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hwhdb"] Jun 09 19:48:19.410843 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:48:19.410819 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05b48888_07bb_43ac_a02e_87c8e52020d5.slice/crio-01476afbff1fae667011720d726a79ffa987e16e63a5dc012d58446378e6634b WatchSource:0}: Error finding container 01476afbff1fae667011720d726a79ffa987e16e63a5dc012d58446378e6634b: Status 404 returned error can't find the container with id 01476afbff1fae667011720d726a79ffa987e16e63a5dc012d58446378e6634b Jun 09 19:48:20.291146 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.291091 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hwhdb" event={"ID":"05b48888-07bb-43ac-a02e-87c8e52020d5","Type":"ContainerStarted","Data":"01476afbff1fae667011720d726a79ffa987e16e63a5dc012d58446378e6634b"} Jun 09 19:48:20.301448 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.301412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:20.518945 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.518885 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:20.569381 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.569315 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kcp78"] Jun 09 19:48:20.571383 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.571363 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.573710 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.573686 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 19:48:20.573951 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.573931 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 19:48:20.574030 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.573971 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 19:48:20.574070 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.574051 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 19:48:20.575290 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.575045 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 19:48:20.575290 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.575076 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f9vfd\"" Jun 09 19:48:20.575290 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.575154 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 19:48:20.601822 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.601795 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:20.661925 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.661894 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:20.678104 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.678073 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.678236 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.678122 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-textfile\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.678236 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.678164 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-tls\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.678356 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.678238 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-wtmp\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.678356 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.678288 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70a340bf-36f5-4424-adfa-b956495e2956-root\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.678356 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.678323 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70a340bf-36f5-4424-adfa-b956495e2956-sys\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.678356 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.678356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.678537 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.678389 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70a340bf-36f5-4424-adfa-b956495e2956-metrics-client-ca\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.678537 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.678436 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqj8d\" (UniqueName: \"kubernetes.io/projected/70a340bf-36f5-4424-adfa-b956495e2956-kube-api-access-jqj8d\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.763478 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.763441 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:20.779615 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.779583 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70a340bf-36f5-4424-adfa-b956495e2956-sys\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.779775 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.779631 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.779775 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.779660 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70a340bf-36f5-4424-adfa-b956495e2956-metrics-client-ca\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.779775 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.779685 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqj8d\" (UniqueName: \"kubernetes.io/projected/70a340bf-36f5-4424-adfa-b956495e2956-kube-api-access-jqj8d\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.779775 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.779719 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/70a340bf-36f5-4424-adfa-b956495e2956-sys\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.779775 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.779729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.780035 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.779778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-textfile\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.780035 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.779805 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-tls\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.780035 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.779833 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-wtmp\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.780035 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.779883 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70a340bf-36f5-4424-adfa-b956495e2956-root\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.780035 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.779953 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/70a340bf-36f5-4424-adfa-b956495e2956-root\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.780292 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:48:20.780084 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 19:48:20.780292 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.780168 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-wtmp\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.780292 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:48:20.780177 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-tls podName:70a340bf-36f5-4424-adfa-b956495e2956 nodeName:}" failed. No retries permitted until 2026-06-09 19:48:21.280159099 +0000 UTC m=+286.518324697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-tls") pod "node-exporter-kcp78" (UID: "70a340bf-36f5-4424-adfa-b956495e2956") : secret "node-exporter-tls" not found Jun 09 19:48:20.780449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.780297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-textfile\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.780449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.780374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/70a340bf-36f5-4424-adfa-b956495e2956-metrics-client-ca\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.780449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.780374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-accelerators-collector-config\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.782321 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.782303 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.787656 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.787638 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqj8d\" (UniqueName: \"kubernetes.io/projected/70a340bf-36f5-4424-adfa-b956495e2956-kube-api-access-jqj8d\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:20.864738 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.864643 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:20.967248 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:20.967204 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:21.283549 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.283513 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-tls\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:21.283695 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:48:21.283658 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 19:48:21.283735 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:48:21.283720 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-tls podName:70a340bf-36f5-4424-adfa-b956495e2956 nodeName:}" failed. No retries permitted until 2026-06-09 19:48:22.283704084 +0000 UTC m=+287.521869673 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-tls") pod "node-exporter-kcp78" (UID: "70a340bf-36f5-4424-adfa-b956495e2956") : secret "node-exporter-tls" not found Jun 09 19:48:21.294968 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.294942 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hwhdb" event={"ID":"05b48888-07bb-43ac-a02e-87c8e52020d5","Type":"ContainerStarted","Data":"f198461e3fef87db102e0c608294c0bf89c51085de07e9f99d85b5e012674fc6"} Jun 09 19:48:21.295297 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.294984 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hwhdb" event={"ID":"05b48888-07bb-43ac-a02e-87c8e52020d5","Type":"ContainerStarted","Data":"ac9b22af7f64bebfce14669b76f6bfa085a5aa4502ca461c884fa27deedb209d"} Jun 09 19:48:21.295297 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.295055 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hwhdb" Jun 09 19:48:21.317849 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.317805 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hwhdb" podStartSLOduration=250.718710965 podStartE2EDuration="4m12.317791001s" totalImagesPullingTime="1.599080036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:44:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:48:21.31727179 +0000 UTC m=+286.555437402" watchObservedRunningTime="2026-06-09 19:48:21.317791001 +0000 UTC m=+286.555956615" Jun 09 19:48:21.326898 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.326864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:21.529616 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.529539 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:21.614379 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.614347 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:21.617794 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.617771 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 19:48:21.620976 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.620961 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.623540 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.623518 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 19:48:21.623654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.623544 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 19:48:21.623654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.623521 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 19:48:21.623654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.623621 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 19:48:21.623864 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.623849 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 19:48:21.623915 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.623865 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 19:48:21.623964 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.623938 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zqdpz\"" Jun 09 19:48:21.624066 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.624047 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 19:48:21.624066 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.624064 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 19:48:21.624213 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.624155 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 19:48:21.636995 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.636972 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 19:48:21.686664 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686636 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46813f9f-07bc-4f94-a64a-38d94c5822f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.686759 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686667 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fgwk\" (UniqueName: \"kubernetes.io/projected/46813f9f-07bc-4f94-a64a-38d94c5822f4-kube-api-access-8fgwk\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.686759 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.686759 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686707 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.686759 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.686896 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46813f9f-07bc-4f94-a64a-38d94c5822f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.686896 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686799 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-web-config\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.686896 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686817 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.686896 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686845 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46813f9f-07bc-4f94-a64a-38d94c5822f4-config-out\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.686896 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686860 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/46813f9f-07bc-4f94-a64a-38d94c5822f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.686896 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686887 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46813f9f-07bc-4f94-a64a-38d94c5822f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.687064 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686909 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.687064 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.686928 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.734559 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.734525 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:21.787899 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.787842 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.787899 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.787878 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.788025 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.787903 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.788067 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.788043 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46813f9f-07bc-4f94-a64a-38d94c5822f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.788115 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.788079 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-web-config\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.788184 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.788112 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.788240 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.788188 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46813f9f-07bc-4f94-a64a-38d94c5822f4-config-out\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.788240 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.788214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/46813f9f-07bc-4f94-a64a-38d94c5822f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.788751 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.788694 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/46813f9f-07bc-4f94-a64a-38d94c5822f4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.788860 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.788838 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46813f9f-07bc-4f94-a64a-38d94c5822f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.788929 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.788908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.788991 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.788937 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.788991 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.788978 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46813f9f-07bc-4f94-a64a-38d94c5822f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.789258 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.789006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fgwk\" (UniqueName: \"kubernetes.io/projected/46813f9f-07bc-4f94-a64a-38d94c5822f4-kube-api-access-8fgwk\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.790030 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:48:21.789801 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/46813f9f-07bc-4f94-a64a-38d94c5822f4-alertmanager-trusted-ca-bundle podName:46813f9f-07bc-4f94-a64a-38d94c5822f4 nodeName:}" failed. No retries permitted until 2026-06-09 19:48:22.289777162 +0000 UTC m=+287.527942753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/46813f9f-07bc-4f94-a64a-38d94c5822f4-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "46813f9f-07bc-4f94-a64a-38d94c5822f4") : configmap references non-existent config key: ca-bundle.crt Jun 09 19:48:21.790439 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.790417 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/46813f9f-07bc-4f94-a64a-38d94c5822f4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.790960 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.790916 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.790960 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.790929 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-web-config\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.791303 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.791258 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.791303 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.791282 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/46813f9f-07bc-4f94-a64a-38d94c5822f4-config-out\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.791828 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.791801 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/46813f9f-07bc-4f94-a64a-38d94c5822f4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.791955 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.791934 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.792106 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.792086 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.792460 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.792444 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-config-volume\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.792575 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.792556 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/46813f9f-07bc-4f94-a64a-38d94c5822f4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.797286 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.797269 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fgwk\" (UniqueName: \"kubernetes.io/projected/46813f9f-07bc-4f94-a64a-38d94c5822f4-kube-api-access-8fgwk\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:21.879624 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.879598 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:21.879751 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.879651 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:21.880994 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.880970 2573 patch_prober.go:28] interesting pod/console-86bb6cc6f-r7k77 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" start-of-body= Jun 09 19:48:21.881085 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:21.881013 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-86bb6cc6f-r7k77" podUID="bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.11:8443/health\": dial tcp 10.133.0.11:8443: connect: connection refused" Jun 09 19:48:22.157726 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:22.157691 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:22.257792 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:22.257764 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:22.293891 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:22.293861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46813f9f-07bc-4f94-a64a-38d94c5822f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:22.294034 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:22.293905 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-tls\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:22.294616 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:22.294599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/46813f9f-07bc-4f94-a64a-38d94c5822f4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"46813f9f-07bc-4f94-a64a-38d94c5822f4\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:22.296345 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:22.296322 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/70a340bf-36f5-4424-adfa-b956495e2956-node-exporter-tls\") pod \"node-exporter-kcp78\" (UID: \"70a340bf-36f5-4424-adfa-b956495e2956\") " pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:22.307650 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:22.307618 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:22.382605 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:22.382580 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kcp78" Jun 09 19:48:22.393361 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:48:22.393334 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70a340bf_36f5_4424_adfa_b956495e2956.slice/crio-ef48e791ab280e1cf4d14e5b07c191e7fdd42a0384942e13f90ba6c0c86c0c63 WatchSource:0}: Error finding container ef48e791ab280e1cf4d14e5b07c191e7fdd42a0384942e13f90ba6c0c86c0c63: Status 404 returned error can't find the container with id ef48e791ab280e1cf4d14e5b07c191e7fdd42a0384942e13f90ba6c0c86c0c63 Jun 09 19:48:22.530022 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:22.529936 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 19:48:22.661450 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:22.661421 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 19:48:22.661572 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:48:22.661501 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46813f9f_07bc_4f94_a64a_38d94c5822f4.slice/crio-a1a582dd1c8430f165efc15a923b120e998d510b44ad6ce6f34d77c9319d5704 WatchSource:0}: Error finding container a1a582dd1c8430f165efc15a923b120e998d510b44ad6ce6f34d77c9319d5704: Status 404 returned error can't find the container with id a1a582dd1c8430f165efc15a923b120e998d510b44ad6ce6f34d77c9319d5704 Jun 09 19:48:23.307359 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.307325 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46813f9f-07bc-4f94-a64a-38d94c5822f4","Type":"ContainerStarted","Data":"a1a582dd1c8430f165efc15a923b120e998d510b44ad6ce6f34d77c9319d5704"} Jun 09 19:48:23.308398 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.308375 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcp78" event={"ID":"70a340bf-36f5-4424-adfa-b956495e2956","Type":"ContainerStarted","Data":"ef48e791ab280e1cf4d14e5b07c191e7fdd42a0384942e13f90ba6c0c86c0c63"} Jun 09 19:48:23.459449 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.459412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:23.526203 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.526084 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:23.532399 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.532376 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq"] Jun 09 19:48:23.536574 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.536555 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.539158 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.539088 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 09 19:48:23.539271 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.539197 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 09 19:48:23.539271 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.539253 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 09 19:48:23.539441 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.539405 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-bcorn0c1e38qa\"" Jun 09 19:48:23.539566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.539495 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 09 19:48:23.539663 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.539570 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 09 19:48:23.540079 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.540060 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6cvwm\"" Jun 09 19:48:23.545930 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.545906 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq"] Jun 09 19:48:23.603995 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.603971 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b1675bd-6c0c-47df-b1ca-4f03ac920673-metrics-client-ca\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.604107 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.604006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.604107 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.604035 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-tls\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.604107 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.604074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.604263 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.604144 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.604263 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.604169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khx57\" (UniqueName: \"kubernetes.io/projected/3b1675bd-6c0c-47df-b1ca-4f03ac920673-kube-api-access-khx57\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.604263 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.604186 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.604263 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.604202 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-grpc-tls\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.705091 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.705062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.705216 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.705111 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-tls\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.705216 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.705162 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.705330 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.705255 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.705330 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.705289 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khx57\" (UniqueName: \"kubernetes.io/projected/3b1675bd-6c0c-47df-b1ca-4f03ac920673-kube-api-access-khx57\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.705330 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.705322 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.705481 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.705347 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-grpc-tls\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.705481 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.705386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b1675bd-6c0c-47df-b1ca-4f03ac920673-metrics-client-ca\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.706119 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.706073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b1675bd-6c0c-47df-b1ca-4f03ac920673-metrics-client-ca\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.707967 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.707940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.708046 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.708009 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.708145 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.708108 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-tls\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.708341 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.708318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.708527 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.708511 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.708588 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.708571 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3b1675bd-6c0c-47df-b1ca-4f03ac920673-secret-grpc-tls\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.716554 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.716536 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khx57\" (UniqueName: \"kubernetes.io/projected/3b1675bd-6c0c-47df-b1ca-4f03ac920673-kube-api-access-khx57\") pod \"thanos-querier-6c7b8846d6-f4bxq\" (UID: \"3b1675bd-6c0c-47df-b1ca-4f03ac920673\") " pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.797390 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.797310 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:23.847410 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.847385 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:23.896376 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.896297 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:23.972178 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:23.972152 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq"] Jun 09 19:48:23.974483 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:48:23.974459 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b1675bd_6c0c_47df_b1ca_4f03ac920673.slice/crio-0718fea9af8dcb831f6bf90112cbc241925c6732cdc721cafb0ca44cfb31dce8 WatchSource:0}: Error finding container 0718fea9af8dcb831f6bf90112cbc241925c6732cdc721cafb0ca44cfb31dce8: Status 404 returned error can't find the container with id 0718fea9af8dcb831f6bf90112cbc241925c6732cdc721cafb0ca44cfb31dce8 Jun 09 19:48:24.312945 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:24.312912 2573 generic.go:356] "Generic (PLEG): container finished" podID="46813f9f-07bc-4f94-a64a-38d94c5822f4" containerID="7d5704595fbbabd4bece69b1c9522508ee904c8360689c4f9e1022d7597eac88" exitCode=0 Jun 09 19:48:24.313376 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:24.312986 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46813f9f-07bc-4f94-a64a-38d94c5822f4","Type":"ContainerDied","Data":"7d5704595fbbabd4bece69b1c9522508ee904c8360689c4f9e1022d7597eac88"} Jun 09 19:48:24.314247 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:24.314210 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" event={"ID":"3b1675bd-6c0c-47df-b1ca-4f03ac920673","Type":"ContainerStarted","Data":"0718fea9af8dcb831f6bf90112cbc241925c6732cdc721cafb0ca44cfb31dce8"} Jun 09 19:48:24.315647 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:24.315622 2573 generic.go:356] "Generic (PLEG): container finished" podID="70a340bf-36f5-4424-adfa-b956495e2956" containerID="5d1f30f23dc4b485ea5cfbd5bd75c0ac298e14d5da8d5d1dbe85ce84ee454e87" exitCode=0 Jun 09 19:48:24.315729 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:24.315681 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcp78" event={"ID":"70a340bf-36f5-4424-adfa-b956495e2956","Type":"ContainerDied","Data":"5d1f30f23dc4b485ea5cfbd5bd75c0ac298e14d5da8d5d1dbe85ce84ee454e87"} Jun 09 19:48:25.322542 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.322504 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:25.323072 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.323047 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcp78" event={"ID":"70a340bf-36f5-4424-adfa-b956495e2956","Type":"ContainerStarted","Data":"78be68c3970dfa5d1fc2bdffe69ceaa91e1f5c05d68c3a32fed2296aa5cd641a"} Jun 09 19:48:25.323153 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.323098 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kcp78" event={"ID":"70a340bf-36f5-4424-adfa-b956495e2956","Type":"ContainerStarted","Data":"c4e09e72c47399efe58007001df8ec0c9abe4fb485087d6faaec6bbffd507daf"} Jun 09 19:48:25.331004 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.330974 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7"] Jun 09 19:48:25.334391 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.334372 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" Jun 09 19:48:25.336591 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.336565 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 19:48:25.336729 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.336619 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-g9dfp\"" Jun 09 19:48:25.343642 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.343589 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7"] Jun 09 19:48:25.347018 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.346974 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kcp78" podStartSLOduration=4.437740439 podStartE2EDuration="5.34695579s" totalImagesPullingTime="839.339471ms" totalInitContainerRuntime="69.87588ms" isStatefulPod=true podCreationTimestamp="2026-06-09 19:48:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:48:25.345155767 +0000 UTC m=+290.583321388" watchObservedRunningTime="2026-06-09 19:48:25.34695579 +0000 UTC m=+290.585121404" Jun 09 19:48:25.381511 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.379758 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86bb6cc6f-r7k77"] Jun 09 19:48:25.409005 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.408969 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:25.420160 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.420117 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9b86e87-1b7d-4e25-8906-aa20b477c1f6-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qzmf7\" (UID: \"f9b86e87-1b7d-4e25-8906-aa20b477c1f6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" Jun 09 19:48:25.420298 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.420248 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glhtp\" (UniqueName: \"kubernetes.io/projected/f9b86e87-1b7d-4e25-8906-aa20b477c1f6-kube-api-access-glhtp\") pod \"monitoring-plugin-76b68cc874-qzmf7\" (UID: \"f9b86e87-1b7d-4e25-8906-aa20b477c1f6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" Jun 09 19:48:25.521446 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.521408 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glhtp\" (UniqueName: \"kubernetes.io/projected/f9b86e87-1b7d-4e25-8906-aa20b477c1f6-kube-api-access-glhtp\") pod \"monitoring-plugin-76b68cc874-qzmf7\" (UID: \"f9b86e87-1b7d-4e25-8906-aa20b477c1f6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" Jun 09 19:48:25.521636 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.521485 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9b86e87-1b7d-4e25-8906-aa20b477c1f6-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qzmf7\" (UID: \"f9b86e87-1b7d-4e25-8906-aa20b477c1f6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" Jun 09 19:48:25.521636 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:48:25.521586 2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 19:48:25.521735 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:48:25.521652 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9b86e87-1b7d-4e25-8906-aa20b477c1f6-monitoring-plugin-cert podName:f9b86e87-1b7d-4e25-8906-aa20b477c1f6 nodeName:}" failed. No retries permitted until 2026-06-09 19:48:26.021631181 +0000 UTC m=+291.259796770 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/f9b86e87-1b7d-4e25-8906-aa20b477c1f6-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-qzmf7" (UID: "f9b86e87-1b7d-4e25-8906-aa20b477c1f6") : secret "monitoring-plugin-cert" not found Jun 09 19:48:25.529615 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.529586 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glhtp\" (UniqueName: \"kubernetes.io/projected/f9b86e87-1b7d-4e25-8906-aa20b477c1f6-kube-api-access-glhtp\") pod \"monitoring-plugin-76b68cc874-qzmf7\" (UID: \"f9b86e87-1b7d-4e25-8906-aa20b477c1f6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" Jun 09 19:48:25.622817 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:25.622733 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:26.025775 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:26.025739 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9b86e87-1b7d-4e25-8906-aa20b477c1f6-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qzmf7\" (UID: \"f9b86e87-1b7d-4e25-8906-aa20b477c1f6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" Jun 09 19:48:26.028478 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:26.028449 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f9b86e87-1b7d-4e25-8906-aa20b477c1f6-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-qzmf7\" (UID: \"f9b86e87-1b7d-4e25-8906-aa20b477c1f6\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" Jun 09 19:48:26.098873 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:26.098835 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:26.246703 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:26.246669 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" Jun 09 19:48:26.258198 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:48:26.258159 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-74jvx" podUID="70cf497e-8c3e-4fb1-8981-cb9754626d08" Jun 09 19:48:26.471664 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:26.471639 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7"] Jun 09 19:48:26.477423 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:48:26.477387 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9b86e87_1b7d_4e25_8906_aa20b477c1f6.slice/crio-74f7fa4184f347e3986a23b2e8423f5e7273e06b64567f6b020d6877489b3978 WatchSource:0}: Error finding container 74f7fa4184f347e3986a23b2e8423f5e7273e06b64567f6b020d6877489b3978: Status 404 returned error can't find the container with id 74f7fa4184f347e3986a23b2e8423f5e7273e06b64567f6b020d6877489b3978 Jun 09 19:48:27.119478 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:27.119287 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:27.333262 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:27.333234 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46813f9f-07bc-4f94-a64a-38d94c5822f4","Type":"ContainerStarted","Data":"bc5de45f92e400d0cd012df82f7b550ff8a2b7b63e656bfbd1ca4344ff9c1bc4"} Jun 09 19:48:27.333377 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:27.333295 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46813f9f-07bc-4f94-a64a-38d94c5822f4","Type":"ContainerStarted","Data":"66f0b80387211203e3b9cf4da14f18bc5ddf808bce39113ec78076c7cdb6fcbc"} Jun 09 19:48:27.333377 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:27.333335 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46813f9f-07bc-4f94-a64a-38d94c5822f4","Type":"ContainerStarted","Data":"b302faef87a5b61c0c75a59acff3e338cca7c9d189c5ce45627716de6ca5860f"} Jun 09 19:48:27.333377 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:27.333366 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46813f9f-07bc-4f94-a64a-38d94c5822f4","Type":"ContainerStarted","Data":"1b50e557f59669a6d8c3309913d097d6412a823446ae8326bcefde2f7ac2fd72"} Jun 09 19:48:27.333510 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:27.333391 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46813f9f-07bc-4f94-a64a-38d94c5822f4","Type":"ContainerStarted","Data":"8ffad7d69ba79045670b4581bbc652177be503f550f10e253922777327eeff4c"} Jun 09 19:48:27.335330 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:27.335303 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" event={"ID":"3b1675bd-6c0c-47df-b1ca-4f03ac920673","Type":"ContainerStarted","Data":"c3745c9f1d967f3f1cc3cd6bcc2d82747f9320d6ed67194c2497040deacfa410"} Jun 09 19:48:27.335440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:27.335358 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" event={"ID":"3b1675bd-6c0c-47df-b1ca-4f03ac920673","Type":"ContainerStarted","Data":"0bfedb391f29d1a18b012f16eae1d4c4f73e650dc245afb46b733fd5192f5312"} Jun 09 19:48:27.335440 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:27.335386 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" event={"ID":"3b1675bd-6c0c-47df-b1ca-4f03ac920673","Type":"ContainerStarted","Data":"1cce0c0aeac5013034c313c11ffe986cce8dc6389b85080ca5e6e659aff95dff"} Jun 09 19:48:27.336287 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:27.336266 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" event={"ID":"f9b86e87-1b7d-4e25-8906-aa20b477c1f6","Type":"ContainerStarted","Data":"74f7fa4184f347e3986a23b2e8423f5e7273e06b64567f6b020d6877489b3978"} Jun 09 19:48:28.341447 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:28.341408 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" event={"ID":"f9b86e87-1b7d-4e25-8906-aa20b477c1f6","Type":"ContainerStarted","Data":"a6fa57b16462425ae2e8a192d5fab656009fa25814c4d699621300900aecbad8"} Jun 09 19:48:28.341903 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:28.341596 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" Jun 09 19:48:28.344745 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:28.344712 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"46813f9f-07bc-4f94-a64a-38d94c5822f4","Type":"ContainerStarted","Data":"bb4d9e10418871f13bd8364d181323d69966eee8e47d97ca8cc266143f217fcc"} Jun 09 19:48:28.346627 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:28.346606 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" Jun 09 19:48:28.347656 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:28.347638 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" event={"ID":"3b1675bd-6c0c-47df-b1ca-4f03ac920673","Type":"ContainerStarted","Data":"74088e70d7e2bee227051c37b364e4adfe1095930ff8027504a9c32590c91401"} Jun 09 19:48:28.347761 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:28.347682 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" event={"ID":"3b1675bd-6c0c-47df-b1ca-4f03ac920673","Type":"ContainerStarted","Data":"1545308120a63883ed178876e97478819517f2a5cff2673d375968426aa3aed2"} Jun 09 19:48:28.347761 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:28.347707 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" event={"ID":"3b1675bd-6c0c-47df-b1ca-4f03ac920673","Type":"ContainerStarted","Data":"0116ffcb6d3d0f8723a375c4dc6c9abeb92d8673dfa7dc2cfac382972bab9098"} Jun 09 19:48:28.347875 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:28.347809 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:28.355778 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:28.355738 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-qzmf7" podStartSLOduration=2.026885337 podStartE2EDuration="3.355724376s" totalImagesPullingTime="1.328839039s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:48:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:48:28.355072917 +0000 UTC m=+293.593238535" watchObservedRunningTime="2026-06-09 19:48:28.355724376 +0000 UTC m=+293.593889987" Jun 09 19:48:28.373813 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:28.373764 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" podStartSLOduration=2.222626972 podStartE2EDuration="5.373751592s" totalImagesPullingTime="3.15112462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:48:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:48:28.372234496 +0000 UTC m=+293.610400106" watchObservedRunningTime="2026-06-09 19:48:28.373751592 +0000 UTC m=+293.611917205" Jun 09 19:48:28.409242 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:28.409198 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.745059852 podStartE2EDuration="7.409178619s" totalImagesPullingTime="3.648719541s" totalInitContainerRuntime="15.399226ms" isStatefulPod=false podCreationTimestamp="2026-06-09 19:48:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:48:28.407963142 +0000 UTC m=+293.646128755" watchObservedRunningTime="2026-06-09 19:48:28.409178619 +0000 UTC m=+293.647344230" Jun 09 19:48:30.870943 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:30.870905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:31.300530 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:31.300498 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hwhdb" Jun 09 19:48:31.469348 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:31.469311 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:31.569354 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:31.569264 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:32.808686 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:32.808651 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:32.865145 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:32.865099 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:33.219942 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:33.219907 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:33.269000 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:33.268974 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:34.358550 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:34.358521 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6c7b8846d6-f4bxq" Jun 09 19:48:35.205218 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:35.205194 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 19:48:35.942443 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:35.942409 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:35.992422 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:35.992389 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:39.947322 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:39.947287 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:39.997382 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:39.997354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:40.765591 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:40.765557 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:40.837797 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:40.837763 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:40.977489 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:40.977447 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:41.026088 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:41.026005 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:41.256454 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:41.256423 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:48:41.787566 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:41.787528 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:41.840349 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:41.840320 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:42.109583 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:42.109500 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:42.212506 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:42.212472 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:44.446725 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:44.446675 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:44.547114 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:44.547081 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:45.788213 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:45.788174 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" podUID="0df84bb3-d2bd-4653-ae82-8e75c44c9fdf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 19:48:48.176207 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:48.176165 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fmtbl_74d2baf0-98cd-4c3e-a79a-a63b8db23646/serve-healthcheck-canary/0.log" Jun 09 19:48:49.022235 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:49.022192 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:49.071462 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:49.071434 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:48:50.407018 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.406972 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-86bb6cc6f-r7k77" podUID="bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" containerName="console" containerID="cri-o://32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5" gracePeriod=15 Jun 09 19:48:50.646621 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.646596 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:50.740372 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.740307 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-oauth-config\") pod \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " Jun 09 19:48:50.740372 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.740343 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwpc6\" (UniqueName: \"kubernetes.io/projected/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-kube-api-access-kwpc6\") pod \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " Jun 09 19:48:50.740558 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.740377 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-config\") pod \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " Jun 09 19:48:50.740558 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.740402 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-oauth-serving-cert\") pod \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " Jun 09 19:48:50.740558 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.740422 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-serving-cert\") pod \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " Jun 09 19:48:50.740558 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.740447 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-service-ca\") pod \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\" (UID: \"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b\") " Jun 09 19:48:50.740815 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.740793 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" (UID: "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 19:48:50.740897 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.740844 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-config" (OuterVolumeSpecName: "console-config") pod "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" (UID: "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 19:48:50.740897 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.740856 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-service-ca" (OuterVolumeSpecName: "service-ca") pod "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" (UID: "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 19:48:50.742594 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.742570 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-kube-api-access-kwpc6" (OuterVolumeSpecName: "kube-api-access-kwpc6") pod "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" (UID: "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b"). InnerVolumeSpecName "kube-api-access-kwpc6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:48:50.742708 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.742697 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" (UID: "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 19:48:50.742773 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.742715 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" (UID: "bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 19:48:50.841283 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.841255 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:48:50.841283 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.841278 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-oauth-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:48:50.841415 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.841289 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-serving-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:48:50.841415 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.841298 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-service-ca\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:48:50.841415 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.841306 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-console-oauth-config\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:48:50.841415 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:50.841314 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwpc6\" (UniqueName: \"kubernetes.io/projected/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b-kube-api-access-kwpc6\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:48:51.432276 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:51.432242 2573 generic.go:356] "Generic (PLEG): container finished" podID="bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" containerID="32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5" exitCode=0 Jun 09 19:48:51.432682 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:51.432286 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86bb6cc6f-r7k77" Jun 09 19:48:51.432682 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:51.432323 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bb6cc6f-r7k77" event={"ID":"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b","Type":"ContainerDied","Data":"32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5"} Jun 09 19:48:51.432682 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:51.432360 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86bb6cc6f-r7k77" event={"ID":"bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b","Type":"ContainerDied","Data":"fa419e67509d71547dcc9da56a36544187a01781abbf6a8e59b37f9eb32a5b88"} Jun 09 19:48:51.432682 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:51.432381 2573 scope.go:117] "RemoveContainer" containerID="32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5" Jun 09 19:48:51.442103 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:51.442083 2573 scope.go:117] "RemoveContainer" containerID="32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5" Jun 09 19:48:51.442382 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:48:51.442362 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5\": container with ID starting with 32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5 not found: ID does not exist" containerID="32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5" Jun 09 19:48:51.442434 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:51.442392 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5"} err="failed to get container status \"32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5\": rpc error: code = NotFound desc = could not find container \"32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5\": container with ID starting with 32668709bca362f423b90543652d07472ca2bfcc1aa37011fed63217135af4f5 not found: ID does not exist" Jun 09 19:48:51.449404 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:51.449379 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86bb6cc6f-r7k77"] Jun 09 19:48:51.451635 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:51.451614 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86bb6cc6f-r7k77"] Jun 09 19:48:53.261389 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:53.261348 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" path="/var/lib/kubelet/pods/bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b/volumes" Jun 09 19:48:55.788218 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:48:55.788179 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" podUID="0df84bb3-d2bd-4653-ae82-8e75c44c9fdf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 19:49:04.268256 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:04.268216 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:04.366793 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:04.366755 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:04.564682 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:04.564606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:04.665978 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:04.665942 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:04.766242 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:04.766209 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:05.788613 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:05.788580 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" podUID="0df84bb3-d2bd-4653-ae82-8e75c44c9fdf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 19:49:05.789075 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:05.788652 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" Jun 09 19:49:05.789265 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:05.789244 2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"0036321f2b81748d4edbee32744b11d31348c826a293cea6aab04253dcced878"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 19:49:05.789344 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:05.789292 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" podUID="0df84bb3-d2bd-4653-ae82-8e75c44c9fdf" containerName="service-proxy" containerID="cri-o://0036321f2b81748d4edbee32744b11d31348c826a293cea6aab04253dcced878" gracePeriod=30 Jun 09 19:49:06.488798 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:06.488762 2573 generic.go:356] "Generic (PLEG): container finished" podID="0df84bb3-d2bd-4653-ae82-8e75c44c9fdf" containerID="0036321f2b81748d4edbee32744b11d31348c826a293cea6aab04253dcced878" exitCode=2 Jun 09 19:49:06.488993 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:06.488824 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" event={"ID":"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf","Type":"ContainerDied","Data":"0036321f2b81748d4edbee32744b11d31348c826a293cea6aab04253dcced878"} Jun 09 19:49:06.488993 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:06.488878 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6f9f498c4f-4lmzf" event={"ID":"0df84bb3-d2bd-4653-ae82-8e75c44c9fdf","Type":"ContainerStarted","Data":"6b3e7480af9ae81efee59c7bc4e0be51d1d563ce0938482d0e985e0ee051fa2a"} Jun 09 19:49:14.438734 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:14.438697 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:14.489611 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:14.489571 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:36.656233 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:36.656192 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:36.702853 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:36.702817 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:41.213455 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:41.213422 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:41.267468 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:41.267437 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:42.716546 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:42.716512 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:42.770530 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:42.770487 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:48.200389 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:48.200355 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:49:48.202592 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:48.202568 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/70cf497e-8c3e-4fb1-8981-cb9754626d08-metrics-certs\") pod \"network-metrics-daemon-74jvx\" (UID: \"70cf497e-8c3e-4fb1-8981-cb9754626d08\") " pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:49:48.460166 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:48.460074 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d8jnq\"" Jun 09 19:49:48.468158 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:48.468138 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-74jvx" Jun 09 19:49:48.560605 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:48.560572 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:48.589799 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:48.589775 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-74jvx"] Jun 09 19:49:48.592164 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:49:48.592139 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70cf497e_8c3e_4fb1_8981_cb9754626d08.slice/crio-57ec020a67297f9550262afa6432486a6f5eafbdc39f2354d7e99f8feea4ee81 WatchSource:0}: Error finding container 57ec020a67297f9550262afa6432486a6f5eafbdc39f2354d7e99f8feea4ee81: Status 404 returned error can't find the container with id 57ec020a67297f9550262afa6432486a6f5eafbdc39f2354d7e99f8feea4ee81 Jun 09 19:49:48.594016 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:48.593999 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 19:49:48.635675 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:48.635640 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-74jvx" event={"ID":"70cf497e-8c3e-4fb1-8981-cb9754626d08","Type":"ContainerStarted","Data":"57ec020a67297f9550262afa6432486a6f5eafbdc39f2354d7e99f8feea4ee81"} Jun 09 19:49:48.664421 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:48.664399 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:49.640971 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:49.640931 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-74jvx" event={"ID":"70cf497e-8c3e-4fb1-8981-cb9754626d08","Type":"ContainerStarted","Data":"2a3be55e63613f71aaa3870a2b235bb248e6495de2db1de1d085fe2079cfddc4"} Jun 09 19:49:49.641364 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:49.641003 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-74jvx" event={"ID":"70cf497e-8c3e-4fb1-8981-cb9754626d08","Type":"ContainerStarted","Data":"76017f2a23f80cfda7e824220e9163ce335af659d6561e8f6fcbf3b1d3f00bd8"} Jun 09 19:49:49.656050 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:49.656006 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-74jvx" podStartSLOduration=373.795495921 podStartE2EDuration="6m14.655990962s" totalImagesPullingTime="860.495041ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:43:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:49:49.654563684 +0000 UTC m=+374.892729292" watchObservedRunningTime="2026-06-09 19:49:49.655990962 +0000 UTC m=+374.894156599" Jun 09 19:49:49.764021 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:49.763947 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:49.825212 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:49.825172 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:53.304854 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:53.304802 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:53.358644 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:53.358617 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:53.409304 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:53.409275 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:57.668998 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:57.668967 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:59.447890 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:59.447842 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:59.547972 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:59.547930 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:49:59.610260 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:49:59.610225 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:50:18.324662 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:50:18.324618 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:50:18.372007 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:50:18.371975 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:50:56.344914 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:50:56.344874 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:50:56.464282 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:50:56.464254 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:23.391738 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:23.391702 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:24.380405 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:24.380364 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:27.034681 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:27.034637 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:27.135189 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:27.135162 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:28.087854 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:28.087818 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:28.355387 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:28.355301 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:29.082944 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.082914 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4"] Jun 09 19:51:29.083213 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.083199 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" containerName="console" Jun 09 19:51:29.083266 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.083215 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" containerName="console" Jun 09 19:51:29.083300 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.083270 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfaf2db7-18bd-4b36-b8c1-4bad34d7a85b" containerName="console" Jun 09 19:51:29.085169 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.085154 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:29.092284 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.092261 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gl6ph\"" Jun 09 19:51:29.092625 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.092470 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 19:51:29.093411 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.093397 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 19:51:29.135241 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.135219 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4"] Jun 09 19:51:29.137344 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.137320 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrmsk\" (UniqueName: \"kubernetes.io/projected/444e6db4-5205-44b9-95cb-068b2d08d5af-kube-api-access-rrmsk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:29.137439 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.137365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:29.137439 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.137388 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:29.238473 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.238441 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrmsk\" (UniqueName: \"kubernetes.io/projected/444e6db4-5205-44b9-95cb-068b2d08d5af-kube-api-access-rrmsk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:29.238635 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.238486 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:29.238635 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.238511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:29.238896 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.238874 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:29.238943 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.238894 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:29.276038 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.276008 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrmsk\" (UniqueName: \"kubernetes.io/projected/444e6db4-5205-44b9-95cb-068b2d08d5af-kube-api-access-rrmsk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:29.393278 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.393249 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:29.531712 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.531678 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4"] Jun 09 19:51:29.534361 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:51:29.534335 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod444e6db4_5205_44b9_95cb_068b2d08d5af.slice/crio-133edbf6fef556c32929ea54e85bf1eff7ed0bf08cdfc2795faa5cafd365a000 WatchSource:0}: Error finding container 133edbf6fef556c32929ea54e85bf1eff7ed0bf08cdfc2795faa5cafd365a000: Status 404 returned error can't find the container with id 133edbf6fef556c32929ea54e85bf1eff7ed0bf08cdfc2795faa5cafd365a000 Jun 09 19:51:29.992281 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:29.992246 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" event={"ID":"444e6db4-5205-44b9-95cb-068b2d08d5af","Type":"ContainerStarted","Data":"133edbf6fef556c32929ea54e85bf1eff7ed0bf08cdfc2795faa5cafd365a000"} Jun 09 19:51:31.611519 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:31.611484 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:31.889428 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:31.889390 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:34.088458 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:34.088419 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:34.283474 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:34.283404 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:37.703898 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:37.703861 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:38.023193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:38.023096 2573 generic.go:356] "Generic (PLEG): container finished" podID="444e6db4-5205-44b9-95cb-068b2d08d5af" containerID="e243bb8c24a83e7a61eacbc4260c5b4d38756e208e4f895d37d2ab8aad07264b" exitCode=0 Jun 09 19:51:38.023193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:38.023173 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" event={"ID":"444e6db4-5205-44b9-95cb-068b2d08d5af","Type":"ContainerDied","Data":"e243bb8c24a83e7a61eacbc4260c5b4d38756e208e4f895d37d2ab8aad07264b"} Jun 09 19:51:38.962775 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:38.962738 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:41.037108 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:41.037077 2573 generic.go:356] "Generic (PLEG): container finished" podID="444e6db4-5205-44b9-95cb-068b2d08d5af" containerID="b7aebf9dc8f0e0bb982f1a4ce3bef79da5763f3921fe520db38e5333014c57b8" exitCode=0 Jun 09 19:51:41.037492 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:41.037163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" event={"ID":"444e6db4-5205-44b9-95cb-068b2d08d5af","Type":"ContainerDied","Data":"b7aebf9dc8f0e0bb982f1a4ce3bef79da5763f3921fe520db38e5333014c57b8"} Jun 09 19:51:48.180227 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:48.180189 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:49.072647 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:49.072615 2573 generic.go:356] "Generic (PLEG): container finished" podID="444e6db4-5205-44b9-95cb-068b2d08d5af" containerID="5e5e9fd44faf1032657e4f9438e32c50ffddb73dfb45c105a254758f566e07f0" exitCode=0 Jun 09 19:51:49.072647 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:49.072652 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" event={"ID":"444e6db4-5205-44b9-95cb-068b2d08d5af","Type":"ContainerDied","Data":"5e5e9fd44faf1032657e4f9438e32c50ffddb73dfb45c105a254758f566e07f0"} Jun 09 19:51:49.330722 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:49.330640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:50.176035 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.175993 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:50.198502 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.198475 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:50.274755 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.274718 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:50.292369 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.292341 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-util\") pod \"444e6db4-5205-44b9-95cb-068b2d08d5af\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " Jun 09 19:51:50.292490 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.292439 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-bundle\") pod \"444e6db4-5205-44b9-95cb-068b2d08d5af\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " Jun 09 19:51:50.292490 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.292462 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrmsk\" (UniqueName: \"kubernetes.io/projected/444e6db4-5205-44b9-95cb-068b2d08d5af-kube-api-access-rrmsk\") pod \"444e6db4-5205-44b9-95cb-068b2d08d5af\" (UID: \"444e6db4-5205-44b9-95cb-068b2d08d5af\") " Jun 09 19:51:50.292827 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.292802 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-bundle" (OuterVolumeSpecName: "bundle") pod "444e6db4-5205-44b9-95cb-068b2d08d5af" (UID: "444e6db4-5205-44b9-95cb-068b2d08d5af"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:51:50.294626 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.294597 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/444e6db4-5205-44b9-95cb-068b2d08d5af-kube-api-access-rrmsk" (OuterVolumeSpecName: "kube-api-access-rrmsk") pod "444e6db4-5205-44b9-95cb-068b2d08d5af" (UID: "444e6db4-5205-44b9-95cb-068b2d08d5af"). InnerVolumeSpecName "kube-api-access-rrmsk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:51:50.296769 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.296751 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-util" (OuterVolumeSpecName: "util") pod "444e6db4-5205-44b9-95cb-068b2d08d5af" (UID: "444e6db4-5205-44b9-95cb-068b2d08d5af"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:51:50.393500 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.393471 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:51:50.393500 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.393498 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrmsk\" (UniqueName: \"kubernetes.io/projected/444e6db4-5205-44b9-95cb-068b2d08d5af-kube-api-access-rrmsk\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:51:50.393892 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:50.393508 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/444e6db4-5205-44b9-95cb-068b2d08d5af-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:51:51.081272 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:51.081241 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" event={"ID":"444e6db4-5205-44b9-95cb-068b2d08d5af","Type":"ContainerDied","Data":"133edbf6fef556c32929ea54e85bf1eff7ed0bf08cdfc2795faa5cafd365a000"} Jun 09 19:51:51.081428 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:51.081290 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwqnf4" Jun 09 19:51:51.081428 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:51.081315 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="133edbf6fef556c32929ea54e85bf1eff7ed0bf08cdfc2795faa5cafd365a000" Jun 09 19:51:51.175407 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:51.175376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:51.290263 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:51.290223 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:54.344723 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:54.344686 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:54.449301 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:54.449270 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:55.786842 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.786808 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5"] Jun 09 19:51:55.787226 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.787061 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="444e6db4-5205-44b9-95cb-068b2d08d5af" containerName="extract" Jun 09 19:51:55.787226 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.787072 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="444e6db4-5205-44b9-95cb-068b2d08d5af" containerName="extract" Jun 09 19:51:55.787226 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.787081 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="444e6db4-5205-44b9-95cb-068b2d08d5af" containerName="util" Jun 09 19:51:55.787226 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.787087 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="444e6db4-5205-44b9-95cb-068b2d08d5af" containerName="util" Jun 09 19:51:55.787226 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.787095 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="444e6db4-5205-44b9-95cb-068b2d08d5af" containerName="pull" Jun 09 19:51:55.787226 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.787100 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="444e6db4-5205-44b9-95cb-068b2d08d5af" containerName="pull" Jun 09 19:51:55.787226 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.787164 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="444e6db4-5205-44b9-95cb-068b2d08d5af" containerName="extract" Jun 09 19:51:55.793308 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.793287 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5" Jun 09 19:51:55.798204 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.798185 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 19:51:55.798503 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.798485 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-rkhrz\"" Jun 09 19:51:55.798605 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.798504 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 19:51:55.803572 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.803553 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5"] Jun 09 19:51:55.834192 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.834156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45fdn\" (UniqueName: \"kubernetes.io/projected/19b7d5b1-388d-4ef6-94c8-350886d5b10b-kube-api-access-45fdn\") pod \"openshift-lws-operator-fd8ccff4c-fc8c5\" (UID: \"19b7d5b1-388d-4ef6-94c8-350886d5b10b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5" Jun 09 19:51:55.834330 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.834223 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19b7d5b1-388d-4ef6-94c8-350886d5b10b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fc8c5\" (UID: \"19b7d5b1-388d-4ef6-94c8-350886d5b10b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5" Jun 09 19:51:55.935360 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.935328 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45fdn\" (UniqueName: \"kubernetes.io/projected/19b7d5b1-388d-4ef6-94c8-350886d5b10b-kube-api-access-45fdn\") pod \"openshift-lws-operator-fd8ccff4c-fc8c5\" (UID: \"19b7d5b1-388d-4ef6-94c8-350886d5b10b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5" Jun 09 19:51:55.935494 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.935383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19b7d5b1-388d-4ef6-94c8-350886d5b10b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fc8c5\" (UID: \"19b7d5b1-388d-4ef6-94c8-350886d5b10b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5" Jun 09 19:51:55.935713 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.935698 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19b7d5b1-388d-4ef6-94c8-350886d5b10b-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fc8c5\" (UID: \"19b7d5b1-388d-4ef6-94c8-350886d5b10b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5" Jun 09 19:51:55.951826 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:55.951798 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45fdn\" (UniqueName: \"kubernetes.io/projected/19b7d5b1-388d-4ef6-94c8-350886d5b10b-kube-api-access-45fdn\") pod \"openshift-lws-operator-fd8ccff4c-fc8c5\" (UID: \"19b7d5b1-388d-4ef6-94c8-350886d5b10b\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5" Jun 09 19:51:56.101245 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:56.101170 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5" Jun 09 19:51:56.226748 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:56.226716 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5"] Jun 09 19:51:56.230254 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:51:56.230227 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19b7d5b1_388d_4ef6_94c8_350886d5b10b.slice/crio-88908c4ba00ab0a48152707f4b74cbfbf5783e1fb75f277e0eea4157025bba1b WatchSource:0}: Error finding container 88908c4ba00ab0a48152707f4b74cbfbf5783e1fb75f277e0eea4157025bba1b: Status 404 returned error can't find the container with id 88908c4ba00ab0a48152707f4b74cbfbf5783e1fb75f277e0eea4157025bba1b Jun 09 19:51:57.105452 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:57.105417 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5" event={"ID":"19b7d5b1-388d-4ef6-94c8-350886d5b10b","Type":"ContainerStarted","Data":"88908c4ba00ab0a48152707f4b74cbfbf5783e1fb75f277e0eea4157025bba1b"} Jun 09 19:51:58.110543 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:58.110499 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5" event={"ID":"19b7d5b1-388d-4ef6-94c8-350886d5b10b","Type":"ContainerStarted","Data":"6e102bdfada916e539e247ca76c6202245ff0875eaed299ee6aa5c042f39a101"} Jun 09 19:51:58.141897 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:58.141842 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fc8c5" podStartSLOduration=1.464194251 podStartE2EDuration="3.141823312s" totalImagesPullingTime="1.677629061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:51:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:51:58.13955425 +0000 UTC m=+503.377719860" watchObservedRunningTime="2026-06-09 19:51:58.141823312 +0000 UTC m=+503.379988926" Jun 09 19:51:58.987998 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:58.987965 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:51:59.101094 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:51:59.101056 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:01.279844 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:01.279806 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:15.340810 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:15.340772 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:15.450561 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:15.450531 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:15.956519 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:15.956429 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:16.360869 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.360789 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:16.464290 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.464259 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:16.495388 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.495356 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw"] Jun 09 19:52:16.498428 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.498408 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.503807 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.503789 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 19:52:16.503908 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.503856 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 19:52:16.504004 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.503985 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 19:52:16.504068 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.504020 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mq85f\"" Jun 09 19:52:16.504209 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.504190 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 19:52:16.522170 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.522122 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw"] Jun 09 19:52:16.599717 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.599689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/111ecf4b-3fca-4981-ba8c-da928688122b-manifests\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.599842 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.599725 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/111ecf4b-3fca-4981-ba8c-da928688122b-tmp\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.599842 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.599743 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/111ecf4b-3fca-4981-ba8c-da928688122b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.599842 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.599765 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsc4c\" (UniqueName: \"kubernetes.io/projected/111ecf4b-3fca-4981-ba8c-da928688122b-kube-api-access-tsc4c\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.599842 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.599828 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/111ecf4b-3fca-4981-ba8c-da928688122b-webhook-cert\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.674186 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.674154 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:16.700939 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.700906 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/111ecf4b-3fca-4981-ba8c-da928688122b-webhook-cert\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.701056 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.700947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/111ecf4b-3fca-4981-ba8c-da928688122b-manifests\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.701056 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.700981 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/111ecf4b-3fca-4981-ba8c-da928688122b-tmp\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.701056 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.701006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/111ecf4b-3fca-4981-ba8c-da928688122b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.701056 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.701028 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsc4c\" (UniqueName: \"kubernetes.io/projected/111ecf4b-3fca-4981-ba8c-da928688122b-kube-api-access-tsc4c\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.701409 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.701382 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/111ecf4b-3fca-4981-ba8c-da928688122b-manifests\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.703315 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.703295 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/111ecf4b-3fca-4981-ba8c-da928688122b-tmp\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.703512 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.703493 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/111ecf4b-3fca-4981-ba8c-da928688122b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.703569 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.703511 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/111ecf4b-3fca-4981-ba8c-da928688122b-webhook-cert\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.716025 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.715997 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsc4c\" (UniqueName: \"kubernetes.io/projected/111ecf4b-3fca-4981-ba8c-da928688122b-kube-api-access-tsc4c\") pod \"opendatahub-operator-controller-manager-696b96fdb9-wnnrw\" (UID: \"111ecf4b-3fca-4981-ba8c-da928688122b\") " pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.770609 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.770582 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:16.809586 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.809563 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:16.874894 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.874835 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:16.939057 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.939029 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw"] Jun 09 19:52:16.941672 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:52:16.941638 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111ecf4b_3fca_4981_ba8c_da928688122b.slice/crio-20d9724bbe1d30825c987063c8448630c4bd6ef4eba47833f70da451abaa09e4 WatchSource:0}: Error finding container 20d9724bbe1d30825c987063c8448630c4bd6ef4eba47833f70da451abaa09e4: Status 404 returned error can't find the container with id 20d9724bbe1d30825c987063c8448630c4bd6ef4eba47833f70da451abaa09e4 Jun 09 19:52:16.974089 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:16.974062 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:17.089787 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:17.089744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:17.179165 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:17.179107 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" event={"ID":"111ecf4b-3fca-4981-ba8c-da928688122b","Type":"ContainerStarted","Data":"20d9724bbe1d30825c987063c8448630c4bd6ef4eba47833f70da451abaa09e4"} Jun 09 19:52:17.196716 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:17.196637 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:17.518019 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:17.517934 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:17.637346 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:17.637291 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:21.197498 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:21.197469 2573 generic.go:356] "Generic (PLEG): container finished" podID="111ecf4b-3fca-4981-ba8c-da928688122b" containerID="0466407e83b43ab85315f69146b7d1f0d4703a344c1a9aeba03d6e96af9bf035" exitCode=0 Jun 09 19:52:21.197969 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:21.197509 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" event={"ID":"111ecf4b-3fca-4981-ba8c-da928688122b","Type":"ContainerDied","Data":"0466407e83b43ab85315f69146b7d1f0d4703a344c1a9aeba03d6e96af9bf035"} Jun 09 19:52:22.203657 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:22.203612 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" event={"ID":"111ecf4b-3fca-4981-ba8c-da928688122b","Type":"ContainerStarted","Data":"672cd1c489f0105c1902965a937442b88ecf5b7d982720f08678d919c99ba7f4"} Jun 09 19:52:22.204074 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:22.203680 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:22.242729 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:22.242681 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" podStartSLOduration=1.5857845849999999 podStartE2EDuration="6.242665694s" totalImagesPullingTime="3.763355117s" totalInitContainerRuntime="893.525992ms" isStatefulPod=false podCreationTimestamp="2026-06-09 19:52:16 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:52:22.239868409 +0000 UTC m=+527.478034019" watchObservedRunningTime="2026-06-09 19:52:22.242665694 +0000 UTC m=+527.480831305" Jun 09 19:52:33.210782 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:33.210754 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-696b96fdb9-wnnrw" Jun 09 19:52:37.230510 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:37.230473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:37.439660 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:37.439612 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:37.689755 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:37.689725 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:38.124689 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.124586 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:38.184652 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.184617 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj"] Jun 09 19:52:38.195024 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.194998 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x"] Jun 09 19:52:38.195204 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.195153 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" Jun 09 19:52:38.198359 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.198338 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:38.223257 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.223238 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 19:52:38.224372 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.224345 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gl6ph\"" Jun 09 19:52:38.224489 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.224406 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 19:52:38.224489 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.224406 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 19:52:38.224489 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.224420 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 19:52:38.224489 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.224441 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 19:52:38.224869 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.224852 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-l5smg\"" Jun 09 19:52:38.239958 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.239935 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 19:52:38.278295 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.278261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:38.278295 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.278298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:38.278521 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.278319 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhdlq\" (UniqueName: \"kubernetes.io/projected/5494495f-b247-431a-9bbc-354d1d9a0ed4-kube-api-access-bhdlq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:38.278521 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.278375 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c-tls-certs\") pod \"kube-auth-proxy-7d8c95444f-nh6wj\" (UID: \"19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c\") " pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" Jun 09 19:52:38.278521 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.278409 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c-tmp\") pod \"kube-auth-proxy-7d8c95444f-nh6wj\" (UID: \"19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c\") " pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" Jun 09 19:52:38.278521 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.278435 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmjpw\" (UniqueName: \"kubernetes.io/projected/19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c-kube-api-access-mmjpw\") pod \"kube-auth-proxy-7d8c95444f-nh6wj\" (UID: \"19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c\") " pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" Jun 09 19:52:38.283250 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.283219 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-qmmnl"] Jun 09 19:52:38.286702 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.286671 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x"] Jun 09 19:52:38.286832 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.286778 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" Jun 09 19:52:38.288420 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.288400 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj"] Jun 09 19:52:38.325597 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.325574 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-t6ksx\"" Jun 09 19:52:38.325896 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.325879 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 09 19:52:38.378100 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.378015 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-qmmnl"] Jun 09 19:52:38.379284 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.379254 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:38.379413 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.379304 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhdlq\" (UniqueName: \"kubernetes.io/projected/5494495f-b247-431a-9bbc-354d1d9a0ed4-kube-api-access-bhdlq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:38.379413 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.379338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c-tls-certs\") pod \"kube-auth-proxy-7d8c95444f-nh6wj\" (UID: \"19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c\") " pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" Jun 09 19:52:38.379413 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.379361 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c-tmp\") pod \"kube-auth-proxy-7d8c95444f-nh6wj\" (UID: \"19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c\") " pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" Jun 09 19:52:38.379576 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.379423 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmjpw\" (UniqueName: \"kubernetes.io/projected/19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c-kube-api-access-mmjpw\") pod \"kube-auth-proxy-7d8c95444f-nh6wj\" (UID: \"19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c\") " pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" Jun 09 19:52:38.379576 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.379524 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:38.379576 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.379557 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64bbeaa0-21e6-4197-9527-446b5ad44b91-cert\") pod \"odh-model-controller-6dc94f689f-qmmnl\" (UID: \"64bbeaa0-21e6-4197-9527-446b5ad44b91\") " pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" Jun 09 19:52:38.379713 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.379594 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctdrl\" (UniqueName: \"kubernetes.io/projected/64bbeaa0-21e6-4197-9527-446b5ad44b91-kube-api-access-ctdrl\") pod \"odh-model-controller-6dc94f689f-qmmnl\" (UID: \"64bbeaa0-21e6-4197-9527-446b5ad44b91\") " pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" Jun 09 19:52:38.379798 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.379766 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-bundle\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:38.380031 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.380005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-util\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:38.382075 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.382050 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c-tmp\") pod \"kube-auth-proxy-7d8c95444f-nh6wj\" (UID: \"19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c\") " pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" Jun 09 19:52:38.382514 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.382492 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c-tls-certs\") pod \"kube-auth-proxy-7d8c95444f-nh6wj\" (UID: \"19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c\") " pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" Jun 09 19:52:38.449525 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.449494 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:38.453840 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.453818 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmjpw\" (UniqueName: \"kubernetes.io/projected/19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c-kube-api-access-mmjpw\") pod \"kube-auth-proxy-7d8c95444f-nh6wj\" (UID: \"19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c\") " pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" Jun 09 19:52:38.453996 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.453943 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhdlq\" (UniqueName: \"kubernetes.io/projected/5494495f-b247-431a-9bbc-354d1d9a0ed4-kube-api-access-bhdlq\") pod \"4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:38.479911 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.479871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64bbeaa0-21e6-4197-9527-446b5ad44b91-cert\") pod \"odh-model-controller-6dc94f689f-qmmnl\" (UID: \"64bbeaa0-21e6-4197-9527-446b5ad44b91\") " pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" Jun 09 19:52:38.480032 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.479920 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctdrl\" (UniqueName: \"kubernetes.io/projected/64bbeaa0-21e6-4197-9527-446b5ad44b91-kube-api-access-ctdrl\") pod \"odh-model-controller-6dc94f689f-qmmnl\" (UID: \"64bbeaa0-21e6-4197-9527-446b5ad44b91\") " pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" Jun 09 19:52:38.480032 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:52:38.480017 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 09 19:52:38.480109 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:52:38.480077 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64bbeaa0-21e6-4197-9527-446b5ad44b91-cert podName:64bbeaa0-21e6-4197-9527-446b5ad44b91 nodeName:}" failed. No retries permitted until 2026-06-09 19:52:38.980060457 +0000 UTC m=+544.218226046 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/64bbeaa0-21e6-4197-9527-446b5ad44b91-cert") pod "odh-model-controller-6dc94f689f-qmmnl" (UID: "64bbeaa0-21e6-4197-9527-446b5ad44b91") : secret "odh-model-controller-webhook-cert" not found Jun 09 19:52:38.504828 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.504783 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" Jun 09 19:52:38.509799 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.509784 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:38.539558 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.539302 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctdrl\" (UniqueName: \"kubernetes.io/projected/64bbeaa0-21e6-4197-9527-446b5ad44b91-kube-api-access-ctdrl\") pod \"odh-model-controller-6dc94f689f-qmmnl\" (UID: \"64bbeaa0-21e6-4197-9527-446b5ad44b91\") " pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" Jun 09 19:52:38.695519 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.695479 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj"] Jun 09 19:52:38.699149 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.699105 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x"] Jun 09 19:52:38.699297 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:52:38.699267 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a5ecbf_1a4b_46c4_a4c7_8a76ab5b8d9c.slice/crio-f004017e2f73e4f04b5e2a3452d7a9b79493790f6262916c121c50d671d9045d WatchSource:0}: Error finding container f004017e2f73e4f04b5e2a3452d7a9b79493790f6262916c121c50d671d9045d: Status 404 returned error can't find the container with id f004017e2f73e4f04b5e2a3452d7a9b79493790f6262916c121c50d671d9045d Jun 09 19:52:38.700413 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:52:38.700386 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5494495f_b247_431a_9bbc_354d1d9a0ed4.slice/crio-d7b50605ba1c90b2417c91d1b8387a514ee0d160894a0c426cc6ef8818d85c15 WatchSource:0}: Error finding container d7b50605ba1c90b2417c91d1b8387a514ee0d160894a0c426cc6ef8818d85c15: Status 404 returned error can't find the container with id d7b50605ba1c90b2417c91d1b8387a514ee0d160894a0c426cc6ef8818d85c15 Jun 09 19:52:38.784109 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.784071 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:38.985885 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.985791 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64bbeaa0-21e6-4197-9527-446b5ad44b91-cert\") pod \"odh-model-controller-6dc94f689f-qmmnl\" (UID: \"64bbeaa0-21e6-4197-9527-446b5ad44b91\") " pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" Jun 09 19:52:38.988196 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:38.988169 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/64bbeaa0-21e6-4197-9527-446b5ad44b91-cert\") pod \"odh-model-controller-6dc94f689f-qmmnl\" (UID: \"64bbeaa0-21e6-4197-9527-446b5ad44b91\") " pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" Jun 09 19:52:39.076767 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:39.076731 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:39.200000 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:39.199962 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" Jun 09 19:52:39.266505 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:39.266442 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" event={"ID":"19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c","Type":"ContainerStarted","Data":"f004017e2f73e4f04b5e2a3452d7a9b79493790f6262916c121c50d671d9045d"} Jun 09 19:52:39.268225 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:39.268198 2573 generic.go:356] "Generic (PLEG): container finished" podID="5494495f-b247-431a-9bbc-354d1d9a0ed4" containerID="aa8c4197a69fb5346a7553e9ec429f166785e9e71dfe802ea7ad9d1bddb8c0fe" exitCode=0 Jun 09 19:52:39.268372 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:39.268243 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" event={"ID":"5494495f-b247-431a-9bbc-354d1d9a0ed4","Type":"ContainerDied","Data":"aa8c4197a69fb5346a7553e9ec429f166785e9e71dfe802ea7ad9d1bddb8c0fe"} Jun 09 19:52:39.268372 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:39.268276 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" event={"ID":"5494495f-b247-431a-9bbc-354d1d9a0ed4","Type":"ContainerStarted","Data":"d7b50605ba1c90b2417c91d1b8387a514ee0d160894a0c426cc6ef8818d85c15"} Jun 09 19:52:39.370183 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:39.370158 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-qmmnl"] Jun 09 19:52:39.375320 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:52:39.375282 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64bbeaa0_21e6_4197_9527_446b5ad44b91.slice/crio-a1015197f7da3258838872c4fa37955319f7e1678ba53df2a449b615a914f51f WatchSource:0}: Error finding container a1015197f7da3258838872c4fa37955319f7e1678ba53df2a449b615a914f51f: Status 404 returned error can't find the container with id a1015197f7da3258838872c4fa37955319f7e1678ba53df2a449b615a914f51f Jun 09 19:52:40.012446 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.012406 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:40.044270 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.044237 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-zwfs6"] Jun 09 19:52:40.049643 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.049612 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" Jun 09 19:52:40.065117 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.065090 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 09 19:52:40.084005 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.083969 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-zwfs6"] Jun 09 19:52:40.094688 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.094631 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p7qn\" (UniqueName: \"kubernetes.io/projected/170cfd8a-4109-4ae3-ade7-54ab83aefcc8-kube-api-access-6p7qn\") pod \"model-serving-api-5dd488fc48-zwfs6\" (UID: \"170cfd8a-4109-4ae3-ade7-54ab83aefcc8\") " pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" Jun 09 19:52:40.094860 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.094704 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/170cfd8a-4109-4ae3-ade7-54ab83aefcc8-tls-certs\") pod \"model-serving-api-5dd488fc48-zwfs6\" (UID: \"170cfd8a-4109-4ae3-ade7-54ab83aefcc8\") " pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" Jun 09 19:52:40.195810 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.195339 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p7qn\" (UniqueName: \"kubernetes.io/projected/170cfd8a-4109-4ae3-ade7-54ab83aefcc8-kube-api-access-6p7qn\") pod \"model-serving-api-5dd488fc48-zwfs6\" (UID: \"170cfd8a-4109-4ae3-ade7-54ab83aefcc8\") " pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" Jun 09 19:52:40.195810 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.195437 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/170cfd8a-4109-4ae3-ade7-54ab83aefcc8-tls-certs\") pod \"model-serving-api-5dd488fc48-zwfs6\" (UID: \"170cfd8a-4109-4ae3-ade7-54ab83aefcc8\") " pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" Jun 09 19:52:40.195810 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:52:40.195599 2573 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 09 19:52:40.195810 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:52:40.195669 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/170cfd8a-4109-4ae3-ade7-54ab83aefcc8-tls-certs podName:170cfd8a-4109-4ae3-ade7-54ab83aefcc8 nodeName:}" failed. No retries permitted until 2026-06-09 19:52:40.695644768 +0000 UTC m=+545.933810371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/170cfd8a-4109-4ae3-ade7-54ab83aefcc8-tls-certs") pod "model-serving-api-5dd488fc48-zwfs6" (UID: "170cfd8a-4109-4ae3-ade7-54ab83aefcc8") : secret "model-serving-api-tls" not found Jun 09 19:52:40.278468 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.278386 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" event={"ID":"64bbeaa0-21e6-4197-9527-446b5ad44b91","Type":"ContainerStarted","Data":"a1015197f7da3258838872c4fa37955319f7e1678ba53df2a449b615a914f51f"} Jun 09 19:52:40.291976 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.291919 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p7qn\" (UniqueName: \"kubernetes.io/projected/170cfd8a-4109-4ae3-ade7-54ab83aefcc8-kube-api-access-6p7qn\") pod \"model-serving-api-5dd488fc48-zwfs6\" (UID: \"170cfd8a-4109-4ae3-ade7-54ab83aefcc8\") " pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" Jun 09 19:52:40.384766 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.384718 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:40.701058 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.701012 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/170cfd8a-4109-4ae3-ade7-54ab83aefcc8-tls-certs\") pod \"model-serving-api-5dd488fc48-zwfs6\" (UID: \"170cfd8a-4109-4ae3-ade7-54ab83aefcc8\") " pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" Jun 09 19:52:40.704169 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.704143 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/170cfd8a-4109-4ae3-ade7-54ab83aefcc8-tls-certs\") pod \"model-serving-api-5dd488fc48-zwfs6\" (UID: \"170cfd8a-4109-4ae3-ade7-54ab83aefcc8\") " pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" Jun 09 19:52:40.965307 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:40.965222 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" Jun 09 19:52:41.286758 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:41.286723 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" event={"ID":"5494495f-b247-431a-9bbc-354d1d9a0ed4","Type":"ContainerStarted","Data":"af20b51bb45c041e0297c778701612845a11b967c94e2acdded016b00d0a5abb"} Jun 09 19:52:41.340542 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:41.340507 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-zwfs6"] Jun 09 19:52:41.905039 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:52:41.905002 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170cfd8a_4109_4ae3_ade7_54ab83aefcc8.slice/crio-e5c3bd25e2472e699755c6165c663113014db25444ff7312403c1120e320ed96 WatchSource:0}: Error finding container e5c3bd25e2472e699755c6165c663113014db25444ff7312403c1120e320ed96: Status 404 returned error can't find the container with id e5c3bd25e2472e699755c6165c663113014db25444ff7312403c1120e320ed96 Jun 09 19:52:42.294113 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:42.294041 2573 generic.go:356] "Generic (PLEG): container finished" podID="5494495f-b247-431a-9bbc-354d1d9a0ed4" containerID="af20b51bb45c041e0297c778701612845a11b967c94e2acdded016b00d0a5abb" exitCode=0 Jun 09 19:52:42.294561 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:42.294121 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" event={"ID":"5494495f-b247-431a-9bbc-354d1d9a0ed4","Type":"ContainerDied","Data":"af20b51bb45c041e0297c778701612845a11b967c94e2acdded016b00d0a5abb"} Jun 09 19:52:42.295791 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:42.295760 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" event={"ID":"170cfd8a-4109-4ae3-ade7-54ab83aefcc8","Type":"ContainerStarted","Data":"e5c3bd25e2472e699755c6165c663113014db25444ff7312403c1120e320ed96"} Jun 09 19:52:43.303949 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:43.303909 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" event={"ID":"5494495f-b247-431a-9bbc-354d1d9a0ed4","Type":"ContainerStarted","Data":"89d0f90036458536cd61fccc8838dea0c69a20f6e0c968fe8ff9ada148b4fa36"} Jun 09 19:52:43.305857 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:43.305832 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" event={"ID":"64bbeaa0-21e6-4197-9527-446b5ad44b91","Type":"ContainerStarted","Data":"0183621320c672e9c5f6e94b4324ec80b098aeb8983cdf0d5585523dc096463d"} Jun 09 19:52:43.306311 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:43.306283 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" Jun 09 19:52:43.307808 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:43.307783 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" event={"ID":"19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c","Type":"ContainerStarted","Data":"53c2cee1972daefe05ee7d5dea472ba81c646b84da57cd3c0506dfab4949c80a"} Jun 09 19:52:43.330904 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:43.330360 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" podStartSLOduration=3.464626452 podStartE2EDuration="5.330346416s" totalImagesPullingTime="1.865719964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:52:43.329028357 +0000 UTC m=+548.567193967" watchObservedRunningTime="2026-06-09 19:52:43.330346416 +0000 UTC m=+548.568512026" Jun 09 19:52:43.359570 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:43.359521 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7d8c95444f-nh6wj" podStartSLOduration=0.88256046 podStartE2EDuration="5.359504203s" totalImagesPullingTime="4.476943743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:52:43.358969753 +0000 UTC m=+548.597135366" watchObservedRunningTime="2026-06-09 19:52:43.359504203 +0000 UTC m=+548.597669863" Jun 09 19:52:43.394576 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:43.394507 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" podStartSLOduration=1.5563153079999998 podStartE2EDuration="5.394483069s" totalImagesPullingTime="3.838167761s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:52:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:52:43.392820645 +0000 UTC m=+548.630986259" watchObservedRunningTime="2026-06-09 19:52:43.394483069 +0000 UTC m=+548.632648680" Jun 09 19:52:44.315854 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:44.315813 2573 generic.go:356] "Generic (PLEG): container finished" podID="5494495f-b247-431a-9bbc-354d1d9a0ed4" containerID="89d0f90036458536cd61fccc8838dea0c69a20f6e0c968fe8ff9ada148b4fa36" exitCode=0 Jun 09 19:52:44.316290 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:44.315905 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" event={"ID":"5494495f-b247-431a-9bbc-354d1d9a0ed4","Type":"ContainerDied","Data":"89d0f90036458536cd61fccc8838dea0c69a20f6e0c968fe8ff9ada148b4fa36"} Jun 09 19:52:45.321000 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.320953 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" event={"ID":"170cfd8a-4109-4ae3-ade7-54ab83aefcc8","Type":"ContainerStarted","Data":"cf829d70932765675845e2c870ce2b3c4d1dc3359e7bcffd9866e55b4580d30e"} Jun 09 19:52:45.321476 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.321222 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" Jun 09 19:52:45.414037 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.413978 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" podStartSLOduration=3.550748859 podStartE2EDuration="6.413953717s" totalImagesPullingTime="2.863204858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:52:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:52:45.411832186 +0000 UTC m=+550.649997798" watchObservedRunningTime="2026-06-09 19:52:45.413953717 +0000 UTC m=+550.652119328" Jun 09 19:52:45.455436 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.455411 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:45.541064 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.541031 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-bundle\") pod \"5494495f-b247-431a-9bbc-354d1d9a0ed4\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " Jun 09 19:52:45.541241 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.541071 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhdlq\" (UniqueName: \"kubernetes.io/projected/5494495f-b247-431a-9bbc-354d1d9a0ed4-kube-api-access-bhdlq\") pod \"5494495f-b247-431a-9bbc-354d1d9a0ed4\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " Jun 09 19:52:45.541241 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.541184 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-util\") pod \"5494495f-b247-431a-9bbc-354d1d9a0ed4\" (UID: \"5494495f-b247-431a-9bbc-354d1d9a0ed4\") " Jun 09 19:52:45.541989 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.541949 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-bundle" (OuterVolumeSpecName: "bundle") pod "5494495f-b247-431a-9bbc-354d1d9a0ed4" (UID: "5494495f-b247-431a-9bbc-354d1d9a0ed4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:52:45.543260 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.543231 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5494495f-b247-431a-9bbc-354d1d9a0ed4-kube-api-access-bhdlq" (OuterVolumeSpecName: "kube-api-access-bhdlq") pod "5494495f-b247-431a-9bbc-354d1d9a0ed4" (UID: "5494495f-b247-431a-9bbc-354d1d9a0ed4"). InnerVolumeSpecName "kube-api-access-bhdlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:52:45.545196 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.545177 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-util" (OuterVolumeSpecName: "util") pod "5494495f-b247-431a-9bbc-354d1d9a0ed4" (UID: "5494495f-b247-431a-9bbc-354d1d9a0ed4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:52:45.642072 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.642042 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:52:45.642072 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.642068 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5494495f-b247-431a-9bbc-354d1d9a0ed4-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:52:45.642288 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:45.642079 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhdlq\" (UniqueName: \"kubernetes.io/projected/5494495f-b247-431a-9bbc-354d1d9a0ed4-kube-api-access-bhdlq\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:52:46.326870 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:46.326839 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" Jun 09 19:52:46.327350 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:46.326881 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4258531154569488b4b06856545cf53ed48b82e88ddd64b4ce22efab06jpq5x" event={"ID":"5494495f-b247-431a-9bbc-354d1d9a0ed4","Type":"ContainerDied","Data":"d7b50605ba1c90b2417c91d1b8387a514ee0d160894a0c426cc6ef8818d85c15"} Jun 09 19:52:46.327350 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:46.326925 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7b50605ba1c90b2417c91d1b8387a514ee0d160894a0c426cc6ef8818d85c15" Jun 09 19:52:53.494426 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:53.494391 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:53.820726 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:53.820647 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:54.318295 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.318265 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-qmmnl" Jun 09 19:52:54.938240 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.938209 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v"] Jun 09 19:52:54.938696 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.938680 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5494495f-b247-431a-9bbc-354d1d9a0ed4" containerName="pull" Jun 09 19:52:54.938741 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.938699 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5494495f-b247-431a-9bbc-354d1d9a0ed4" containerName="pull" Jun 09 19:52:54.938741 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.938725 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5494495f-b247-431a-9bbc-354d1d9a0ed4" containerName="util" Jun 09 19:52:54.938741 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.938734 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5494495f-b247-431a-9bbc-354d1d9a0ed4" containerName="util" Jun 09 19:52:54.938835 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.938746 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5494495f-b247-431a-9bbc-354d1d9a0ed4" containerName="extract" Jun 09 19:52:54.938835 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.938755 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5494495f-b247-431a-9bbc-354d1d9a0ed4" containerName="extract" Jun 09 19:52:54.938835 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.938823 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5494495f-b247-431a-9bbc-354d1d9a0ed4" containerName="extract" Jun 09 19:52:54.950731 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.950712 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:54.968417 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.968398 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-gl6ph\"" Jun 09 19:52:54.969392 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:54.969378 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jun 09 19:52:55.015616 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.015573 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:55.015616 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.015623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:55.015817 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.015640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpkwh\" (UniqueName: \"kubernetes.io/projected/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-kube-api-access-xpkwh\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:55.023937 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.023913 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v"] Jun 09 19:52:55.116784 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.116752 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:55.116921 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.116791 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:55.116921 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.116808 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpkwh\" (UniqueName: \"kubernetes.io/projected/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-kube-api-access-xpkwh\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:55.117149 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.117113 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:55.117224 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.117171 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:55.133035 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.133016 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jun 09 19:52:55.385422 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.385392 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpkwh\" (UniqueName: \"kubernetes.io/projected/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-kube-api-access-xpkwh\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:55.559472 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.559439 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:55.796315 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:55.796277 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v"] Jun 09 19:52:55.797627 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:52:55.797600 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd7f2f86_f142_4e2f_9b8c_090e978f72c8.slice/crio-f580aae60baa5cef4866a39358608603ad905edd8d4131bcbf5260505faaa64e WatchSource:0}: Error finding container f580aae60baa5cef4866a39358608603ad905edd8d4131bcbf5260505faaa64e: Status 404 returned error can't find the container with id f580aae60baa5cef4866a39358608603ad905edd8d4131bcbf5260505faaa64e Jun 09 19:52:56.294586 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.294503 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:56.331233 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.331209 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-zwfs6" Jun 09 19:52:56.370898 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.370869 2573 generic.go:356] "Generic (PLEG): container finished" podID="fd7f2f86-f142-4e2f-9b8c-090e978f72c8" containerID="708e53c1c34c76c4295532033b87737c5cbe1c9b534487cdf9bdfb357f108b84" exitCode=0 Jun 09 19:52:56.371048 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.370918 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" event={"ID":"fd7f2f86-f142-4e2f-9b8c-090e978f72c8","Type":"ContainerDied","Data":"708e53c1c34c76c4295532033b87737c5cbe1c9b534487cdf9bdfb357f108b84"} Jun 09 19:52:56.371048 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.370952 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" event={"ID":"fd7f2f86-f142-4e2f-9b8c-090e978f72c8","Type":"ContainerStarted","Data":"f580aae60baa5cef4866a39358608603ad905edd8d4131bcbf5260505faaa64e"} Jun 09 19:52:56.537982 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.537948 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-zjt8v"] Jun 09 19:52:56.541447 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.541425 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" Jun 09 19:52:56.546559 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.546508 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 09 19:52:56.546693 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.546675 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-n8xdl\"" Jun 09 19:52:56.560092 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.560070 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp"] Jun 09 19:52:56.563227 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.563212 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" Jun 09 19:52:56.569899 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.569885 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 09 19:52:56.570203 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.570191 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-r9n95\"" Jun 09 19:52:56.583095 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.583073 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-zjt8v"] Jun 09 19:52:56.629790 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.629766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dfpc\" (UniqueName: \"kubernetes.io/projected/0515e67d-404a-4d19-be4d-570abcfd1564-kube-api-access-6dfpc\") pod \"kserve-controller-manager-69fc866d76-zjt8v\" (UID: \"0515e67d-404a-4d19-be4d-570abcfd1564\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" Jun 09 19:52:56.629896 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.629796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qrsq\" (UniqueName: \"kubernetes.io/projected/ca0548aa-1127-42bf-aab4-a8e33b315805-kube-api-access-5qrsq\") pod \"llmisvc-controller-manager-864bfd7bc9-fjngp\" (UID: \"ca0548aa-1127-42bf-aab4-a8e33b315805\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" Jun 09 19:52:56.629896 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.629841 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca0548aa-1127-42bf-aab4-a8e33b315805-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fjngp\" (UID: \"ca0548aa-1127-42bf-aab4-a8e33b315805\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" Jun 09 19:52:56.629896 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.629873 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0515e67d-404a-4d19-be4d-570abcfd1564-cert\") pod \"kserve-controller-manager-69fc866d76-zjt8v\" (UID: \"0515e67d-404a-4d19-be4d-570abcfd1564\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" Jun 09 19:52:56.653562 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.653529 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:56.657154 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.657113 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp"] Jun 09 19:52:56.730975 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.730943 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dfpc\" (UniqueName: \"kubernetes.io/projected/0515e67d-404a-4d19-be4d-570abcfd1564-kube-api-access-6dfpc\") pod \"kserve-controller-manager-69fc866d76-zjt8v\" (UID: \"0515e67d-404a-4d19-be4d-570abcfd1564\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" Jun 09 19:52:56.730975 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.730974 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qrsq\" (UniqueName: \"kubernetes.io/projected/ca0548aa-1127-42bf-aab4-a8e33b315805-kube-api-access-5qrsq\") pod \"llmisvc-controller-manager-864bfd7bc9-fjngp\" (UID: \"ca0548aa-1127-42bf-aab4-a8e33b315805\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" Jun 09 19:52:56.731250 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.731148 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca0548aa-1127-42bf-aab4-a8e33b315805-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fjngp\" (UID: \"ca0548aa-1127-42bf-aab4-a8e33b315805\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" Jun 09 19:52:56.731250 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.731195 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0515e67d-404a-4d19-be4d-570abcfd1564-cert\") pod \"kserve-controller-manager-69fc866d76-zjt8v\" (UID: \"0515e67d-404a-4d19-be4d-570abcfd1564\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" Jun 09 19:52:56.731250 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:52:56.731225 2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 09 19:52:56.731370 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:52:56.731287 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca0548aa-1127-42bf-aab4-a8e33b315805-cert podName:ca0548aa-1127-42bf-aab4-a8e33b315805 nodeName:}" failed. No retries permitted until 2026-06-09 19:52:57.231266194 +0000 UTC m=+562.469431797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ca0548aa-1127-42bf-aab4-a8e33b315805-cert") pod "llmisvc-controller-manager-864bfd7bc9-fjngp" (UID: "ca0548aa-1127-42bf-aab4-a8e33b315805") : secret "llmisvc-webhook-server-cert" not found Jun 09 19:52:56.733512 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.733492 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0515e67d-404a-4d19-be4d-570abcfd1564-cert\") pod \"kserve-controller-manager-69fc866d76-zjt8v\" (UID: \"0515e67d-404a-4d19-be4d-570abcfd1564\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" Jun 09 19:52:56.805424 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.805352 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qrsq\" (UniqueName: \"kubernetes.io/projected/ca0548aa-1127-42bf-aab4-a8e33b315805-kube-api-access-5qrsq\") pod \"llmisvc-controller-manager-864bfd7bc9-fjngp\" (UID: \"ca0548aa-1127-42bf-aab4-a8e33b315805\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" Jun 09 19:52:56.807482 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.807462 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dfpc\" (UniqueName: \"kubernetes.io/projected/0515e67d-404a-4d19-be4d-570abcfd1564-kube-api-access-6dfpc\") pod \"kserve-controller-manager-69fc866d76-zjt8v\" (UID: \"0515e67d-404a-4d19-be4d-570abcfd1564\") " pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" Jun 09 19:52:56.852063 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:56.852037 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" Jun 09 19:52:57.236002 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:57.235963 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca0548aa-1127-42bf-aab4-a8e33b315805-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fjngp\" (UID: \"ca0548aa-1127-42bf-aab4-a8e33b315805\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" Jun 09 19:52:57.238277 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:57.238253 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ca0548aa-1127-42bf-aab4-a8e33b315805-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-fjngp\" (UID: \"ca0548aa-1127-42bf-aab4-a8e33b315805\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" Jun 09 19:52:57.334605 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:57.334580 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-zjt8v"] Jun 09 19:52:57.349906 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:57.349878 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:57.376407 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:57.376378 2573 generic.go:356] "Generic (PLEG): container finished" podID="fd7f2f86-f142-4e2f-9b8c-090e978f72c8" containerID="f06c105cd0eff580bb1861b7c8dff0ca91d13eb4fb5c61f25ad744c7f8fe26d4" exitCode=0 Jun 09 19:52:57.376508 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:57.376471 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" event={"ID":"fd7f2f86-f142-4e2f-9b8c-090e978f72c8","Type":"ContainerDied","Data":"f06c105cd0eff580bb1861b7c8dff0ca91d13eb4fb5c61f25ad744c7f8fe26d4"} Jun 09 19:52:57.377817 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:52:57.377782 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0515e67d_404a_4d19_be4d_570abcfd1564.slice/crio-101962f45ffb100add3f8b5ef86346a3c6072b4c93accd6087c18dfb5d5ffd52 WatchSource:0}: Error finding container 101962f45ffb100add3f8b5ef86346a3c6072b4c93accd6087c18dfb5d5ffd52: Status 404 returned error can't find the container with id 101962f45ffb100add3f8b5ef86346a3c6072b4c93accd6087c18dfb5d5ffd52 Jun 09 19:52:57.471782 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:57.471756 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" Jun 09 19:52:57.693890 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:57.693864 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp"] Jun 09 19:52:57.695028 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:52:57.695001 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podca0548aa_1127_42bf_aab4_a8e33b315805.slice/crio-6a8c1a41ed309a1ce3a8e85f43f87718184ff8b79901050b4b6c96e58410a339 WatchSource:0}: Error finding container 6a8c1a41ed309a1ce3a8e85f43f87718184ff8b79901050b4b6c96e58410a339: Status 404 returned error can't find the container with id 6a8c1a41ed309a1ce3a8e85f43f87718184ff8b79901050b4b6c96e58410a339 Jun 09 19:52:57.877385 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:57.877281 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:58.217557 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:58.217519 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:58.383457 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:58.383419 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" event={"ID":"0515e67d-404a-4d19-be4d-570abcfd1564","Type":"ContainerStarted","Data":"101962f45ffb100add3f8b5ef86346a3c6072b4c93accd6087c18dfb5d5ffd52"} Jun 09 19:52:58.386409 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:58.386376 2573 generic.go:356] "Generic (PLEG): container finished" podID="fd7f2f86-f142-4e2f-9b8c-090e978f72c8" containerID="8cbe7efa4f25932e73cbda66e226b843ed482f142cb7f586c1ae5e2c960b0c5a" exitCode=0 Jun 09 19:52:58.386553 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:58.386459 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" event={"ID":"fd7f2f86-f142-4e2f-9b8c-090e978f72c8","Type":"ContainerDied","Data":"8cbe7efa4f25932e73cbda66e226b843ed482f142cb7f586c1ae5e2c960b0c5a"} Jun 09 19:52:58.388019 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:58.387993 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" event={"ID":"ca0548aa-1127-42bf-aab4-a8e33b315805","Type":"ContainerStarted","Data":"6a8c1a41ed309a1ce3a8e85f43f87718184ff8b79901050b4b6c96e58410a339"} Jun 09 19:52:58.664496 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:58.664463 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:59.354308 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:59.354270 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:59.909889 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:59.909863 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:52:59.958798 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:59.958772 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-util\") pod \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " Jun 09 19:52:59.958909 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:59.958828 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpkwh\" (UniqueName: \"kubernetes.io/projected/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-kube-api-access-xpkwh\") pod \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " Jun 09 19:52:59.958970 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:59.958911 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-bundle\") pod \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\" (UID: \"fd7f2f86-f142-4e2f-9b8c-090e978f72c8\") " Jun 09 19:52:59.960215 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:59.960189 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-bundle" (OuterVolumeSpecName: "bundle") pod "fd7f2f86-f142-4e2f-9b8c-090e978f72c8" (UID: "fd7f2f86-f142-4e2f-9b8c-090e978f72c8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:52:59.962817 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:59.962728 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-kube-api-access-xpkwh" (OuterVolumeSpecName: "kube-api-access-xpkwh") pod "fd7f2f86-f142-4e2f-9b8c-090e978f72c8" (UID: "fd7f2f86-f142-4e2f-9b8c-090e978f72c8"). InnerVolumeSpecName "kube-api-access-xpkwh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:52:59.963897 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:59.963870 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:52:59.967210 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:52:59.967180 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-util" (OuterVolumeSpecName: "util") pod "fd7f2f86-f142-4e2f-9b8c-090e978f72c8" (UID: "fd7f2f86-f142-4e2f-9b8c-090e978f72c8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:53:00.060095 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:00.060065 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:53:00.060095 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:00.060090 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpkwh\" (UniqueName: \"kubernetes.io/projected/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-kube-api-access-xpkwh\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:53:00.060095 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:00.060100 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd7f2f86-f142-4e2f-9b8c-090e978f72c8-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:53:00.402461 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:00.402423 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" Jun 09 19:53:00.402654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:00.402422 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a4lh6v" event={"ID":"fd7f2f86-f142-4e2f-9b8c-090e978f72c8","Type":"ContainerDied","Data":"f580aae60baa5cef4866a39358608603ad905edd8d4131bcbf5260505faaa64e"} Jun 09 19:53:00.402654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:00.402561 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f580aae60baa5cef4866a39358608603ad905edd8d4131bcbf5260505faaa64e" Jun 09 19:53:00.404149 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:00.404106 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" event={"ID":"0515e67d-404a-4d19-be4d-570abcfd1564","Type":"ContainerStarted","Data":"aa371a3fef310ea3a41f009ecd238ba5f1262e6d2470be64e7e8e0d5d5f19435"} Jun 09 19:53:00.404268 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:00.404252 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" Jun 09 19:53:00.461900 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:00.461852 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:00.462844 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:00.462728 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" podStartSLOduration=1.899515971 podStartE2EDuration="4.462708755s" totalImagesPullingTime="2.563192784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:53:00.462450166 +0000 UTC m=+565.700615780" watchObservedRunningTime="2026-06-09 19:53:00.462708755 +0000 UTC m=+565.700874381" Jun 09 19:53:01.409526 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:01.409487 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" event={"ID":"ca0548aa-1127-42bf-aab4-a8e33b315805","Type":"ContainerStarted","Data":"015c25d3a99de9de7b5d5b2f8a34567b43c24a68e655757dd674c362c63a370a"} Jun 09 19:53:01.409919 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:01.409638 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" Jun 09 19:53:01.620469 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:01.620408 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" podStartSLOduration=2.536724551 podStartE2EDuration="5.620392472s" totalImagesPullingTime="3.083667921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:52:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:53:01.597523155 +0000 UTC m=+566.835688767" watchObservedRunningTime="2026-06-09 19:53:01.620392472 +0000 UTC m=+566.858558083" Jun 09 19:53:09.883272 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.883232 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7568d8cfb9-84l8t"] Jun 09 19:53:09.883743 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.883672 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7f2f86-f142-4e2f-9b8c-090e978f72c8" containerName="pull" Jun 09 19:53:09.883743 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.883691 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7f2f86-f142-4e2f-9b8c-090e978f72c8" containerName="pull" Jun 09 19:53:09.883743 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.883717 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7f2f86-f142-4e2f-9b8c-090e978f72c8" containerName="util" Jun 09 19:53:09.883743 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.883726 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7f2f86-f142-4e2f-9b8c-090e978f72c8" containerName="util" Jun 09 19:53:09.883743 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.883735 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7f2f86-f142-4e2f-9b8c-090e978f72c8" containerName="extract" Jun 09 19:53:09.884005 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.883743 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7f2f86-f142-4e2f-9b8c-090e978f72c8" containerName="extract" Jun 09 19:53:09.884005 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.883860 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd7f2f86-f142-4e2f-9b8c-090e978f72c8" containerName="extract" Jun 09 19:53:09.887041 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.887021 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7568d8cfb9-84l8t" Jun 09 19:53:09.890735 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.890715 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 19:53:09.891369 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.891351 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-4q2zn\"" Jun 09 19:53:09.923571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.923545 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7568d8cfb9-84l8t"] Jun 09 19:53:09.941391 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.941360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrrj7\" (UniqueName: \"kubernetes.io/projected/2f6694b6-9dae-4158-9e3f-3a6b7248f5f9-kube-api-access-rrrj7\") pod \"dashboard-redirect-7568d8cfb9-84l8t\" (UID: \"2f6694b6-9dae-4158-9e3f-3a6b7248f5f9\") " pod="opendatahub/dashboard-redirect-7568d8cfb9-84l8t" Jun 09 19:53:09.941479 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:09.941447 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2f6694b6-9dae-4158-9e3f-3a6b7248f5f9-redirect-config\") pod \"dashboard-redirect-7568d8cfb9-84l8t\" (UID: \"2f6694b6-9dae-4158-9e3f-3a6b7248f5f9\") " pod="opendatahub/dashboard-redirect-7568d8cfb9-84l8t" Jun 09 19:53:10.035252 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.035213 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:10.042280 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.042250 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrrj7\" (UniqueName: \"kubernetes.io/projected/2f6694b6-9dae-4158-9e3f-3a6b7248f5f9-kube-api-access-rrrj7\") pod \"dashboard-redirect-7568d8cfb9-84l8t\" (UID: \"2f6694b6-9dae-4158-9e3f-3a6b7248f5f9\") " pod="opendatahub/dashboard-redirect-7568d8cfb9-84l8t" Jun 09 19:53:10.042450 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.042313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2f6694b6-9dae-4158-9e3f-3a6b7248f5f9-redirect-config\") pod \"dashboard-redirect-7568d8cfb9-84l8t\" (UID: \"2f6694b6-9dae-4158-9e3f-3a6b7248f5f9\") " pod="opendatahub/dashboard-redirect-7568d8cfb9-84l8t" Jun 09 19:53:10.043036 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.043015 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/2f6694b6-9dae-4158-9e3f-3a6b7248f5f9-redirect-config\") pod \"dashboard-redirect-7568d8cfb9-84l8t\" (UID: \"2f6694b6-9dae-4158-9e3f-3a6b7248f5f9\") " pod="opendatahub/dashboard-redirect-7568d8cfb9-84l8t" Jun 09 19:53:10.047659 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.047637 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-5h84r"] Jun 09 19:53:10.050894 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.050878 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" Jun 09 19:53:10.054049 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.054027 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 09 19:53:10.054198 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.054181 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 09 19:53:10.054274 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.054260 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-nzxp5\"" Jun 09 19:53:10.088402 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.088378 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrrj7\" (UniqueName: \"kubernetes.io/projected/2f6694b6-9dae-4158-9e3f-3a6b7248f5f9-kube-api-access-rrrj7\") pod \"dashboard-redirect-7568d8cfb9-84l8t\" (UID: \"2f6694b6-9dae-4158-9e3f-3a6b7248f5f9\") " pod="opendatahub/dashboard-redirect-7568d8cfb9-84l8t" Jun 09 19:53:10.143162 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.143064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rznvj\" (UniqueName: \"kubernetes.io/projected/a835446b-04ef-47ab-ac8c-385769d5447f-kube-api-access-rznvj\") pod \"servicemesh-operator3-57f65f65fb-5h84r\" (UID: \"a835446b-04ef-47ab-ac8c-385769d5447f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" Jun 09 19:53:10.143162 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.143116 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a835446b-04ef-47ab-ac8c-385769d5447f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-5h84r\" (UID: \"a835446b-04ef-47ab-ac8c-385769d5447f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" Jun 09 19:53:10.182991 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.182954 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-5h84r"] Jun 09 19:53:10.197402 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.197362 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7568d8cfb9-84l8t" Jun 09 19:53:10.244538 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.244491 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rznvj\" (UniqueName: \"kubernetes.io/projected/a835446b-04ef-47ab-ac8c-385769d5447f-kube-api-access-rznvj\") pod \"servicemesh-operator3-57f65f65fb-5h84r\" (UID: \"a835446b-04ef-47ab-ac8c-385769d5447f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" Jun 09 19:53:10.244714 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.244566 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a835446b-04ef-47ab-ac8c-385769d5447f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-5h84r\" (UID: \"a835446b-04ef-47ab-ac8c-385769d5447f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" Jun 09 19:53:10.247712 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.247690 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/a835446b-04ef-47ab-ac8c-385769d5447f-operator-config\") pod \"servicemesh-operator3-57f65f65fb-5h84r\" (UID: \"a835446b-04ef-47ab-ac8c-385769d5447f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" Jun 09 19:53:10.277936 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.277900 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rznvj\" (UniqueName: \"kubernetes.io/projected/a835446b-04ef-47ab-ac8c-385769d5447f-kube-api-access-rznvj\") pod \"servicemesh-operator3-57f65f65fb-5h84r\" (UID: \"a835446b-04ef-47ab-ac8c-385769d5447f\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" Jun 09 19:53:10.360110 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.360080 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" Jun 09 19:53:10.457519 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:53:10.457485 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f6694b6_9dae_4158_9e3f_3a6b7248f5f9.slice/crio-4456d6c2118ff603b2e272a1fcf08260719efcd81426bce792497abf9011406b WatchSource:0}: Error finding container 4456d6c2118ff603b2e272a1fcf08260719efcd81426bce792497abf9011406b: Status 404 returned error can't find the container with id 4456d6c2118ff603b2e272a1fcf08260719efcd81426bce792497abf9011406b Jun 09 19:53:10.457635 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.457520 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7568d8cfb9-84l8t"] Jun 09 19:53:10.565117 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:53:10.565074 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda835446b_04ef_47ab_ac8c_385769d5447f.slice/crio-05545e3ac1b418539d061e85761d446de89f4169a827a4f085384633b50d3c05 WatchSource:0}: Error finding container 05545e3ac1b418539d061e85761d446de89f4169a827a4f085384633b50d3c05: Status 404 returned error can't find the container with id 05545e3ac1b418539d061e85761d446de89f4169a827a4f085384633b50d3c05 Jun 09 19:53:10.594009 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:10.593980 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-5h84r"] Jun 09 19:53:11.453357 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:11.453321 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" event={"ID":"a835446b-04ef-47ab-ac8c-385769d5447f","Type":"ContainerStarted","Data":"05545e3ac1b418539d061e85761d446de89f4169a827a4f085384633b50d3c05"} Jun 09 19:53:11.454346 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:11.454325 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7568d8cfb9-84l8t" event={"ID":"2f6694b6-9dae-4158-9e3f-3a6b7248f5f9","Type":"ContainerStarted","Data":"4456d6c2118ff603b2e272a1fcf08260719efcd81426bce792497abf9011406b"} Jun 09 19:53:14.472116 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:14.472077 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" event={"ID":"a835446b-04ef-47ab-ac8c-385769d5447f","Type":"ContainerStarted","Data":"3b8938a66715604f6989eef7d00e021ee23b0c80df1c5f792e93649903c9893a"} Jun 09 19:53:14.472573 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:14.472267 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" Jun 09 19:53:14.473756 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:14.473726 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7568d8cfb9-84l8t" event={"ID":"2f6694b6-9dae-4158-9e3f-3a6b7248f5f9","Type":"ContainerStarted","Data":"c46b50d5f29fd128a421dc2a238a321a2aa84eda70351538cac3c73e820d900e"} Jun 09 19:53:14.552962 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:14.552912 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" podStartSLOduration=2.043965627 podStartE2EDuration="5.552899033s" totalImagesPullingTime="3.508933406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:53:14.548369329 +0000 UTC m=+579.786534942" watchObservedRunningTime="2026-06-09 19:53:14.552899033 +0000 UTC m=+579.791064644" Jun 09 19:53:14.715306 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:14.715258 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7568d8cfb9-84l8t" podStartSLOduration=2.042550572 podStartE2EDuration="5.715241606s" totalImagesPullingTime="3.672691034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:53:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:53:14.713942081 +0000 UTC m=+579.952107694" watchObservedRunningTime="2026-06-09 19:53:14.715241606 +0000 UTC m=+579.953407217" Jun 09 19:53:16.183441 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:16.183402 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:17.826427 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:17.826386 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:20.321732 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:20.321694 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:20.415396 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:20.415361 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:23.108061 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:23.108027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:23.220587 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:23.220557 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:25.480345 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:25.480313 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-5h84r" Jun 09 19:53:25.612242 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:25.612199 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:25.793380 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:25.793291 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:30.618619 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:30.618576 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:31.415197 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:31.415168 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-zjt8v" Jun 09 19:53:32.415716 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:32.415682 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-fjngp" Jun 09 19:53:37.896087 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.896054 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-858c698c98-tvnwr"] Jun 09 19:53:37.899471 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.899455 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:37.903106 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.903083 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 19:53:37.904407 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.904389 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 19:53:37.904686 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.904660 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-tjzsf\"" Jun 09 19:53:37.904686 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.904682 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 19:53:37.904844 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.904755 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 19:53:37.904844 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.904755 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 19:53:37.904844 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.904754 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 19:53:37.904985 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.904756 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 19:53:37.910210 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.910192 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 19:53:37.922457 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.922430 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858c698c98-tvnwr"] Jun 09 19:53:37.972269 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.972243 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:37.972410 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.972373 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-console-config\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:37.972410 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.972401 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmk7l\" (UniqueName: \"kubernetes.io/projected/0bab3dd5-9f26-452a-8379-570cd570523b-kube-api-access-dmk7l\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:37.972512 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.972428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-trusted-ca-bundle\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:37.972512 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.972446 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bab3dd5-9f26-452a-8379-570cd570523b-console-oauth-config\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:37.972512 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.972462 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-service-ca\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:37.972627 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.972517 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bab3dd5-9f26-452a-8379-570cd570523b-console-serving-cert\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:37.972627 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:37.972609 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-oauth-serving-cert\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.047378 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.047352 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:38.073414 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.073387 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-oauth-serving-cert\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.073525 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.073429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-console-config\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.073525 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.073449 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmk7l\" (UniqueName: \"kubernetes.io/projected/0bab3dd5-9f26-452a-8379-570cd570523b-kube-api-access-dmk7l\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.073525 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.073506 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-trusted-ca-bundle\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.073630 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.073538 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bab3dd5-9f26-452a-8379-570cd570523b-console-oauth-config\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.073630 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.073562 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-service-ca\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.073630 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.073581 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bab3dd5-9f26-452a-8379-570cd570523b-console-serving-cert\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.074254 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.074224 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-console-config\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.074254 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.074240 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-oauth-serving-cert\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.074433 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.074225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-service-ca\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.074433 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.074426 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0bab3dd5-9f26-452a-8379-570cd570523b-trusted-ca-bundle\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.076032 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.076010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bab3dd5-9f26-452a-8379-570cd570523b-console-oauth-config\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.076155 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.076102 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bab3dd5-9f26-452a-8379-570cd570523b-console-serving-cert\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.090015 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.089993 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmk7l\" (UniqueName: \"kubernetes.io/projected/0bab3dd5-9f26-452a-8379-570cd570523b-kube-api-access-dmk7l\") pod \"console-858c698c98-tvnwr\" (UID: \"0bab3dd5-9f26-452a-8379-570cd570523b\") " pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.209288 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.209197 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:38.235503 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.235478 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:38.362380 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.362349 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-858c698c98-tvnwr"] Jun 09 19:53:38.365931 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:53:38.365906 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bab3dd5_9f26_452a_8379_570cd570523b.slice/crio-b8de89651ccb3a1abb7c8d4432f7d68cd880616a9c1569560ca3fe50542090a8 WatchSource:0}: Error finding container b8de89651ccb3a1abb7c8d4432f7d68cd880616a9c1569560ca3fe50542090a8: Status 404 returned error can't find the container with id b8de89651ccb3a1abb7c8d4432f7d68cd880616a9c1569560ca3fe50542090a8 Jun 09 19:53:38.590158 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.590029 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858c698c98-tvnwr" event={"ID":"0bab3dd5-9f26-452a-8379-570cd570523b","Type":"ContainerStarted","Data":"a4d2925c53f0908fd4f16ca014da529e8cf2609ec501c74a736c061f2490de8a"} Jun 09 19:53:38.590158 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.590103 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-858c698c98-tvnwr" event={"ID":"0bab3dd5-9f26-452a-8379-570cd570523b","Type":"ContainerStarted","Data":"b8de89651ccb3a1abb7c8d4432f7d68cd880616a9c1569560ca3fe50542090a8"} Jun 09 19:53:38.624017 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.623969 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-858c698c98-tvnwr" podStartSLOduration=1.623950599 podStartE2EDuration="1.623950599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:53:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:53:38.620426855 +0000 UTC m=+603.858592459" watchObservedRunningTime="2026-06-09 19:53:38.623950599 +0000 UTC m=+603.862116209" Jun 09 19:53:38.741979 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.741948 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:38.879956 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.879925 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:38.999733 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:38.999699 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:39.133751 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.133369 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrzbd"] Jun 09 19:53:39.134284 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.134255 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:39.137249 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.137222 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" Jun 09 19:53:39.139759 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.139735 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 19:53:39.140741 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.140723 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 19:53:39.140818 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.140723 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-k9ltr\"" Jun 09 19:53:39.151198 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.151174 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrzbd"] Jun 09 19:53:39.181290 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.181261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twpdx\" (UniqueName: \"kubernetes.io/projected/96975ed8-5c00-427a-87c9-a1db0214963f-kube-api-access-twpdx\") pod \"kuadrant-operator-catalog-wrzbd\" (UID: \"96975ed8-5c00-427a-87c9-a1db0214963f\") " pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" Jun 09 19:53:39.235062 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.235035 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:39.282055 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.282033 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twpdx\" (UniqueName: \"kubernetes.io/projected/96975ed8-5c00-427a-87c9-a1db0214963f-kube-api-access-twpdx\") pod \"kuadrant-operator-catalog-wrzbd\" (UID: \"96975ed8-5c00-427a-87c9-a1db0214963f\") " pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" Jun 09 19:53:39.291335 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.291310 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twpdx\" (UniqueName: \"kubernetes.io/projected/96975ed8-5c00-427a-87c9-a1db0214963f-kube-api-access-twpdx\") pod \"kuadrant-operator-catalog-wrzbd\" (UID: \"96975ed8-5c00-427a-87c9-a1db0214963f\") " pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" Jun 09 19:53:39.437617 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.437541 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrzbd"] Jun 09 19:53:39.437795 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.437778 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" Jun 09 19:53:39.571454 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.571429 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrzbd"] Jun 09 19:53:39.572955 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:53:39.572927 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96975ed8_5c00_427a_87c9_a1db0214963f.slice/crio-e0e46d5502d7e59b0d7cd244c820475d9f3f61dfea3051f7006aaa4a116f8fe6 WatchSource:0}: Error finding container e0e46d5502d7e59b0d7cd244c820475d9f3f61dfea3051f7006aaa4a116f8fe6: Status 404 returned error can't find the container with id e0e46d5502d7e59b0d7cd244c820475d9f3f61dfea3051f7006aaa4a116f8fe6 Jun 09 19:53:39.595926 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.595900 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" event={"ID":"96975ed8-5c00-427a-87c9-a1db0214963f","Type":"ContainerStarted","Data":"e0e46d5502d7e59b0d7cd244c820475d9f3f61dfea3051f7006aaa4a116f8fe6"} Jun 09 19:53:39.643501 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.643469 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p948w"] Jun 09 19:53:39.647905 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.647880 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p948w" Jun 09 19:53:39.656845 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.656820 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p948w"] Jun 09 19:53:39.685354 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.685323 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z75g4\" (UniqueName: \"kubernetes.io/projected/0a3d1234-c74a-4ca1-8f3f-25e21d202bb6-kube-api-access-z75g4\") pod \"kuadrant-operator-catalog-p948w\" (UID: \"0a3d1234-c74a-4ca1-8f3f-25e21d202bb6\") " pod="kuadrant-system/kuadrant-operator-catalog-p948w" Jun 09 19:53:39.785850 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.785783 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z75g4\" (UniqueName: \"kubernetes.io/projected/0a3d1234-c74a-4ca1-8f3f-25e21d202bb6-kube-api-access-z75g4\") pod \"kuadrant-operator-catalog-p948w\" (UID: \"0a3d1234-c74a-4ca1-8f3f-25e21d202bb6\") " pod="kuadrant-system/kuadrant-operator-catalog-p948w" Jun 09 19:53:39.796176 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.796151 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z75g4\" (UniqueName: \"kubernetes.io/projected/0a3d1234-c74a-4ca1-8f3f-25e21d202bb6-kube-api-access-z75g4\") pod \"kuadrant-operator-catalog-p948w\" (UID: \"0a3d1234-c74a-4ca1-8f3f-25e21d202bb6\") " pod="kuadrant-system/kuadrant-operator-catalog-p948w" Jun 09 19:53:39.880765 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.880721 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:39.958257 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:39.958216 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-p948w" Jun 09 19:53:40.081694 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:40.081615 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:40.087256 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:40.087226 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-p948w"] Jun 09 19:53:40.130114 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:53:40.130081 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a3d1234_c74a_4ca1_8f3f_25e21d202bb6.slice/crio-00a9c6ef12f7d8825e9aa914a1c675c91819daa00785ac2ddb96322919e3c985 WatchSource:0}: Error finding container 00a9c6ef12f7d8825e9aa914a1c675c91819daa00785ac2ddb96322919e3c985: Status 404 returned error can't find the container with id 00a9c6ef12f7d8825e9aa914a1c675c91819daa00785ac2ddb96322919e3c985 Jun 09 19:53:40.602004 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:40.601969 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p948w" event={"ID":"0a3d1234-c74a-4ca1-8f3f-25e21d202bb6","Type":"ContainerStarted","Data":"00a9c6ef12f7d8825e9aa914a1c675c91819daa00785ac2ddb96322919e3c985"} Jun 09 19:53:42.612936 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:42.612893 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-p948w" event={"ID":"0a3d1234-c74a-4ca1-8f3f-25e21d202bb6","Type":"ContainerStarted","Data":"0e39b5ab3a6db795fee977df3e948d34b788e2499a25dc1ac2a0f77264308cb3"} Jun 09 19:53:42.614410 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:42.614384 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" event={"ID":"96975ed8-5c00-427a-87c9-a1db0214963f","Type":"ContainerStarted","Data":"38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033"} Jun 09 19:53:42.614538 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:42.614478 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" podUID="96975ed8-5c00-427a-87c9-a1db0214963f" containerName="registry-server" containerID="cri-o://38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033" gracePeriod=2 Jun 09 19:53:42.632850 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:42.632809 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-p948w" podStartSLOduration=2.075438125 podStartE2EDuration="3.632794738s" totalImagesPullingTime="1.557356613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:53:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:53:42.632214141 +0000 UTC m=+607.870379753" watchObservedRunningTime="2026-06-09 19:53:42.632794738 +0000 UTC m=+607.870960349" Jun 09 19:53:42.648148 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:42.648092 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" podStartSLOduration=1.5357536619999999 podStartE2EDuration="3.648076618s" totalImagesPullingTime="2.112322956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:53:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:53:42.647534704 +0000 UTC m=+607.885700315" watchObservedRunningTime="2026-06-09 19:53:42.648076618 +0000 UTC m=+607.886242228" Jun 09 19:53:42.858484 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:42.858461 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" Jun 09 19:53:42.908646 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:42.908609 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twpdx\" (UniqueName: \"kubernetes.io/projected/96975ed8-5c00-427a-87c9-a1db0214963f-kube-api-access-twpdx\") pod \"96975ed8-5c00-427a-87c9-a1db0214963f\" (UID: \"96975ed8-5c00-427a-87c9-a1db0214963f\") " Jun 09 19:53:42.910637 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:42.910616 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96975ed8-5c00-427a-87c9-a1db0214963f-kube-api-access-twpdx" (OuterVolumeSpecName: "kube-api-access-twpdx") pod "96975ed8-5c00-427a-87c9-a1db0214963f" (UID: "96975ed8-5c00-427a-87c9-a1db0214963f"). InnerVolumeSpecName "kube-api-access-twpdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:53:43.009231 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:43.009198 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twpdx\" (UniqueName: \"kubernetes.io/projected/96975ed8-5c00-427a-87c9-a1db0214963f-kube-api-access-twpdx\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:53:43.620463 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:43.620370 2573 generic.go:356] "Generic (PLEG): container finished" podID="96975ed8-5c00-427a-87c9-a1db0214963f" containerID="38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033" exitCode=0 Jun 09 19:53:43.620463 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:43.620419 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" Jun 09 19:53:43.620463 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:43.620450 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" event={"ID":"96975ed8-5c00-427a-87c9-a1db0214963f","Type":"ContainerDied","Data":"38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033"} Jun 09 19:53:43.620985 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:43.620509 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wrzbd" event={"ID":"96975ed8-5c00-427a-87c9-a1db0214963f","Type":"ContainerDied","Data":"e0e46d5502d7e59b0d7cd244c820475d9f3f61dfea3051f7006aaa4a116f8fe6"} Jun 09 19:53:43.620985 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:43.620539 2573 scope.go:117] "RemoveContainer" containerID="38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033" Jun 09 19:53:43.629393 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:43.629378 2573 scope.go:117] "RemoveContainer" containerID="38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033" Jun 09 19:53:43.629670 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:53:43.629649 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033\": container with ID starting with 38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033 not found: ID does not exist" containerID="38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033" Jun 09 19:53:43.629722 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:43.629678 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033"} err="failed to get container status \"38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033\": rpc error: code = NotFound desc = could not find container \"38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033\": container with ID starting with 38992a33724e7a85c05e5b76485ea609e3cb17b4c4b011d5285e694c27a43033 not found: ID does not exist" Jun 09 19:53:43.636921 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:43.636900 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrzbd"] Jun 09 19:53:43.641014 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:43.640989 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wrzbd"] Jun 09 19:53:45.262351 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:45.262320 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96975ed8-5c00-427a-87c9-a1db0214963f" path="/var/lib/kubelet/pods/96975ed8-5c00-427a-87c9-a1db0214963f/volumes" Jun 09 19:53:48.209824 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:48.209743 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:48.209824 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:48.209793 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:48.214473 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:48.214452 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:48.649438 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:48.649411 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-858c698c98-tvnwr" Jun 09 19:53:48.906459 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:48.906357 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:49.003608 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:49.003581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:53:49.958351 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:49.958300 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-p948w" Jun 09 19:53:49.958806 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:49.958377 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-p948w" Jun 09 19:53:49.980213 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:49.980189 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-p948w" Jun 09 19:53:50.676314 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:50.676289 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-p948w" Jun 09 19:53:55.202715 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.202676 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz"] Jun 09 19:53:55.203264 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.203241 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96975ed8-5c00-427a-87c9-a1db0214963f" containerName="registry-server" Jun 09 19:53:55.203264 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.203262 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="96975ed8-5c00-427a-87c9-a1db0214963f" containerName="registry-server" Jun 09 19:53:55.203403 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.203373 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="96975ed8-5c00-427a-87c9-a1db0214963f" containerName="registry-server" Jun 09 19:53:55.206631 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.206610 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:53:55.209906 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.209885 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-crm4g\"" Jun 09 19:53:55.226941 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.226912 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz"] Jun 09 19:53:55.308499 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.308468 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kjlx\" (UniqueName: \"kubernetes.io/projected/be406039-4815-46ae-aa57-34591a0bb199-kube-api-access-9kjlx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:53:55.308660 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.308521 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:53:55.308660 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.308596 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:53:55.409483 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.409449 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kjlx\" (UniqueName: \"kubernetes.io/projected/be406039-4815-46ae-aa57-34591a0bb199-kube-api-access-9kjlx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:53:55.409639 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.409494 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:53:55.409639 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.409609 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:53:55.409955 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.409940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:53:55.410012 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.409996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:53:55.419529 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.419505 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kjlx\" (UniqueName: \"kubernetes.io/projected/be406039-4815-46ae-aa57-34591a0bb199-kube-api-access-9kjlx\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:53:55.514878 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.514805 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:53:55.524148 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.524102 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz"] Jun 09 19:53:55.528259 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.528237 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:55.552971 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.552932 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz"] Jun 09 19:53:55.611688 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.611652 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:55.611819 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.611712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:55.611869 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.611837 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs4lz\" (UniqueName: \"kubernetes.io/projected/5923d134-dc70-48f9-b273-f9321ddb2c66-kube-api-access-cs4lz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:55.663863 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.663834 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz"] Jun 09 19:53:55.664845 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:53:55.664819 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe406039_4815_46ae_aa57_34591a0bb199.slice/crio-3c8ad2a9f4fd5e48e35fdefbbf2e0e727fb575aa2c8269abfe7d9a5a4136073c WatchSource:0}: Error finding container 3c8ad2a9f4fd5e48e35fdefbbf2e0e727fb575aa2c8269abfe7d9a5a4136073c: Status 404 returned error can't find the container with id 3c8ad2a9f4fd5e48e35fdefbbf2e0e727fb575aa2c8269abfe7d9a5a4136073c Jun 09 19:53:55.681425 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.681402 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" event={"ID":"be406039-4815-46ae-aa57-34591a0bb199","Type":"ContainerStarted","Data":"3c8ad2a9f4fd5e48e35fdefbbf2e0e727fb575aa2c8269abfe7d9a5a4136073c"} Jun 09 19:53:55.712496 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.712477 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:55.712570 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.712544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:55.712641 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.712625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs4lz\" (UniqueName: \"kubernetes.io/projected/5923d134-dc70-48f9-b273-f9321ddb2c66-kube-api-access-cs4lz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:55.712850 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.712831 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:55.712926 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.712861 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:55.727474 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.727449 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs4lz\" (UniqueName: \"kubernetes.io/projected/5923d134-dc70-48f9-b273-f9321ddb2c66-kube-api-access-cs4lz\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:55.847071 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.847012 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:55.984279 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:55.984095 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz"] Jun 09 19:53:55.986804 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:53:55.986777 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5923d134_dc70_48f9_b273_f9321ddb2c66.slice/crio-ed5d9408b2b652d85c66e533ba84864d43e66a24ea66c5d30b3e04814ed9081f WatchSource:0}: Error finding container ed5d9408b2b652d85c66e533ba84864d43e66a24ea66c5d30b3e04814ed9081f: Status 404 returned error can't find the container with id ed5d9408b2b652d85c66e533ba84864d43e66a24ea66c5d30b3e04814ed9081f Jun 09 19:53:56.188161 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.188120 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r"] Jun 09 19:53:56.191553 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.191537 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:53:56.216293 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.216269 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:53:56.216641 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.216312 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:53:56.216641 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.216386 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z78w4\" (UniqueName: \"kubernetes.io/projected/6c19535f-d2fc-489c-8967-fb37ec6e80b4-kube-api-access-z78w4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:53:56.219381 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.219359 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r"] Jun 09 19:53:56.316981 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.316939 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:53:56.317199 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.316985 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:53:56.317199 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.317045 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z78w4\" (UniqueName: \"kubernetes.io/projected/6c19535f-d2fc-489c-8967-fb37ec6e80b4-kube-api-access-z78w4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:53:56.317374 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.317356 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:53:56.317442 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.317421 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:53:56.326538 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.326499 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z78w4\" (UniqueName: \"kubernetes.io/projected/6c19535f-d2fc-489c-8967-fb37ec6e80b4-kube-api-access-z78w4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:53:56.500916 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.500836 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:53:56.660374 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.660347 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r"] Jun 09 19:53:56.662043 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:53:56.662016 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c19535f_d2fc_489c_8967_fb37ec6e80b4.slice/crio-d87a9e9527beeb97109e2821778929d0d62c433fca008117b9e73239109ea2d3 WatchSource:0}: Error finding container d87a9e9527beeb97109e2821778929d0d62c433fca008117b9e73239109ea2d3: Status 404 returned error can't find the container with id d87a9e9527beeb97109e2821778929d0d62c433fca008117b9e73239109ea2d3 Jun 09 19:53:56.687970 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.687945 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" event={"ID":"6c19535f-d2fc-489c-8967-fb37ec6e80b4","Type":"ContainerStarted","Data":"d87a9e9527beeb97109e2821778929d0d62c433fca008117b9e73239109ea2d3"} Jun 09 19:53:56.689192 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.689170 2573 generic.go:356] "Generic (PLEG): container finished" podID="be406039-4815-46ae-aa57-34591a0bb199" containerID="bb046af8172be0434a1ed8a49d25c6f36214bde4e8e1fa2d6427a86808732ad2" exitCode=0 Jun 09 19:53:56.689263 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.689202 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" event={"ID":"be406039-4815-46ae-aa57-34591a0bb199","Type":"ContainerDied","Data":"bb046af8172be0434a1ed8a49d25c6f36214bde4e8e1fa2d6427a86808732ad2"} Jun 09 19:53:56.690621 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.690601 2573 generic.go:356] "Generic (PLEG): container finished" podID="5923d134-dc70-48f9-b273-f9321ddb2c66" containerID="78780d451be25cf1d7c4686399a13018cb99eff6df52d472678583ffddbfc46e" exitCode=0 Jun 09 19:53:56.690704 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.690685 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" event={"ID":"5923d134-dc70-48f9-b273-f9321ddb2c66","Type":"ContainerDied","Data":"78780d451be25cf1d7c4686399a13018cb99eff6df52d472678583ffddbfc46e"} Jun 09 19:53:56.690782 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.690718 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" event={"ID":"5923d134-dc70-48f9-b273-f9321ddb2c66","Type":"ContainerStarted","Data":"ed5d9408b2b652d85c66e533ba84864d43e66a24ea66c5d30b3e04814ed9081f"} Jun 09 19:53:56.856103 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.856078 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg"] Jun 09 19:53:56.859539 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.859524 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:53:56.881844 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.881818 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg"] Jun 09 19:53:56.926621 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.926592 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:53:56.926772 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.926630 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvbdz\" (UniqueName: \"kubernetes.io/projected/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-kube-api-access-mvbdz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:53:56.926772 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:56.926736 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:53:57.027732 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.027647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:53:57.027732 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.027706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:53:57.027732 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.027730 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvbdz\" (UniqueName: \"kubernetes.io/projected/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-kube-api-access-mvbdz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:53:57.028051 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.028031 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:53:57.028088 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.028046 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:53:57.045471 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.045448 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvbdz\" (UniqueName: \"kubernetes.io/projected/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-kube-api-access-mvbdz\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:53:57.168610 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.168576 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:53:57.315579 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.315555 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg"] Jun 09 19:53:57.333614 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:53:57.333548 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44eaa12e_d82c_4ee4_9050_ba2ad45c193f.slice/crio-2b7324e44e4b340ef81842661a1a13ccb3a4b262a41cf70fcc775c93f0772105 WatchSource:0}: Error finding container 2b7324e44e4b340ef81842661a1a13ccb3a4b262a41cf70fcc775c93f0772105: Status 404 returned error can't find the container with id 2b7324e44e4b340ef81842661a1a13ccb3a4b262a41cf70fcc775c93f0772105 Jun 09 19:53:57.697568 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.697544 2573 generic.go:356] "Generic (PLEG): container finished" podID="5923d134-dc70-48f9-b273-f9321ddb2c66" containerID="9ab43fa8f6c6490e5dae745070e08ffcd264680b7ff0384abb40f1e59097432a" exitCode=0 Jun 09 19:53:57.697677 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.697629 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" event={"ID":"5923d134-dc70-48f9-b273-f9321ddb2c66","Type":"ContainerDied","Data":"9ab43fa8f6c6490e5dae745070e08ffcd264680b7ff0384abb40f1e59097432a"} Jun 09 19:53:57.699188 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.699159 2573 generic.go:356] "Generic (PLEG): container finished" podID="44eaa12e-d82c-4ee4-9050-ba2ad45c193f" containerID="7fb015d836ded0188710720894c728f857f2fc133360845f5cb0f96193966ae3" exitCode=0 Jun 09 19:53:57.699287 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.699192 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" event={"ID":"44eaa12e-d82c-4ee4-9050-ba2ad45c193f","Type":"ContainerDied","Data":"7fb015d836ded0188710720894c728f857f2fc133360845f5cb0f96193966ae3"} Jun 09 19:53:57.699287 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.699236 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" event={"ID":"44eaa12e-d82c-4ee4-9050-ba2ad45c193f","Type":"ContainerStarted","Data":"2b7324e44e4b340ef81842661a1a13ccb3a4b262a41cf70fcc775c93f0772105"} Jun 09 19:53:57.700947 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.700922 2573 generic.go:356] "Generic (PLEG): container finished" podID="6c19535f-d2fc-489c-8967-fb37ec6e80b4" containerID="a2b02bb2676c3fbe3453465652c675eac804fe38b98d8355c3afe435f4878650" exitCode=0 Jun 09 19:53:57.701059 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.701001 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" event={"ID":"6c19535f-d2fc-489c-8967-fb37ec6e80b4","Type":"ContainerDied","Data":"a2b02bb2676c3fbe3453465652c675eac804fe38b98d8355c3afe435f4878650"} Jun 09 19:53:57.703028 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:57.703009 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" event={"ID":"be406039-4815-46ae-aa57-34591a0bb199","Type":"ContainerStarted","Data":"09c26d145e340fb01317fd5c4fe86345b6eed4fdfa0a5fd756a3fe7d3e855261"} Jun 09 19:53:58.709450 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:58.709388 2573 generic.go:356] "Generic (PLEG): container finished" podID="5923d134-dc70-48f9-b273-f9321ddb2c66" containerID="9c00d6276684471035ec53892234eaefb8fc751d185b265cf5e1d7299d98c3ff" exitCode=0 Jun 09 19:53:58.709789 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:58.709483 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" event={"ID":"5923d134-dc70-48f9-b273-f9321ddb2c66","Type":"ContainerDied","Data":"9c00d6276684471035ec53892234eaefb8fc751d185b265cf5e1d7299d98c3ff"} Jun 09 19:53:58.711221 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:58.711199 2573 generic.go:356] "Generic (PLEG): container finished" podID="44eaa12e-d82c-4ee4-9050-ba2ad45c193f" containerID="595c24787857c7b63074db1a3e9e089e996a982b5a17102cc9de2555fc948438" exitCode=0 Jun 09 19:53:58.711304 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:58.711283 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" event={"ID":"44eaa12e-d82c-4ee4-9050-ba2ad45c193f","Type":"ContainerDied","Data":"595c24787857c7b63074db1a3e9e089e996a982b5a17102cc9de2555fc948438"} Jun 09 19:53:58.713616 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:58.713568 2573 generic.go:356] "Generic (PLEG): container finished" podID="be406039-4815-46ae-aa57-34591a0bb199" containerID="09c26d145e340fb01317fd5c4fe86345b6eed4fdfa0a5fd756a3fe7d3e855261" exitCode=0 Jun 09 19:53:58.713616 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:58.713605 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" event={"ID":"be406039-4815-46ae-aa57-34591a0bb199","Type":"ContainerDied","Data":"09c26d145e340fb01317fd5c4fe86345b6eed4fdfa0a5fd756a3fe7d3e855261"} Jun 09 19:53:59.723582 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.723501 2573 generic.go:356] "Generic (PLEG): container finished" podID="6c19535f-d2fc-489c-8967-fb37ec6e80b4" containerID="394b36afc278dba24dfc68ccbded36d8dacc211ee1239738b9848e995210877a" exitCode=0 Jun 09 19:53:59.724028 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.723588 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" event={"ID":"6c19535f-d2fc-489c-8967-fb37ec6e80b4","Type":"ContainerDied","Data":"394b36afc278dba24dfc68ccbded36d8dacc211ee1239738b9848e995210877a"} Jun 09 19:53:59.725765 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.725739 2573 generic.go:356] "Generic (PLEG): container finished" podID="be406039-4815-46ae-aa57-34591a0bb199" containerID="f80fa7f57a6beb0a5154abd47a5237c94e4497420eb23c84759bb227b2434181" exitCode=0 Jun 09 19:53:59.725876 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.725773 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" event={"ID":"be406039-4815-46ae-aa57-34591a0bb199","Type":"ContainerDied","Data":"f80fa7f57a6beb0a5154abd47a5237c94e4497420eb23c84759bb227b2434181"} Jun 09 19:53:59.727705 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.727677 2573 generic.go:356] "Generic (PLEG): container finished" podID="44eaa12e-d82c-4ee4-9050-ba2ad45c193f" containerID="bf9cbee42b9083ca83e230f412e4849deb7f27153be227b9182824aa505b6257" exitCode=0 Jun 09 19:53:59.727822 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.727764 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" event={"ID":"44eaa12e-d82c-4ee4-9050-ba2ad45c193f","Type":"ContainerDied","Data":"bf9cbee42b9083ca83e230f412e4849deb7f27153be227b9182824aa505b6257"} Jun 09 19:53:59.853398 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.853376 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:53:59.961214 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.961185 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-util\") pod \"5923d134-dc70-48f9-b273-f9321ddb2c66\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " Jun 09 19:53:59.961371 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.961222 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-bundle\") pod \"5923d134-dc70-48f9-b273-f9321ddb2c66\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " Jun 09 19:53:59.961371 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.961311 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs4lz\" (UniqueName: \"kubernetes.io/projected/5923d134-dc70-48f9-b273-f9321ddb2c66-kube-api-access-cs4lz\") pod \"5923d134-dc70-48f9-b273-f9321ddb2c66\" (UID: \"5923d134-dc70-48f9-b273-f9321ddb2c66\") " Jun 09 19:53:59.961775 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.961747 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-bundle" (OuterVolumeSpecName: "bundle") pod "5923d134-dc70-48f9-b273-f9321ddb2c66" (UID: "5923d134-dc70-48f9-b273-f9321ddb2c66"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:53:59.963300 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.963274 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5923d134-dc70-48f9-b273-f9321ddb2c66-kube-api-access-cs4lz" (OuterVolumeSpecName: "kube-api-access-cs4lz") pod "5923d134-dc70-48f9-b273-f9321ddb2c66" (UID: "5923d134-dc70-48f9-b273-f9321ddb2c66"). InnerVolumeSpecName "kube-api-access-cs4lz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:53:59.966735 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:53:59.966707 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-util" (OuterVolumeSpecName: "util") pod "5923d134-dc70-48f9-b273-f9321ddb2c66" (UID: "5923d134-dc70-48f9-b273-f9321ddb2c66"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:54:00.062146 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.062051 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs4lz\" (UniqueName: \"kubernetes.io/projected/5923d134-dc70-48f9-b273-f9321ddb2c66-kube-api-access-cs4lz\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:00.062146 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.062078 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:00.062146 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.062088 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5923d134-dc70-48f9-b273-f9321ddb2c66-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:00.734627 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.734546 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" Jun 09 19:54:00.734627 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.734560 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz" event={"ID":"5923d134-dc70-48f9-b273-f9321ddb2c66","Type":"ContainerDied","Data":"ed5d9408b2b652d85c66e533ba84864d43e66a24ea66c5d30b3e04814ed9081f"} Jun 09 19:54:00.734627 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.734605 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ed5d9408b2b652d85c66e533ba84864d43e66a24ea66c5d30b3e04814ed9081f" Jun 09 19:54:00.736646 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.736624 2573 generic.go:356] "Generic (PLEG): container finished" podID="6c19535f-d2fc-489c-8967-fb37ec6e80b4" containerID="19ac1a72ad81e8fa6850f42d9f3c8c8168ec494b59cacd5bda31a70cbe0c192b" exitCode=0 Jun 09 19:54:00.736749 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.736692 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" event={"ID":"6c19535f-d2fc-489c-8967-fb37ec6e80b4","Type":"ContainerDied","Data":"19ac1a72ad81e8fa6850f42d9f3c8c8168ec494b59cacd5bda31a70cbe0c192b"} Jun 09 19:54:00.871366 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.871343 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:54:00.899027 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.899007 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:54:00.969663 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.969638 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-bundle\") pod \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " Jun 09 19:54:00.969827 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.969677 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-util\") pod \"be406039-4815-46ae-aa57-34591a0bb199\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " Jun 09 19:54:00.969827 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.969713 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kjlx\" (UniqueName: \"kubernetes.io/projected/be406039-4815-46ae-aa57-34591a0bb199-kube-api-access-9kjlx\") pod \"be406039-4815-46ae-aa57-34591a0bb199\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " Jun 09 19:54:00.969827 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.969777 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvbdz\" (UniqueName: \"kubernetes.io/projected/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-kube-api-access-mvbdz\") pod \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " Jun 09 19:54:00.969827 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.969812 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-util\") pod \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\" (UID: \"44eaa12e-d82c-4ee4-9050-ba2ad45c193f\") " Jun 09 19:54:00.970042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.969868 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-bundle\") pod \"be406039-4815-46ae-aa57-34591a0bb199\" (UID: \"be406039-4815-46ae-aa57-34591a0bb199\") " Jun 09 19:54:00.970422 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.970393 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-bundle" (OuterVolumeSpecName: "bundle") pod "44eaa12e-d82c-4ee4-9050-ba2ad45c193f" (UID: "44eaa12e-d82c-4ee4-9050-ba2ad45c193f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:54:00.970551 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.970469 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-bundle" (OuterVolumeSpecName: "bundle") pod "be406039-4815-46ae-aa57-34591a0bb199" (UID: "be406039-4815-46ae-aa57-34591a0bb199"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:54:00.971883 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.971860 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be406039-4815-46ae-aa57-34591a0bb199-kube-api-access-9kjlx" (OuterVolumeSpecName: "kube-api-access-9kjlx") pod "be406039-4815-46ae-aa57-34591a0bb199" (UID: "be406039-4815-46ae-aa57-34591a0bb199"). InnerVolumeSpecName "kube-api-access-9kjlx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:54:00.972443 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.972422 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-kube-api-access-mvbdz" (OuterVolumeSpecName: "kube-api-access-mvbdz") pod "44eaa12e-d82c-4ee4-9050-ba2ad45c193f" (UID: "44eaa12e-d82c-4ee4-9050-ba2ad45c193f"). InnerVolumeSpecName "kube-api-access-mvbdz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:54:00.974348 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.974328 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-util" (OuterVolumeSpecName: "util") pod "be406039-4815-46ae-aa57-34591a0bb199" (UID: "be406039-4815-46ae-aa57-34591a0bb199"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:54:00.976297 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:00.976277 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-util" (OuterVolumeSpecName: "util") pod "44eaa12e-d82c-4ee4-9050-ba2ad45c193f" (UID: "44eaa12e-d82c-4ee4-9050-ba2ad45c193f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:54:01.070802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.070732 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:01.070802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.070756 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:01.070802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.070764 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be406039-4815-46ae-aa57-34591a0bb199-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:01.070802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.070773 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kjlx\" (UniqueName: \"kubernetes.io/projected/be406039-4815-46ae-aa57-34591a0bb199-kube-api-access-9kjlx\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:01.070802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.070783 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvbdz\" (UniqueName: \"kubernetes.io/projected/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-kube-api-access-mvbdz\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:01.070802 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.070790 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44eaa12e-d82c-4ee4-9050-ba2ad45c193f-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:01.744368 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.744290 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" Jun 09 19:54:01.744368 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.744326 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg" event={"ID":"44eaa12e-d82c-4ee4-9050-ba2ad45c193f","Type":"ContainerDied","Data":"2b7324e44e4b340ef81842661a1a13ccb3a4b262a41cf70fcc775c93f0772105"} Jun 09 19:54:01.744809 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.744376 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b7324e44e4b340ef81842661a1a13ccb3a4b262a41cf70fcc775c93f0772105" Jun 09 19:54:01.746405 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.746343 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" event={"ID":"be406039-4815-46ae-aa57-34591a0bb199","Type":"ContainerDied","Data":"3c8ad2a9f4fd5e48e35fdefbbf2e0e727fb575aa2c8269abfe7d9a5a4136073c"} Jun 09 19:54:01.746405 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.746398 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c8ad2a9f4fd5e48e35fdefbbf2e0e727fb575aa2c8269abfe7d9a5a4136073c" Jun 09 19:54:01.746620 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.746603 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz" Jun 09 19:54:01.877163 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.877123 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:54:01.976696 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.976655 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-bundle\") pod \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " Jun 09 19:54:01.976696 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.976702 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-util\") pod \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " Jun 09 19:54:01.976933 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.976756 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z78w4\" (UniqueName: \"kubernetes.io/projected/6c19535f-d2fc-489c-8967-fb37ec6e80b4-kube-api-access-z78w4\") pod \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\" (UID: \"6c19535f-d2fc-489c-8967-fb37ec6e80b4\") " Jun 09 19:54:01.977196 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.977165 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-bundle" (OuterVolumeSpecName: "bundle") pod "6c19535f-d2fc-489c-8967-fb37ec6e80b4" (UID: "6c19535f-d2fc-489c-8967-fb37ec6e80b4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:54:01.978860 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.978838 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c19535f-d2fc-489c-8967-fb37ec6e80b4-kube-api-access-z78w4" (OuterVolumeSpecName: "kube-api-access-z78w4") pod "6c19535f-d2fc-489c-8967-fb37ec6e80b4" (UID: "6c19535f-d2fc-489c-8967-fb37ec6e80b4"). InnerVolumeSpecName "kube-api-access-z78w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:54:01.981442 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:01.981419 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-util" (OuterVolumeSpecName: "util") pod "6c19535f-d2fc-489c-8967-fb37ec6e80b4" (UID: "6c19535f-d2fc-489c-8967-fb37ec6e80b4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:54:02.077312 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:02.077238 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z78w4\" (UniqueName: \"kubernetes.io/projected/6c19535f-d2fc-489c-8967-fb37ec6e80b4-kube-api-access-z78w4\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:02.077312 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:02.077264 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-bundle\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:02.077312 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:02.077273 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c19535f-d2fc-489c-8967-fb37ec6e80b4-util\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:02.752803 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:02.752763 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" event={"ID":"6c19535f-d2fc-489c-8967-fb37ec6e80b4","Type":"ContainerDied","Data":"d87a9e9527beeb97109e2821778929d0d62c433fca008117b9e73239109ea2d3"} Jun 09 19:54:02.753192 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:02.752839 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d87a9e9527beeb97109e2821778929d0d62c433fca008117b9e73239109ea2d3" Jun 09 19:54:02.753192 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:02.752778 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r" Jun 09 19:54:08.504244 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:08.504182 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:09.057866 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:09.057836 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:10.149638 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.149606 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:10.585430 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.585347 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:10.587123 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587100 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg"] Jun 09 19:54:10.587448 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587436 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5923d134-dc70-48f9-b273-f9321ddb2c66" containerName="extract" Jun 09 19:54:10.587487 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587450 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5923d134-dc70-48f9-b273-f9321ddb2c66" containerName="extract" Jun 09 19:54:10.587487 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587461 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5923d134-dc70-48f9-b273-f9321ddb2c66" containerName="util" Jun 09 19:54:10.587487 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587467 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5923d134-dc70-48f9-b273-f9321ddb2c66" containerName="util" Jun 09 19:54:10.587487 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587473 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c19535f-d2fc-489c-8967-fb37ec6e80b4" containerName="pull" Jun 09 19:54:10.587487 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587478 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c19535f-d2fc-489c-8967-fb37ec6e80b4" containerName="pull" Jun 09 19:54:10.587487 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587486 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c19535f-d2fc-489c-8967-fb37ec6e80b4" containerName="util" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587491 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c19535f-d2fc-489c-8967-fb37ec6e80b4" containerName="util" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587500 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be406039-4815-46ae-aa57-34591a0bb199" containerName="extract" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587505 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="be406039-4815-46ae-aa57-34591a0bb199" containerName="extract" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587514 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be406039-4815-46ae-aa57-34591a0bb199" containerName="pull" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587519 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="be406039-4815-46ae-aa57-34591a0bb199" containerName="pull" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587526 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be406039-4815-46ae-aa57-34591a0bb199" containerName="util" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587531 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="be406039-4815-46ae-aa57-34591a0bb199" containerName="util" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587538 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44eaa12e-d82c-4ee4-9050-ba2ad45c193f" containerName="util" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587543 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="44eaa12e-d82c-4ee4-9050-ba2ad45c193f" containerName="util" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587555 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5923d134-dc70-48f9-b273-f9321ddb2c66" containerName="pull" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587559 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5923d134-dc70-48f9-b273-f9321ddb2c66" containerName="pull" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587564 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44eaa12e-d82c-4ee4-9050-ba2ad45c193f" containerName="extract" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587569 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="44eaa12e-d82c-4ee4-9050-ba2ad45c193f" containerName="extract" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587575 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c19535f-d2fc-489c-8967-fb37ec6e80b4" containerName="extract" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587580 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c19535f-d2fc-489c-8967-fb37ec6e80b4" containerName="extract" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587588 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44eaa12e-d82c-4ee4-9050-ba2ad45c193f" containerName="pull" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587593 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="44eaa12e-d82c-4ee4-9050-ba2ad45c193f" containerName="pull" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587641 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5923d134-dc70-48f9-b273-f9321ddb2c66" containerName="extract" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587650 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="44eaa12e-d82c-4ee4-9050-ba2ad45c193f" containerName="extract" Jun 09 19:54:10.587654 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587659 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c19535f-d2fc-489c-8967-fb37ec6e80b4" containerName="extract" Jun 09 19:54:10.588429 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.587665 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="be406039-4815-46ae-aa57-34591a0bb199" containerName="extract" Jun 09 19:54:10.591309 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.591289 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.594840 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.594814 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 09 19:54:10.594952 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.594862 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 09 19:54:10.594952 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.594870 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-shpgs\"" Jun 09 19:54:10.594952 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.594893 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 09 19:54:10.595141 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.595114 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 19:54:10.609944 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.609923 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg"] Jun 09 19:54:10.648312 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.648285 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.648469 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.648324 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.648469 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.648424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.648549 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.648471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.648549 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.648490 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zclh2\" (UniqueName: \"kubernetes.io/projected/969fcfa4-cc74-4209-827e-5a3c3aef9286-kube-api-access-zclh2\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.648549 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.648521 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/969fcfa4-cc74-4209-827e-5a3c3aef9286-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.648721 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.648547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/969fcfa4-cc74-4209-827e-5a3c3aef9286-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.695518 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.695483 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:10.749666 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.749632 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.749861 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.749687 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.749861 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.749708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zclh2\" (UniqueName: \"kubernetes.io/projected/969fcfa4-cc74-4209-827e-5a3c3aef9286-kube-api-access-zclh2\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.749861 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.749737 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/969fcfa4-cc74-4209-827e-5a3c3aef9286-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.749861 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.749765 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/969fcfa4-cc74-4209-827e-5a3c3aef9286-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.749861 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.749795 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.749861 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.749820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.750599 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.750566 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.752304 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.752269 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.752531 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.752508 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/969fcfa4-cc74-4209-827e-5a3c3aef9286-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.752645 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.752628 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.752784 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.752761 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/969fcfa4-cc74-4209-827e-5a3c3aef9286-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.764029 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.764004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zclh2\" (UniqueName: \"kubernetes.io/projected/969fcfa4-cc74-4209-827e-5a3c3aef9286-kube-api-access-zclh2\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.764313 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.764294 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/969fcfa4-cc74-4209-827e-5a3c3aef9286-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-t7pbg\" (UID: \"969fcfa4-cc74-4209-827e-5a3c3aef9286\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:10.900792 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:10.900764 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:11.043816 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:11.043792 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg"] Jun 09 19:54:11.045159 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:54:11.045106 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod969fcfa4_cc74_4209_827e_5a3c3aef9286.slice/crio-7545f5b9c083450cf5cc27aec61ddf2a9b616e81474e886b63afe68f18a0c967 WatchSource:0}: Error finding container 7545f5b9c083450cf5cc27aec61ddf2a9b616e81474e886b63afe68f18a0c967: Status 404 returned error can't find the container with id 7545f5b9c083450cf5cc27aec61ddf2a9b616e81474e886b63afe68f18a0c967 Jun 09 19:54:11.328191 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:11.328106 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:11.802620 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:11.802579 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" event={"ID":"969fcfa4-cc74-4209-827e-5a3c3aef9286","Type":"ContainerStarted","Data":"7545f5b9c083450cf5cc27aec61ddf2a9b616e81474e886b63afe68f18a0c967"} Jun 09 19:54:13.490236 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:13.490198 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 19:54:13.490543 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:13.490266 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 09 19:54:13.736402 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:13.736362 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:13.816050 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:13.815966 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" event={"ID":"969fcfa4-cc74-4209-827e-5a3c3aef9286","Type":"ContainerStarted","Data":"1ee92cae4f10fa2801ead1509339a4ca04f2957de806da69627ec3746bc330db"} Jun 09 19:54:13.816191 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:13.816076 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:13.840623 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:13.840571 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" podStartSLOduration=1.397776065 podStartE2EDuration="3.840557979s" totalImagesPullingTime="2.442781914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:54:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:54:13.837728151 +0000 UTC m=+639.075893783" watchObservedRunningTime="2026-06-09 19:54:13.840557979 +0000 UTC m=+639.078723590" Jun 09 19:54:14.154943 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:14.154903 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:14.284494 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:14.284463 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:14.551001 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:14.550915 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:14.686496 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:14.686461 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:14.803224 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:14.803103 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:14.824153 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:14.824102 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-t7pbg" Jun 09 19:54:15.045916 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:15.045875 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:16.261917 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:16.261876 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:17.136073 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:17.136037 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:18.818549 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:18.818503 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:19.125361 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.125273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:19.647511 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.647476 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz"] Jun 09 19:54:19.650722 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.650698 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:19.656451 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.656429 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lmdgr\"" Jun 09 19:54:19.672503 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.672479 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz"] Jun 09 19:54:19.730544 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.730517 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtfqh\" (UniqueName: \"kubernetes.io/projected/9f8cee81-825c-4c80-a90d-9f9939db1156-kube-api-access-qtfqh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" (UID: \"9f8cee81-825c-4c80-a90d-9f9939db1156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:19.730687 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.730560 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8cee81-825c-4c80-a90d-9f9939db1156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" (UID: \"9f8cee81-825c-4c80-a90d-9f9939db1156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:19.831807 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.831774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtfqh\" (UniqueName: \"kubernetes.io/projected/9f8cee81-825c-4c80-a90d-9f9939db1156-kube-api-access-qtfqh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" (UID: \"9f8cee81-825c-4c80-a90d-9f9939db1156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:19.832270 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.831817 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8cee81-825c-4c80-a90d-9f9939db1156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" (UID: \"9f8cee81-825c-4c80-a90d-9f9939db1156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:19.832332 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.832272 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8cee81-825c-4c80-a90d-9f9939db1156-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" (UID: \"9f8cee81-825c-4c80-a90d-9f9939db1156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:19.841478 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.841460 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtfqh\" (UniqueName: \"kubernetes.io/projected/9f8cee81-825c-4c80-a90d-9f9939db1156-kube-api-access-qtfqh\") pod \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" (UID: \"9f8cee81-825c-4c80-a90d-9f9939db1156\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:19.960683 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:19.960586 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:20.098371 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:20.098332 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:20.114814 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:20.114794 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz"] Jun 09 19:54:20.116718 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:54:20.116696 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f8cee81_825c_4c80_a90d_9f9939db1156.slice/crio-715dcfd7151ab043553f7b84b78d66e4c32650a5b95b4f4712c1585d5a5ec900 WatchSource:0}: Error finding container 715dcfd7151ab043553f7b84b78d66e4c32650a5b95b4f4712c1585d5a5ec900: Status 404 returned error can't find the container with id 715dcfd7151ab043553f7b84b78d66e4c32650a5b95b4f4712c1585d5a5ec900 Jun 09 19:54:20.744372 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:20.744338 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:20.857642 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:20.857601 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" event={"ID":"9f8cee81-825c-4c80-a90d-9f9939db1156","Type":"ContainerStarted","Data":"715dcfd7151ab043553f7b84b78d66e4c32650a5b95b4f4712c1585d5a5ec900"} Jun 09 19:54:23.286068 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:23.286015 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:23.391804 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:23.391774 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:23.682617 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:23.682580 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:23.777865 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:23.777831 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:27.476956 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:27.476872 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:27.573628 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:27.573591 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:27.896778 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:27.896747 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" event={"ID":"9f8cee81-825c-4c80-a90d-9f9939db1156","Type":"ContainerStarted","Data":"17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e"} Jun 09 19:54:27.896983 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:27.896874 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:27.928635 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:27.928586 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" podStartSLOduration=1.826656779 podStartE2EDuration="8.928568014s" totalImagesPullingTime="7.101911235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:54:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:54:27.926178294 +0000 UTC m=+653.164344110" watchObservedRunningTime="2026-06-09 19:54:27.928568014 +0000 UTC m=+653.166733673" Jun 09 19:54:30.177055 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:30.177023 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:30.462919 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:30.462834 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:30.898266 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:30.898237 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:30.998308 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:30.998273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:37.189776 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:37.189740 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:37.288450 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:37.288418 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:38.904615 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:38.904586 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:39.850805 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:39.850765 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k"] Jun 09 19:54:39.855920 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:39.855903 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:39.874670 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:39.874640 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k"] Jun 09 19:54:39.891327 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:39.891295 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c281347e-02c4-4821-a245-0a6c6e8e45e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9fx2k\" (UID: \"c281347e-02c4-4821-a245-0a6c6e8e45e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:39.891471 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:39.891351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxfzn\" (UniqueName: \"kubernetes.io/projected/c281347e-02c4-4821-a245-0a6c6e8e45e8-kube-api-access-dxfzn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9fx2k\" (UID: \"c281347e-02c4-4821-a245-0a6c6e8e45e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:39.992445 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:39.992413 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c281347e-02c4-4821-a245-0a6c6e8e45e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9fx2k\" (UID: \"c281347e-02c4-4821-a245-0a6c6e8e45e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:39.992807 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:39.992459 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxfzn\" (UniqueName: \"kubernetes.io/projected/c281347e-02c4-4821-a245-0a6c6e8e45e8-kube-api-access-dxfzn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9fx2k\" (UID: \"c281347e-02c4-4821-a245-0a6c6e8e45e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:39.992807 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:39.992759 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c281347e-02c4-4821-a245-0a6c6e8e45e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9fx2k\" (UID: \"c281347e-02c4-4821-a245-0a6c6e8e45e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:40.000822 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.000799 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxfzn\" (UniqueName: \"kubernetes.io/projected/c281347e-02c4-4821-a245-0a6c6e8e45e8-kube-api-access-dxfzn\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-9fx2k\" (UID: \"c281347e-02c4-4821-a245-0a6c6e8e45e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:40.166042 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.165997 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:40.297766 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.297746 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k"] Jun 09 19:54:40.299773 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:54:40.299747 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc281347e_02c4_4821_a245_0a6c6e8e45e8.slice/crio-198e886efcdc35d71ecef60c1d4c8dd41c59e6c6cbaa9b6af3600770b7da62c0 WatchSource:0}: Error finding container 198e886efcdc35d71ecef60c1d4c8dd41c59e6c6cbaa9b6af3600770b7da62c0: Status 404 returned error can't find the container with id 198e886efcdc35d71ecef60c1d4c8dd41c59e6c6cbaa9b6af3600770b7da62c0 Jun 09 19:54:40.498713 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.498635 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k"] Jun 09 19:54:40.505121 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.505092 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k"] Jun 09 19:54:40.518726 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.518702 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz"] Jun 09 19:54:40.518894 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.518868 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" podUID="9f8cee81-825c-4c80-a90d-9f9939db1156" containerName="manager" containerID="cri-o://17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e" gracePeriod=2 Jun 09 19:54:40.530830 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.530806 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9"] Jun 09 19:54:40.531328 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.531288 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c281347e-02c4-4821-a245-0a6c6e8e45e8" containerName="manager" Jun 09 19:54:40.531328 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.531308 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c281347e-02c4-4821-a245-0a6c6e8e45e8" containerName="manager" Jun 09 19:54:40.531485 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.531391 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c281347e-02c4-4821-a245-0a6c6e8e45e8" containerName="manager" Jun 09 19:54:40.534813 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.534794 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz"] Jun 09 19:54:40.534899 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.534876 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:54:40.537223 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:40.537189 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="9f8cee81-825c-4c80-a90d-9f9939db1156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:40.549854 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.549829 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2"] Jun 09 19:54:40.550218 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.550194 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f8cee81-825c-4c80-a90d-9f9939db1156" containerName="manager" Jun 09 19:54:40.550278 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.550220 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f8cee81-825c-4c80-a90d-9f9939db1156" containerName="manager" Jun 09 19:54:40.550314 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.550292 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f8cee81-825c-4c80-a90d-9f9939db1156" containerName="manager" Jun 09 19:54:40.554038 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.554016 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:40.554308 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.554288 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9"] Jun 09 19:54:40.581285 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:40.581251 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="9f8cee81-825c-4c80-a90d-9f9939db1156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:40.585837 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.585812 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2"] Jun 09 19:54:40.597467 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.597445 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkw9k\" (UniqueName: \"kubernetes.io/projected/77f0e5df-3d3b-46c5-9d54-226175794cd3-kube-api-access-lkw9k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xv7v2\" (UID: \"77f0e5df-3d3b-46c5-9d54-226175794cd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:40.597575 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.597509 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/232dd9ee-c1fe-49de-9a16-a4596918ed97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-76js9\" (UID: \"232dd9ee-c1fe-49de-9a16-a4596918ed97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:54:40.597575 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.597541 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp6w4\" (UniqueName: \"kubernetes.io/projected/232dd9ee-c1fe-49de-9a16-a4596918ed97-kube-api-access-tp6w4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-76js9\" (UID: \"232dd9ee-c1fe-49de-9a16-a4596918ed97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:54:40.597575 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.597562 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77f0e5df-3d3b-46c5-9d54-226175794cd3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xv7v2\" (UID: \"77f0e5df-3d3b-46c5-9d54-226175794cd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:40.698787 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.698756 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkw9k\" (UniqueName: \"kubernetes.io/projected/77f0e5df-3d3b-46c5-9d54-226175794cd3-kube-api-access-lkw9k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xv7v2\" (UID: \"77f0e5df-3d3b-46c5-9d54-226175794cd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:40.698911 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.698817 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/232dd9ee-c1fe-49de-9a16-a4596918ed97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-76js9\" (UID: \"232dd9ee-c1fe-49de-9a16-a4596918ed97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:54:40.698911 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.698845 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp6w4\" (UniqueName: \"kubernetes.io/projected/232dd9ee-c1fe-49de-9a16-a4596918ed97-kube-api-access-tp6w4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-76js9\" (UID: \"232dd9ee-c1fe-49de-9a16-a4596918ed97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:54:40.698911 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.698865 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77f0e5df-3d3b-46c5-9d54-226175794cd3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xv7v2\" (UID: \"77f0e5df-3d3b-46c5-9d54-226175794cd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:40.699299 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.699278 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/232dd9ee-c1fe-49de-9a16-a4596918ed97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-76js9\" (UID: \"232dd9ee-c1fe-49de-9a16-a4596918ed97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:54:40.699354 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.699278 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77f0e5df-3d3b-46c5-9d54-226175794cd3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xv7v2\" (UID: \"77f0e5df-3d3b-46c5-9d54-226175794cd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:40.712571 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.712550 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp6w4\" (UniqueName: \"kubernetes.io/projected/232dd9ee-c1fe-49de-9a16-a4596918ed97-kube-api-access-tp6w4\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-76js9\" (UID: \"232dd9ee-c1fe-49de-9a16-a4596918ed97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:54:40.712674 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.712631 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkw9k\" (UniqueName: \"kubernetes.io/projected/77f0e5df-3d3b-46c5-9d54-226175794cd3-kube-api-access-lkw9k\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xv7v2\" (UID: \"77f0e5df-3d3b-46c5-9d54-226175794cd3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:40.744433 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.744410 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:40.746634 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:40.746610 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="9f8cee81-825c-4c80-a90d-9f9939db1156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:40.799822 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.799767 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8cee81-825c-4c80-a90d-9f9939db1156-extensions-socket-volume\") pod \"9f8cee81-825c-4c80-a90d-9f9939db1156\" (UID: \"9f8cee81-825c-4c80-a90d-9f9939db1156\") " Jun 09 19:54:40.799822 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.799808 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtfqh\" (UniqueName: \"kubernetes.io/projected/9f8cee81-825c-4c80-a90d-9f9939db1156-kube-api-access-qtfqh\") pod \"9f8cee81-825c-4c80-a90d-9f9939db1156\" (UID: \"9f8cee81-825c-4c80-a90d-9f9939db1156\") " Jun 09 19:54:40.800097 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.800077 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f8cee81-825c-4c80-a90d-9f9939db1156-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "9f8cee81-825c-4c80-a90d-9f9939db1156" (UID: "9f8cee81-825c-4c80-a90d-9f9939db1156"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:54:40.801697 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.801681 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f8cee81-825c-4c80-a90d-9f9939db1156-kube-api-access-qtfqh" (OuterVolumeSpecName: "kube-api-access-qtfqh") pod "9f8cee81-825c-4c80-a90d-9f9939db1156" (UID: "9f8cee81-825c-4c80-a90d-9f9939db1156"). InnerVolumeSpecName "kube-api-access-qtfqh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:54:40.891551 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.891503 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:54:40.896553 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.896532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:40.900582 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.900565 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/9f8cee81-825c-4c80-a90d-9f9939db1156-extensions-socket-volume\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:40.900634 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.900588 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtfqh\" (UniqueName: \"kubernetes.io/projected/9f8cee81-825c-4c80-a90d-9f9939db1156-kube-api-access-qtfqh\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:40.971602 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.971568 2573 generic.go:356] "Generic (PLEG): container finished" podID="9f8cee81-825c-4c80-a90d-9f9939db1156" containerID="17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e" exitCode=0 Jun 09 19:54:40.971761 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.971620 2573 scope.go:117] "RemoveContainer" containerID="17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e" Jun 09 19:54:40.971761 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.971648 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:40.974154 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:40.974115 2573 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" container="manager" Jun 09 19:54:40.974345 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:40.974309 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="9f8cee81-825c-4c80-a90d-9f9939db1156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:40.982356 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:40.982315 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="9f8cee81-825c-4c80-a90d-9f9939db1156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:40.985014 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:40.984840 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9fx2k\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="c281347e-02c4-4821-a245-0a6c6e8e45e8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:40.985178 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.985096 2573 scope.go:117] "RemoveContainer" containerID="17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e" Jun 09 19:54:40.985733 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:40.985701 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e\": container with ID starting with 17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e not found: ID does not exist" containerID="17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e" Jun 09 19:54:40.985818 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:40.985739 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e"} err="failed to get container status \"17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e\": rpc error: code = NotFound desc = could not find container \"17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e\": container with ID starting with 17b0548df84d6cb66b6371744713bead054cadad8f2e35b9f2d6f8a0ea9dbc9e not found: ID does not exist" Jun 09 19:54:40.994889 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:40.994865 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-brmwz\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="9f8cee81-825c-4c80-a90d-9f9939db1156" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-brmwz" Jun 09 19:54:40.996831 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:40.996810 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9fx2k\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="c281347e-02c4-4821-a245-0a6c6e8e45e8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:41.054260 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:41.054236 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9"] Jun 09 19:54:41.055906 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:54:41.055879 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod232dd9ee_c1fe_49de_9a16_a4596918ed97.slice/crio-825126c91f9a81f010cc6918d02db5dfc832029cec1048a0c011fe89e6e774fb WatchSource:0}: Error finding container 825126c91f9a81f010cc6918d02db5dfc832029cec1048a0c011fe89e6e774fb: Status 404 returned error can't find the container with id 825126c91f9a81f010cc6918d02db5dfc832029cec1048a0c011fe89e6e774fb Jun 09 19:54:41.061053 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:41.061028 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2"] Jun 09 19:54:41.062073 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:54:41.062051 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77f0e5df_3d3b_46c5_9d54_226175794cd3.slice/crio-02dd8b6f471d22e4b8ef42179184d6fea144d4baace433f290be031c94bc1fff WatchSource:0}: Error finding container 02dd8b6f471d22e4b8ef42179184d6fea144d4baace433f290be031c94bc1fff: Status 404 returned error can't find the container with id 02dd8b6f471d22e4b8ef42179184d6fea144d4baace433f290be031c94bc1fff Jun 09 19:54:41.262781 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:41.262754 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f8cee81-825c-4c80-a90d-9f9939db1156" path="/var/lib/kubelet/pods/9f8cee81-825c-4c80-a90d-9f9939db1156/volumes" Jun 09 19:54:41.980886 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:41.980854 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" event={"ID":"77f0e5df-3d3b-46c5-9d54-226175794cd3","Type":"ContainerStarted","Data":"aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299"} Jun 09 19:54:41.981052 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:41.980907 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" event={"ID":"77f0e5df-3d3b-46c5-9d54-226175794cd3","Type":"ContainerStarted","Data":"02dd8b6f471d22e4b8ef42179184d6fea144d4baace433f290be031c94bc1fff"} Jun 09 19:54:41.981052 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:41.980962 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:41.982576 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:41.982549 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" podUID="c281347e-02c4-4821-a245-0a6c6e8e45e8" containerName="manager" containerID="cri-o://6ab64ed72656db2323c672b34aaa59c1a93a1f0bdb31d9e7442d735e4481eea2" gracePeriod=2 Jun 09 19:54:41.984118 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:41.984091 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" event={"ID":"232dd9ee-c1fe-49de-9a16-a4596918ed97","Type":"ContainerStarted","Data":"9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af"} Jun 09 19:54:41.984237 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:41.984157 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" event={"ID":"232dd9ee-c1fe-49de-9a16-a4596918ed97","Type":"ContainerStarted","Data":"825126c91f9a81f010cc6918d02db5dfc832029cec1048a0c011fe89e6e774fb"} Jun 09 19:54:41.984237 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:41.984190 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:54:42.005077 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.005036 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" podStartSLOduration=2.005023212 podStartE2EDuration="2.005023212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:54:42.002187909 +0000 UTC m=+667.240353521" watchObservedRunningTime="2026-06-09 19:54:42.005023212 +0000 UTC m=+667.243188822" Jun 09 19:54:42.020956 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.020918 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" podStartSLOduration=2.020904729 podStartE2EDuration="2.020904729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:54:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:54:42.02002108 +0000 UTC m=+667.258186691" watchObservedRunningTime="2026-06-09 19:54:42.020904729 +0000 UTC m=+667.259070340" Jun 09 19:54:42.222337 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.222308 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:42.224895 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:42.224873 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9fx2k\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="c281347e-02c4-4821-a245-0a6c6e8e45e8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:42.313285 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.313212 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c281347e-02c4-4821-a245-0a6c6e8e45e8-extensions-socket-volume\") pod \"c281347e-02c4-4821-a245-0a6c6e8e45e8\" (UID: \"c281347e-02c4-4821-a245-0a6c6e8e45e8\") " Jun 09 19:54:42.313285 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.313252 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxfzn\" (UniqueName: \"kubernetes.io/projected/c281347e-02c4-4821-a245-0a6c6e8e45e8-kube-api-access-dxfzn\") pod \"c281347e-02c4-4821-a245-0a6c6e8e45e8\" (UID: \"c281347e-02c4-4821-a245-0a6c6e8e45e8\") " Jun 09 19:54:42.313512 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.313493 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c281347e-02c4-4821-a245-0a6c6e8e45e8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c281347e-02c4-4821-a245-0a6c6e8e45e8" (UID: "c281347e-02c4-4821-a245-0a6c6e8e45e8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:54:42.315253 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.315229 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c281347e-02c4-4821-a245-0a6c6e8e45e8-kube-api-access-dxfzn" (OuterVolumeSpecName: "kube-api-access-dxfzn") pod "c281347e-02c4-4821-a245-0a6c6e8e45e8" (UID: "c281347e-02c4-4821-a245-0a6c6e8e45e8"). InnerVolumeSpecName "kube-api-access-dxfzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:54:42.413947 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.413913 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxfzn\" (UniqueName: \"kubernetes.io/projected/c281347e-02c4-4821-a245-0a6c6e8e45e8-kube-api-access-dxfzn\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:42.413947 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.413940 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c281347e-02c4-4821-a245-0a6c6e8e45e8-extensions-socket-volume\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:42.700610 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.700577 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:42.804048 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.804009 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:42.991912 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.991826 2573 generic.go:356] "Generic (PLEG): container finished" podID="c281347e-02c4-4821-a245-0a6c6e8e45e8" containerID="6ab64ed72656db2323c672b34aaa59c1a93a1f0bdb31d9e7442d735e4481eea2" exitCode=2 Jun 09 19:54:42.991912 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.991870 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:42.992103 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:42.991922 2573 scope.go:117] "RemoveContainer" containerID="6ab64ed72656db2323c672b34aaa59c1a93a1f0bdb31d9e7442d735e4481eea2" Jun 09 19:54:42.994480 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:42.994454 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9fx2k\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="c281347e-02c4-4821-a245-0a6c6e8e45e8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:43.000990 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:43.000977 2573 scope.go:117] "RemoveContainer" containerID="6ab64ed72656db2323c672b34aaa59c1a93a1f0bdb31d9e7442d735e4481eea2" Jun 09 19:54:43.001248 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:43.001232 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ab64ed72656db2323c672b34aaa59c1a93a1f0bdb31d9e7442d735e4481eea2\": container with ID starting with 6ab64ed72656db2323c672b34aaa59c1a93a1f0bdb31d9e7442d735e4481eea2 not found: ID does not exist" containerID="6ab64ed72656db2323c672b34aaa59c1a93a1f0bdb31d9e7442d735e4481eea2" Jun 09 19:54:43.001306 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:43.001256 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ab64ed72656db2323c672b34aaa59c1a93a1f0bdb31d9e7442d735e4481eea2"} err="failed to get container status \"6ab64ed72656db2323c672b34aaa59c1a93a1f0bdb31d9e7442d735e4481eea2\": rpc error: code = NotFound desc = could not find container \"6ab64ed72656db2323c672b34aaa59c1a93a1f0bdb31d9e7442d735e4481eea2\": container with ID starting with 6ab64ed72656db2323c672b34aaa59c1a93a1f0bdb31d9e7442d735e4481eea2 not found: ID does not exist" Jun 09 19:54:43.002200 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:43.002180 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-9fx2k\" is forbidden: User \"system:node:ip-10-0-140-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-8.ec2.internal' and this object" podUID="c281347e-02c4-4821-a245-0a6c6e8e45e8" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-9fx2k" Jun 09 19:54:43.263070 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:43.262991 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c281347e-02c4-4821-a245-0a6c6e8e45e8" path="/var/lib/kubelet/pods/c281347e-02c4-4821-a245-0a6c6e8e45e8/volumes" Jun 09 19:54:43.316410 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:43.316379 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:43.423286 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:43.423252 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:46.681541 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:46.681500 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:46.784473 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:46.784437 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:50.488410 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:50.488377 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:50.590656 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:50.590611 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:52.994862 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:52.994829 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:54:52.995295 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:52.994961 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:53.067853 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.067823 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2"] Jun 09 19:54:53.068044 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.068018 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" podUID="77f0e5df-3d3b-46c5-9d54-226175794cd3" containerName="manager" containerID="cri-o://aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299" gracePeriod=10 Jun 09 19:54:53.319175 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.319152 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:53.392526 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.392486 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj"] Jun 09 19:54:53.392856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.392841 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77f0e5df-3d3b-46c5-9d54-226175794cd3" containerName="manager" Jun 09 19:54:53.392856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.392856 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="77f0e5df-3d3b-46c5-9d54-226175794cd3" containerName="manager" Jun 09 19:54:53.392987 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.392917 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="77f0e5df-3d3b-46c5-9d54-226175794cd3" containerName="manager" Jun 09 19:54:53.395794 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.395772 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" Jun 09 19:54:53.410024 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.410001 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj"] Jun 09 19:54:53.412006 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.411988 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77f0e5df-3d3b-46c5-9d54-226175794cd3-extensions-socket-volume\") pod \"77f0e5df-3d3b-46c5-9d54-226175794cd3\" (UID: \"77f0e5df-3d3b-46c5-9d54-226175794cd3\") " Jun 09 19:54:53.412109 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.412096 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lkw9k\" (UniqueName: \"kubernetes.io/projected/77f0e5df-3d3b-46c5-9d54-226175794cd3-kube-api-access-lkw9k\") pod \"77f0e5df-3d3b-46c5-9d54-226175794cd3\" (UID: \"77f0e5df-3d3b-46c5-9d54-226175794cd3\") " Jun 09 19:54:53.412446 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.412419 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77f0e5df-3d3b-46c5-9d54-226175794cd3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "77f0e5df-3d3b-46c5-9d54-226175794cd3" (UID: "77f0e5df-3d3b-46c5-9d54-226175794cd3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:54:53.414067 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.414040 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77f0e5df-3d3b-46c5-9d54-226175794cd3-kube-api-access-lkw9k" (OuterVolumeSpecName: "kube-api-access-lkw9k") pod "77f0e5df-3d3b-46c5-9d54-226175794cd3" (UID: "77f0e5df-3d3b-46c5-9d54-226175794cd3"). InnerVolumeSpecName "kube-api-access-lkw9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:54:53.513014 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.512978 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/597e3315-989d-458b-affd-cd47137fd3f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhpj\" (UID: \"597e3315-989d-458b-affd-cd47137fd3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" Jun 09 19:54:53.513194 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.513028 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4shq5\" (UniqueName: \"kubernetes.io/projected/597e3315-989d-458b-affd-cd47137fd3f7-kube-api-access-4shq5\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhpj\" (UID: \"597e3315-989d-458b-affd-cd47137fd3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" Jun 09 19:54:53.513194 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.513096 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77f0e5df-3d3b-46c5-9d54-226175794cd3-extensions-socket-volume\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:53.513194 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.513112 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkw9k\" (UniqueName: \"kubernetes.io/projected/77f0e5df-3d3b-46c5-9d54-226175794cd3-kube-api-access-lkw9k\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:54:53.614417 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.614328 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/597e3315-989d-458b-affd-cd47137fd3f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhpj\" (UID: \"597e3315-989d-458b-affd-cd47137fd3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" Jun 09 19:54:53.614417 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.614369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4shq5\" (UniqueName: \"kubernetes.io/projected/597e3315-989d-458b-affd-cd47137fd3f7-kube-api-access-4shq5\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhpj\" (UID: \"597e3315-989d-458b-affd-cd47137fd3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" Jun 09 19:54:53.614787 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.614767 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/597e3315-989d-458b-affd-cd47137fd3f7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhpj\" (UID: \"597e3315-989d-458b-affd-cd47137fd3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" Jun 09 19:54:53.622684 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.622658 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4shq5\" (UniqueName: \"kubernetes.io/projected/597e3315-989d-458b-affd-cd47137fd3f7-kube-api-access-4shq5\") pod \"kuadrant-operator-controller-manager-86878c769f-bfhpj\" (UID: \"597e3315-989d-458b-affd-cd47137fd3f7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" Jun 09 19:54:53.705504 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.705466 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" Jun 09 19:54:53.834829 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:53.834802 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj"] Jun 09 19:54:53.835867 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:54:53.835843 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597e3315_989d_458b_affd_cd47137fd3f7.slice/crio-1eca30785af3c981af7e4d22f448f17f1023c6eb15875b4907880b41d7d7fc22 WatchSource:0}: Error finding container 1eca30785af3c981af7e4d22f448f17f1023c6eb15875b4907880b41d7d7fc22: Status 404 returned error can't find the container with id 1eca30785af3c981af7e4d22f448f17f1023c6eb15875b4907880b41d7d7fc22 Jun 09 19:54:54.057053 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.057015 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" event={"ID":"597e3315-989d-458b-affd-cd47137fd3f7","Type":"ContainerStarted","Data":"1e7b31f115a3cff71d3531a4671feb4c3eabefec9848715207de13d432fb5323"} Jun 09 19:54:54.057686 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.057064 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" event={"ID":"597e3315-989d-458b-affd-cd47137fd3f7","Type":"ContainerStarted","Data":"1eca30785af3c981af7e4d22f448f17f1023c6eb15875b4907880b41d7d7fc22"} Jun 09 19:54:54.057686 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.057111 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" Jun 09 19:54:54.058899 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.058875 2573 generic.go:356] "Generic (PLEG): container finished" podID="77f0e5df-3d3b-46c5-9d54-226175794cd3" containerID="aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299" exitCode=0 Jun 09 19:54:54.059046 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.058935 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" Jun 09 19:54:54.059046 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.058940 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" event={"ID":"77f0e5df-3d3b-46c5-9d54-226175794cd3","Type":"ContainerDied","Data":"aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299"} Jun 09 19:54:54.059046 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.058988 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2" event={"ID":"77f0e5df-3d3b-46c5-9d54-226175794cd3","Type":"ContainerDied","Data":"02dd8b6f471d22e4b8ef42179184d6fea144d4baace433f290be031c94bc1fff"} Jun 09 19:54:54.059046 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.059008 2573 scope.go:117] "RemoveContainer" containerID="aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299" Jun 09 19:54:54.070483 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.070296 2573 scope.go:117] "RemoveContainer" containerID="aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299" Jun 09 19:54:54.070649 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:54:54.070621 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299\": container with ID starting with aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299 not found: ID does not exist" containerID="aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299" Jun 09 19:54:54.070700 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.070658 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299"} err="failed to get container status \"aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299\": rpc error: code = NotFound desc = could not find container \"aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299\": container with ID starting with aa0dda3f803e6f878790fd7ea3a6ddf74037a069639ea8dc5dd3faf4ceb43299 not found: ID does not exist" Jun 09 19:54:54.077704 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.077665 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" podStartSLOduration=1.077652101 podStartE2EDuration="1.077652101s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:54:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:54:54.075919778 +0000 UTC m=+679.314085390" watchObservedRunningTime="2026-06-09 19:54:54.077652101 +0000 UTC m=+679.315817711" Jun 09 19:54:54.095553 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.095527 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2"] Jun 09 19:54:54.101576 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:54.101555 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xv7v2"] Jun 09 19:54:55.262057 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:55.262021 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77f0e5df-3d3b-46c5-9d54-226175794cd3" path="/var/lib/kubelet/pods/77f0e5df-3d3b-46c5-9d54-226175794cd3/volumes" Jun 09 19:54:56.037943 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:56.037882 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:54:56.137235 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:54:56.137188 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:55:03.449495 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:03.449459 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:55:05.067339 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:05.067309 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-bfhpj" Jun 09 19:55:05.121391 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:05.121361 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9"] Jun 09 19:55:05.121589 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:05.121565 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" podUID="232dd9ee-c1fe-49de-9a16-a4596918ed97" containerName="manager" containerID="cri-o://9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af" gracePeriod=10 Jun 09 19:55:05.379336 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:05.379310 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:55:05.519402 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:05.519366 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp6w4\" (UniqueName: \"kubernetes.io/projected/232dd9ee-c1fe-49de-9a16-a4596918ed97-kube-api-access-tp6w4\") pod \"232dd9ee-c1fe-49de-9a16-a4596918ed97\" (UID: \"232dd9ee-c1fe-49de-9a16-a4596918ed97\") " Jun 09 19:55:05.519557 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:05.519432 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/232dd9ee-c1fe-49de-9a16-a4596918ed97-extensions-socket-volume\") pod \"232dd9ee-c1fe-49de-9a16-a4596918ed97\" (UID: \"232dd9ee-c1fe-49de-9a16-a4596918ed97\") " Jun 09 19:55:05.519804 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:05.519782 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/232dd9ee-c1fe-49de-9a16-a4596918ed97-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "232dd9ee-c1fe-49de-9a16-a4596918ed97" (UID: "232dd9ee-c1fe-49de-9a16-a4596918ed97"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 19:55:05.521527 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:05.521505 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/232dd9ee-c1fe-49de-9a16-a4596918ed97-kube-api-access-tp6w4" (OuterVolumeSpecName: "kube-api-access-tp6w4") pod "232dd9ee-c1fe-49de-9a16-a4596918ed97" (UID: "232dd9ee-c1fe-49de-9a16-a4596918ed97"). InnerVolumeSpecName "kube-api-access-tp6w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:55:05.620718 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:05.620643 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/232dd9ee-c1fe-49de-9a16-a4596918ed97-extensions-socket-volume\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:55:05.620718 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:05.620671 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp6w4\" (UniqueName: \"kubernetes.io/projected/232dd9ee-c1fe-49de-9a16-a4596918ed97-kube-api-access-tp6w4\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:55:06.128337 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:06.128297 2573 generic.go:356] "Generic (PLEG): container finished" podID="232dd9ee-c1fe-49de-9a16-a4596918ed97" containerID="9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af" exitCode=0 Jun 09 19:55:06.128724 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:06.128345 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" Jun 09 19:55:06.128724 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:06.128377 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" event={"ID":"232dd9ee-c1fe-49de-9a16-a4596918ed97","Type":"ContainerDied","Data":"9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af"} Jun 09 19:55:06.128724 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:06.128458 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9" event={"ID":"232dd9ee-c1fe-49de-9a16-a4596918ed97","Type":"ContainerDied","Data":"825126c91f9a81f010cc6918d02db5dfc832029cec1048a0c011fe89e6e774fb"} Jun 09 19:55:06.128724 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:06.128480 2573 scope.go:117] "RemoveContainer" containerID="9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af" Jun 09 19:55:06.138004 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:06.137981 2573 scope.go:117] "RemoveContainer" containerID="9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af" Jun 09 19:55:06.138301 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:55:06.138282 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af\": container with ID starting with 9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af not found: ID does not exist" containerID="9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af" Jun 09 19:55:06.138488 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:06.138310 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af"} err="failed to get container status \"9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af\": rpc error: code = NotFound desc = could not find container \"9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af\": container with ID starting with 9664faf7cb668e81f9c70275324249742f3140e895d5b58db503ec24c5b6c6af not found: ID does not exist" Jun 09 19:55:06.154258 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:06.154231 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9"] Jun 09 19:55:06.160162 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:06.160117 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-76js9"] Jun 09 19:55:07.262357 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:07.262322 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="232dd9ee-c1fe-49de-9a16-a4596918ed97" path="/var/lib/kubelet/pods/232dd9ee-c1fe-49de-9a16-a4596918ed97/volumes" Jun 09 19:55:09.418200 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:09.418166 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:55:09.518953 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:09.518915 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:55:13.143971 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:13.143940 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:55:24.311982 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.311903 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:55:24.435981 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.435948 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:55:24.490468 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.490434 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:55:24.707325 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.707292 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 19:55:24.707753 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.707728 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="232dd9ee-c1fe-49de-9a16-a4596918ed97" containerName="manager" Jun 09 19:55:24.707753 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.707752 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="232dd9ee-c1fe-49de-9a16-a4596918ed97" containerName="manager" Jun 09 19:55:24.707958 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.707877 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="232dd9ee-c1fe-49de-9a16-a4596918ed97" containerName="manager" Jun 09 19:55:24.709798 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.709781 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" Jun 09 19:55:24.712386 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.712368 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 19:55:24.712386 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.712377 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-crm4g\"" Jun 09 19:55:24.720360 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.720338 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 19:55:24.736889 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.736861 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 19:55:24.887803 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.887772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k26m5\" (UniqueName: \"kubernetes.io/projected/383f6ab9-8740-42ef-97c8-953253ebbbcb-kube-api-access-k26m5\") pod \"limitador-limitador-54d6d988d5-pczcq\" (UID: \"383f6ab9-8740-42ef-97c8-953253ebbbcb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" Jun 09 19:55:24.888061 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.887813 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/383f6ab9-8740-42ef-97c8-953253ebbbcb-config-file\") pod \"limitador-limitador-54d6d988d5-pczcq\" (UID: \"383f6ab9-8740-42ef-97c8-953253ebbbcb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" Jun 09 19:55:24.989081 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.988988 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/383f6ab9-8740-42ef-97c8-953253ebbbcb-config-file\") pod \"limitador-limitador-54d6d988d5-pczcq\" (UID: \"383f6ab9-8740-42ef-97c8-953253ebbbcb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" Jun 09 19:55:24.989270 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.989096 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k26m5\" (UniqueName: \"kubernetes.io/projected/383f6ab9-8740-42ef-97c8-953253ebbbcb-kube-api-access-k26m5\") pod \"limitador-limitador-54d6d988d5-pczcq\" (UID: \"383f6ab9-8740-42ef-97c8-953253ebbbcb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" Jun 09 19:55:24.989669 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.989646 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/383f6ab9-8740-42ef-97c8-953253ebbbcb-config-file\") pod \"limitador-limitador-54d6d988d5-pczcq\" (UID: \"383f6ab9-8740-42ef-97c8-953253ebbbcb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" Jun 09 19:55:24.997596 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:24.997561 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k26m5\" (UniqueName: \"kubernetes.io/projected/383f6ab9-8740-42ef-97c8-953253ebbbcb-kube-api-access-k26m5\") pod \"limitador-limitador-54d6d988d5-pczcq\" (UID: \"383f6ab9-8740-42ef-97c8-953253ebbbcb\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" Jun 09 19:55:25.020524 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:25.020501 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" Jun 09 19:55:25.159048 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:25.158957 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:55:25.162180 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:25.162155 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 19:55:25.163796 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:25.163778 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 19:55:25.235620 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:25.235590 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" event={"ID":"383f6ab9-8740-42ef-97c8-953253ebbbcb","Type":"ContainerStarted","Data":"c672af4927a4a46eff44dc9b8b22163f13a680264f41df8ed4530aa6b2562cc9"} Jun 09 19:55:25.258871 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:25.258752 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:55:28.257838 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:28.257800 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" event={"ID":"383f6ab9-8740-42ef-97c8-953253ebbbcb","Type":"ContainerStarted","Data":"fb7b4634fa896fe180928eb281478714e98d33af0a9a2f022b815caba3efda14"} Jun 09 19:55:28.258246 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:28.257918 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" Jun 09 19:55:28.274619 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:28.274564 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" podStartSLOduration=1.959656705 podStartE2EDuration="4.274550129s" totalImagesPullingTime="2.314893424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:55:28.273539382 +0000 UTC m=+713.511704993" watchObservedRunningTime="2026-06-09 19:55:28.274550129 +0000 UTC m=+713.512715757" Jun 09 19:55:39.264373 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:39.264346 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-pczcq" Jun 09 19:55:45.051575 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:45.051540 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:55:49.031535 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:55:49.031473 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:56:05.185679 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:56:05.185633 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:56:05.286097 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:56:05.286047 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:56:05.435356 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:56:05.435322 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:56:34.478843 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:56:34.478799 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:56:34.579507 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:56:34.579470 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:03.951365 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:03.951325 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:04.278102 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:04.278012 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:09.910175 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:09.910115 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:09.925676 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:09.925649 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84978dc845-8wzvm"] Jun 09 19:57:09.929099 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:09.929082 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:09.932471 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:09.932301 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 19:57:09.932471 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:09.932320 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-92rjr\"" Jun 09 19:57:09.932774 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:09.932744 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 19:57:09.939101 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:09.939079 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84978dc845-8wzvm"] Jun 09 19:57:10.004412 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.004376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:10.080309 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.080270 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92kmv\" (UniqueName: \"kubernetes.io/projected/889ea8d9-8cca-4db4-a04e-db70fd4e8930-kube-api-access-92kmv\") pod \"maas-controller-84978dc845-8wzvm\" (UID: \"889ea8d9-8cca-4db4-a04e-db70fd4e8930\") " pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:10.080510 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.080440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/889ea8d9-8cca-4db4-a04e-db70fd4e8930-webhook-cert\") pod \"maas-controller-84978dc845-8wzvm\" (UID: \"889ea8d9-8cca-4db4-a04e-db70fd4e8930\") " pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:10.104074 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.104043 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:10.160321 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.160221 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:10.181182 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.181149 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/889ea8d9-8cca-4db4-a04e-db70fd4e8930-webhook-cert\") pod \"maas-controller-84978dc845-8wzvm\" (UID: \"889ea8d9-8cca-4db4-a04e-db70fd4e8930\") " pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:10.181309 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.181245 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92kmv\" (UniqueName: \"kubernetes.io/projected/889ea8d9-8cca-4db4-a04e-db70fd4e8930-kube-api-access-92kmv\") pod \"maas-controller-84978dc845-8wzvm\" (UID: \"889ea8d9-8cca-4db4-a04e-db70fd4e8930\") " pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:10.183622 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.183600 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/889ea8d9-8cca-4db4-a04e-db70fd4e8930-webhook-cert\") pod \"maas-controller-84978dc845-8wzvm\" (UID: \"889ea8d9-8cca-4db4-a04e-db70fd4e8930\") " pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:10.189193 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.189171 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92kmv\" (UniqueName: \"kubernetes.io/projected/889ea8d9-8cca-4db4-a04e-db70fd4e8930-kube-api-access-92kmv\") pod \"maas-controller-84978dc845-8wzvm\" (UID: \"889ea8d9-8cca-4db4-a04e-db70fd4e8930\") " pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:10.240995 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.240960 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:10.373160 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.373138 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84978dc845-8wzvm"] Jun 09 19:57:10.374422 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:57:10.374398 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889ea8d9_8cca_4db4_a04e_db70fd4e8930.slice/crio-f3ba078924ab82566b0cca6bb95c7e1108322d0e58cf90f8d1cc81476abecdfb WatchSource:0}: Error finding container f3ba078924ab82566b0cca6bb95c7e1108322d0e58cf90f8d1cc81476abecdfb: Status 404 returned error can't find the container with id f3ba078924ab82566b0cca6bb95c7e1108322d0e58cf90f8d1cc81476abecdfb Jun 09 19:57:10.784261 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:10.784230 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84978dc845-8wzvm" event={"ID":"889ea8d9-8cca-4db4-a04e-db70fd4e8930","Type":"ContainerStarted","Data":"f3ba078924ab82566b0cca6bb95c7e1108322d0e58cf90f8d1cc81476abecdfb"} Jun 09 19:57:12.796114 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:12.796080 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84978dc845-8wzvm" event={"ID":"889ea8d9-8cca-4db4-a04e-db70fd4e8930","Type":"ContainerStarted","Data":"66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec"} Jun 09 19:57:12.796471 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:12.796282 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:12.814047 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:12.814003 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84978dc845-8wzvm" podStartSLOduration=1.47414735 podStartE2EDuration="3.813986732s" totalImagesPullingTime="2.339839382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:57:12.813870253 +0000 UTC m=+818.052035864" watchObservedRunningTime="2026-06-09 19:57:12.813986732 +0000 UTC m=+818.052152355" Jun 09 19:57:12.940688 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:12.940651 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:13.033168 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:13.033057 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:23.814037 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:23.814008 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:24.377586 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.377554 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84978dc845-8wzvm"] Jun 09 19:57:24.377760 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.377736 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-84978dc845-8wzvm" podUID="889ea8d9-8cca-4db4-a04e-db70fd4e8930" containerName="manager" containerID="cri-o://66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec" gracePeriod=30 Jun 09 19:57:24.622154 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.622116 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:24.708916 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.708882 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92kmv\" (UniqueName: \"kubernetes.io/projected/889ea8d9-8cca-4db4-a04e-db70fd4e8930-kube-api-access-92kmv\") pod \"889ea8d9-8cca-4db4-a04e-db70fd4e8930\" (UID: \"889ea8d9-8cca-4db4-a04e-db70fd4e8930\") " Jun 09 19:57:24.709091 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.708952 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/889ea8d9-8cca-4db4-a04e-db70fd4e8930-webhook-cert\") pod \"889ea8d9-8cca-4db4-a04e-db70fd4e8930\" (UID: \"889ea8d9-8cca-4db4-a04e-db70fd4e8930\") " Jun 09 19:57:24.711026 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.711001 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/889ea8d9-8cca-4db4-a04e-db70fd4e8930-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "889ea8d9-8cca-4db4-a04e-db70fd4e8930" (UID: "889ea8d9-8cca-4db4-a04e-db70fd4e8930"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 19:57:24.711152 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.711032 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/889ea8d9-8cca-4db4-a04e-db70fd4e8930-kube-api-access-92kmv" (OuterVolumeSpecName: "kube-api-access-92kmv") pod "889ea8d9-8cca-4db4-a04e-db70fd4e8930" (UID: "889ea8d9-8cca-4db4-a04e-db70fd4e8930"). InnerVolumeSpecName "kube-api-access-92kmv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 19:57:24.810057 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.810031 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92kmv\" (UniqueName: \"kubernetes.io/projected/889ea8d9-8cca-4db4-a04e-db70fd4e8930-kube-api-access-92kmv\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:57:24.810057 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.810051 2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/889ea8d9-8cca-4db4-a04e-db70fd4e8930-webhook-cert\") on node \"ip-10-0-140-8.ec2.internal\" DevicePath \"\"" Jun 09 19:57:24.860866 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.860829 2573 generic.go:356] "Generic (PLEG): container finished" podID="889ea8d9-8cca-4db4-a04e-db70fd4e8930" containerID="66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec" exitCode=0 Jun 09 19:57:24.860866 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.860870 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84978dc845-8wzvm" Jun 09 19:57:24.861352 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.860910 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84978dc845-8wzvm" event={"ID":"889ea8d9-8cca-4db4-a04e-db70fd4e8930","Type":"ContainerDied","Data":"66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec"} Jun 09 19:57:24.861352 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.860969 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84978dc845-8wzvm" event={"ID":"889ea8d9-8cca-4db4-a04e-db70fd4e8930","Type":"ContainerDied","Data":"f3ba078924ab82566b0cca6bb95c7e1108322d0e58cf90f8d1cc81476abecdfb"} Jun 09 19:57:24.861352 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.860998 2573 scope.go:117] "RemoveContainer" containerID="66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec" Jun 09 19:57:24.870076 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.870059 2573 scope.go:117] "RemoveContainer" containerID="66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec" Jun 09 19:57:24.870377 ip-10-0-140-8 kubenswrapper[2573]: E0609 19:57:24.870352 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec\": container with ID starting with 66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec not found: ID does not exist" containerID="66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec" Jun 09 19:57:24.870471 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.870385 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec"} err="failed to get container status \"66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec\": rpc error: code = NotFound desc = could not find container \"66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec\": container with ID starting with 66ec16fc74a228393b016482ec563494ce760667fcacd7c8f91f1548053a7cec not found: ID does not exist" Jun 09 19:57:24.881784 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.881761 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84978dc845-8wzvm"] Jun 09 19:57:24.885899 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:24.885877 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84978dc845-8wzvm"] Jun 09 19:57:25.262856 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:25.262809 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="889ea8d9-8cca-4db4-a04e-db70fd4e8930" path="/var/lib/kubelet/pods/889ea8d9-8cca-4db4-a04e-db70fd4e8930/volumes" Jun 09 19:57:44.419177 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:44.419114 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:44.853731 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:44.853653 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:44.954586 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:44.954552 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:44.977344 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:44.977316 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-4g4m7"] Jun 09 19:57:44.977693 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:44.977679 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="889ea8d9-8cca-4db4-a04e-db70fd4e8930" containerName="manager" Jun 09 19:57:44.977693 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:44.977693 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="889ea8d9-8cca-4db4-a04e-db70fd4e8930" containerName="manager" Jun 09 19:57:44.977787 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:44.977754 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="889ea8d9-8cca-4db4-a04e-db70fd4e8930" containerName="manager" Jun 09 19:57:44.982077 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:44.982057 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-4g4m7" Jun 09 19:57:44.985222 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:44.985197 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 19:57:44.985333 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:44.985278 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-qdsdc\"" Jun 09 19:57:44.991152 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:44.991109 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-4g4m7"] Jun 09 19:57:45.016682 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.016651 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-fqbmc"] Jun 09 19:57:45.025340 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.025313 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 19:57:45.029773 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.029741 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-fqbmc"] Jun 09 19:57:45.036244 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.036216 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:57:45.078951 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.078915 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rd9n4\" (UniqueName: \"kubernetes.io/projected/0b665cc0-b1a8-4e73-a91e-367d594c4947-kube-api-access-rd9n4\") pod \"payload-pre-processing-67d7689b65-4g4m7\" (UID: \"0b665cc0-b1a8-4e73-a91e-367d594c4947\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-4g4m7" Jun 09 19:57:45.102368 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.102339 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 19:57:45.180070 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.180036 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rd9n4\" (UniqueName: \"kubernetes.io/projected/0b665cc0-b1a8-4e73-a91e-367d594c4947-kube-api-access-rd9n4\") pod \"payload-pre-processing-67d7689b65-4g4m7\" (UID: \"0b665cc0-b1a8-4e73-a91e-367d594c4947\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-4g4m7" Jun 09 19:57:45.180070 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.180075 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6cqj\" (UniqueName: \"kubernetes.io/projected/edd96816-ef7d-481e-b361-9b4568d20a52-kube-api-access-h6cqj\") pod \"payload-processing-7c6c859784-fqbmc\" (UID: \"edd96816-ef7d-481e-b361-9b4568d20a52\") " pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 19:57:45.188788 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.188764 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rd9n4\" (UniqueName: \"kubernetes.io/projected/0b665cc0-b1a8-4e73-a91e-367d594c4947-kube-api-access-rd9n4\") pod \"payload-pre-processing-67d7689b65-4g4m7\" (UID: \"0b665cc0-b1a8-4e73-a91e-367d594c4947\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-4g4m7" Jun 09 19:57:45.281163 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.281111 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6cqj\" (UniqueName: \"kubernetes.io/projected/edd96816-ef7d-481e-b361-9b4568d20a52-kube-api-access-h6cqj\") pod \"payload-processing-7c6c859784-fqbmc\" (UID: \"edd96816-ef7d-481e-b361-9b4568d20a52\") " pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 19:57:45.289529 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.289500 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6cqj\" (UniqueName: \"kubernetes.io/projected/edd96816-ef7d-481e-b361-9b4568d20a52-kube-api-access-h6cqj\") pod \"payload-processing-7c6c859784-fqbmc\" (UID: \"edd96816-ef7d-481e-b361-9b4568d20a52\") " pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 19:57:45.294095 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.294075 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-4g4m7" Jun 09 19:57:45.338979 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.338953 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 19:57:45.436959 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.436928 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-4g4m7"] Jun 09 19:57:45.438700 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:57:45.438661 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b665cc0_b1a8_4e73_a91e_367d594c4947.slice/crio-b1d8fb27dac0b19703d208fed6203d41031d1646d8ea349fdeba782d84ba48bc WatchSource:0}: Error finding container b1d8fb27dac0b19703d208fed6203d41031d1646d8ea349fdeba782d84ba48bc: Status 404 returned error can't find the container with id b1d8fb27dac0b19703d208fed6203d41031d1646d8ea349fdeba782d84ba48bc Jun 09 19:57:45.486163 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.486120 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-fqbmc"] Jun 09 19:57:45.487633 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:57:45.487595 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedd96816_ef7d_481e_b361_9b4568d20a52.slice/crio-e03a72a10d1d45c4c4a5a2b05862fcb334ef072dc0a5ddf94960812bb018734b WatchSource:0}: Error finding container e03a72a10d1d45c4c4a5a2b05862fcb334ef072dc0a5ddf94960812bb018734b: Status 404 returned error can't find the container with id e03a72a10d1d45c4c4a5a2b05862fcb334ef072dc0a5ddf94960812bb018734b Jun 09 19:57:45.972341 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.972304 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerStarted","Data":"e03a72a10d1d45c4c4a5a2b05862fcb334ef072dc0a5ddf94960812bb018734b"} Jun 09 19:57:45.973389 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:45.973366 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-4g4m7" event={"ID":"0b665cc0-b1a8-4e73-a91e-367d594c4947","Type":"ContainerStarted","Data":"b1d8fb27dac0b19703d208fed6203d41031d1646d8ea349fdeba782d84ba48bc"} Jun 09 19:57:47.985432 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:47.985395 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerStarted","Data":"b8e6054f04dc7d4c5c65b69147a21a998b8fcbfcb71e90a5e5e4418ac4dfb327"} Jun 09 19:57:47.985885 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:47.985471 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 19:57:47.986902 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:47.986881 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-4g4m7" event={"ID":"0b665cc0-b1a8-4e73-a91e-367d594c4947","Type":"ContainerStarted","Data":"48bd0c37aa7814a1dc91258a62614375afece8a5467716e508426e39bd10182c"} Jun 09 19:57:47.987032 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:47.986999 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-4g4m7" Jun 09 19:57:48.004035 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:48.003985 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podStartSLOduration=2.47693796 podStartE2EDuration="4.003971545s" totalImagesPullingTime="1.527033585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:57:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:57:48.002285789 +0000 UTC m=+853.240451401" watchObservedRunningTime="2026-06-09 19:57:48.003971545 +0000 UTC m=+853.242137157" Jun 09 19:57:48.018594 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:48.018553 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-4g4m7" podStartSLOduration=2.440381284 podStartE2EDuration="4.018534797s" totalImagesPullingTime="1.578153513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:57:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:57:48.017694799 +0000 UTC m=+853.255860410" watchObservedRunningTime="2026-06-09 19:57:48.018534797 +0000 UTC m=+853.256700444" Jun 09 19:57:58.994331 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:58.994297 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 19:57:58.994743 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:57:58.994422 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-4g4m7" Jun 09 19:58:34.973696 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:58:34.973657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:58:36.038884 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:58:36.038851 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:58:52.066733 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:58:52.066695 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:58:53.316353 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:58:53.316319 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:58:53.664455 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:58:53.664414 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 19:59:07.132925 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:07.132885 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:59:07.277221 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:07.277191 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:59:10.890433 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.890398 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks"] Jun 09 19:59:10.894792 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.894768 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.897381 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.897355 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 09 19:59:10.897543 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.897417 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xnhjl\"" Jun 09 19:59:10.897825 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.897799 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.897935 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.897848 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d6abec3-ac72-4097-8b42-16ded11667fa-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.897935 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.897900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.897935 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.897923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.898109 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.897999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.898109 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.898035 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csdz4\" (UniqueName: \"kubernetes.io/projected/6d6abec3-ac72-4097-8b42-16ded11667fa-kube-api-access-csdz4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.898321 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.898301 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 19:59:10.898383 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.898304 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 19:59:10.904479 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.904457 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks"] Jun 09 19:59:10.926663 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.926631 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:59:10.998811 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.998778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.998973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.998816 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csdz4\" (UniqueName: \"kubernetes.io/projected/6d6abec3-ac72-4097-8b42-16ded11667fa-kube-api-access-csdz4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.998973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.998867 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.998973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.998888 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d6abec3-ac72-4097-8b42-16ded11667fa-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.998973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.998908 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.998973 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.998930 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.999275 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.999249 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.999335 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.999272 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:10.999335 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:10.999320 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:11.001182 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:11.001164 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d6abec3-ac72-4097-8b42-16ded11667fa-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:11.001565 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:11.001544 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d6abec3-ac72-4097-8b42-16ded11667fa-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:11.007505 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:11.007481 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csdz4\" (UniqueName: \"kubernetes.io/projected/6d6abec3-ac72-4097-8b42-16ded11667fa-kube-api-access-csdz4\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-ddpks\" (UID: \"6d6abec3-ac72-4097-8b42-16ded11667fa\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:11.207071 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:11.206986 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 19:59:11.346179 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:11.343521 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks"] Jun 09 19:59:11.346179 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:59:11.343920 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6abec3_ac72_4097_8b42_16ded11667fa.slice/crio-fdec582feab4aeea67d89f81baf33fb3bd64c437eea27507a479ae035de642c9 WatchSource:0}: Error finding container fdec582feab4aeea67d89f81baf33fb3bd64c437eea27507a479ae035de642c9: Status 404 returned error can't find the container with id fdec582feab4aeea67d89f81baf33fb3bd64c437eea27507a479ae035de642c9 Jun 09 19:59:11.406685 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:11.406656 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 19:59:11.437966 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:11.437939 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" event={"ID":"6d6abec3-ac72-4097-8b42-16ded11667fa","Type":"ContainerStarted","Data":"fdec582feab4aeea67d89f81baf33fb3bd64c437eea27507a479ae035de642c9"} Jun 09 19:59:15.464492 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:15.464455 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" event={"ID":"6d6abec3-ac72-4097-8b42-16ded11667fa","Type":"ContainerStarted","Data":"baff11056950ae9cd89ef19c6d33d62d25d30e3f7879b62cb23402d6cdad1305"} Jun 09 19:59:27.148087 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:27.148050 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:59:27.605500 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:27.605410 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 19:59:33.622867 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.622822 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx"] Jun 09 19:59:33.627405 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.627382 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.630264 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.630241 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 19:59:33.638337 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.638316 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx"] Jun 09 19:59:33.658205 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.658172 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:59:33.688567 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.688543 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb984f59-d415-47c2-b103-6820a3f8e670-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.688675 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.688577 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.688675 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.688610 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.688747 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.688697 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.688782 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.688748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlsgw\" (UniqueName: \"kubernetes.io/projected/eb984f59-d415-47c2-b103-6820a3f8e670-kube-api-access-zlsgw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.688782 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.688772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.789211 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.789177 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb984f59-d415-47c2-b103-6820a3f8e670-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.789381 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.789221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.789381 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.789340 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.789470 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.789403 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.789470 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.789430 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlsgw\" (UniqueName: \"kubernetes.io/projected/eb984f59-d415-47c2-b103-6820a3f8e670-kube-api-access-zlsgw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.789470 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.789451 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.789635 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.789567 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.789784 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.789761 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.789860 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.789800 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.791682 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.791662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb984f59-d415-47c2-b103-6820a3f8e670-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.791961 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.791941 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb984f59-d415-47c2-b103-6820a3f8e670-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.797482 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.797463 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlsgw\" (UniqueName: \"kubernetes.io/projected/eb984f59-d415-47c2-b103-6820a3f8e670-kube-api-access-zlsgw\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx\" (UID: \"eb984f59-d415-47c2-b103-6820a3f8e670\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:33.941263 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:33.941230 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:34.074716 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:34.074689 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx"] Jun 09 19:59:34.076409 ip-10-0-140-8 kubenswrapper[2573]: W0609 19:59:34.076376 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb984f59_d415_47c2_b103_6820a3f8e670.slice/crio-e3d28fd634e4d99e00fa2b170c0bf8df52fa6c9b59102838e949e45bd5196cfa WatchSource:0}: Error finding container e3d28fd634e4d99e00fa2b170c0bf8df52fa6c9b59102838e949e45bd5196cfa: Status 404 returned error can't find the container with id e3d28fd634e4d99e00fa2b170c0bf8df52fa6c9b59102838e949e45bd5196cfa Jun 09 19:59:34.237648 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:34.237548 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:59:34.339614 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:34.339579 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:59:34.410584 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:34.410542 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 19:59:34.575361 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:34.575263 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" event={"ID":"eb984f59-d415-47c2-b103-6820a3f8e670","Type":"ContainerStarted","Data":"8205e8e26398ee72faa0cc1e0cc03d448368054a44aaaf4e3043471750383e0a"} Jun 09 19:59:34.575361 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:34.575330 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" event={"ID":"eb984f59-d415-47c2-b103-6820a3f8e670","Type":"ContainerStarted","Data":"e3d28fd634e4d99e00fa2b170c0bf8df52fa6c9b59102838e949e45bd5196cfa"} Jun 09 19:59:34.614280 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:34.614238 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:59:36.586803 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:36.586711 2573 generic.go:356] "Generic (PLEG): container finished" podID="eb984f59-d415-47c2-b103-6820a3f8e670" containerID="8205e8e26398ee72faa0cc1e0cc03d448368054a44aaaf4e3043471750383e0a" exitCode=0 Jun 09 19:59:36.586803 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:36.586772 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" event={"ID":"eb984f59-d415-47c2-b103-6820a3f8e670","Type":"ContainerDied","Data":"8205e8e26398ee72faa0cc1e0cc03d448368054a44aaaf4e3043471750383e0a"} Jun 09 19:59:38.600212 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:38.600177 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" event={"ID":"eb984f59-d415-47c2-b103-6820a3f8e670","Type":"ContainerStarted","Data":"6e68e30a783f1c3d21c83154080d9577e6d0393bba2204264b1a51ff4382ecd5"} Jun 09 19:59:38.621297 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:38.621249 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" podStartSLOduration=2.489231586 podStartE2EDuration="5.621232976s" totalImagesPullingTime="1.070742778s" totalInitContainerRuntime="2.061258612s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 19:59:38.619391111 +0000 UTC m=+963.857556724" watchObservedRunningTime="2026-06-09 19:59:38.621232976 +0000 UTC m=+963.859398586" Jun 09 19:59:43.941852 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:43.941811 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:43.942287 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:43.941888 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:43.954295 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:43.954270 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:44.643675 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:44.643643 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx" Jun 09 19:59:47.650256 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:47.650225 2573 generic.go:356] "Generic (PLEG): container finished" podID="edd96816-ef7d-481e-b361-9b4568d20a52" containerID="b8e6054f04dc7d4c5c65b69147a21a998b8fcbfcb71e90a5e5e4418ac4dfb327" exitCode=1 Jun 09 19:59:47.650656 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:47.650296 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerDied","Data":"b8e6054f04dc7d4c5c65b69147a21a998b8fcbfcb71e90a5e5e4418ac4dfb327"} Jun 09 19:59:47.650656 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:47.650614 2573 scope.go:117] "RemoveContainer" containerID="b8e6054f04dc7d4c5c65b69147a21a998b8fcbfcb71e90a5e5e4418ac4dfb327" Jun 09 19:59:48.658019 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:48.657985 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerStarted","Data":"89e5d08622ead36b6d19a74ebe7c302e91a554ea23df751481929b67443b4095"} Jun 09 19:59:48.658536 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:48.658319 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 19:59:56.219872 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:56.219835 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 19:59:56.806311 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:56.806273 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 19:59:59.665665 ip-10-0-140-8 kubenswrapper[2573]: I0609 19:59:59.665634 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:00:02.954799 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:02.954759 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:00:04.017221 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:04.017185 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:00:08.764086 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:08.764054 2573 generic.go:356] "Generic (PLEG): container finished" podID="6d6abec3-ac72-4097-8b42-16ded11667fa" containerID="baff11056950ae9cd89ef19c6d33d62d25d30e3f7879b62cb23402d6cdad1305" exitCode=0 Jun 09 20:00:08.764476 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:08.764143 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" event={"ID":"6d6abec3-ac72-4097-8b42-16ded11667fa","Type":"ContainerDied","Data":"baff11056950ae9cd89ef19c6d33d62d25d30e3f7879b62cb23402d6cdad1305"} Jun 09 20:00:13.800233 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:13.800197 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" event={"ID":"6d6abec3-ac72-4097-8b42-16ded11667fa","Type":"ContainerStarted","Data":"1c8c7d199ee781582d730790e1b536c7ea6575ae2619e3afa0798cd8df7b0998"} Jun 09 20:00:13.826237 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:13.826193 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" podStartSLOduration=2.3833917 podStartE2EDuration="1m3.826178064s" totalImagesPullingTime="7.997563726s" totalInitContainerRuntime="53.445222638s" isStatefulPod=false podCreationTimestamp="2026-06-09 19:59:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:00:13.823885862 +0000 UTC m=+999.062051475" watchObservedRunningTime="2026-06-09 20:00:13.826178064 +0000 UTC m=+999.064343722" Jun 09 20:00:21.207634 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:21.207594 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 20:00:21.208048 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:21.207658 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 20:00:21.220060 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:21.220035 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 20:00:21.853416 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:21.853387 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-ddpks" Jun 09 20:00:31.486378 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:31.486338 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:00:31.588327 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:31.588292 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:00:51.832072 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:51.832034 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:00:51.931231 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:51.931196 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:00:52.971691 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:52.971656 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:00:53.063927 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:00:53.063894 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:01:00.208828 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:01:00.208791 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:01:23.230740 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:01:23.230657 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:01:33.354018 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:01:33.353986 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:01:42.605058 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:01:42.605007 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:01:48.308911 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:01:48.308877 2573 generic.go:356] "Generic (PLEG): container finished" podID="edd96816-ef7d-481e-b361-9b4568d20a52" containerID="89e5d08622ead36b6d19a74ebe7c302e91a554ea23df751481929b67443b4095" exitCode=1 Jun 09 20:01:48.309372 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:01:48.308955 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerDied","Data":"89e5d08622ead36b6d19a74ebe7c302e91a554ea23df751481929b67443b4095"} Jun 09 20:01:48.309372 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:01:48.309021 2573 scope.go:117] "RemoveContainer" containerID="b8e6054f04dc7d4c5c65b69147a21a998b8fcbfcb71e90a5e5e4418ac4dfb327" Jun 09 20:01:48.309508 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:01:48.309372 2573 scope.go:117] "RemoveContainer" containerID="89e5d08622ead36b6d19a74ebe7c302e91a554ea23df751481929b67443b4095" Jun 09 20:01:48.309597 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:01:48.309574 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:01:49.664288 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:01:49.664254 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:01:49.664704 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:01:49.664587 2573 scope.go:117] "RemoveContainer" containerID="89e5d08622ead36b6d19a74ebe7c302e91a554ea23df751481929b67443b4095" Jun 09 20:01:49.664844 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:01:49.664823 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 10s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:01:52.497203 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:01:52.497169 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:02:00.130051 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:00.130008 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:02:00.231179 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:00.231121 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:02:00.256584 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:00.256559 2573 scope.go:117] "RemoveContainer" containerID="89e5d08622ead36b6d19a74ebe7c302e91a554ea23df751481929b67443b4095" Jun 09 20:02:00.380647 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:00.380568 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerStarted","Data":"d95d5f4694aa2ca4957c08ead961233f0fa25fd0ef8904b9394b685dc1f655dd"} Jun 09 20:02:00.380786 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:00.380767 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:02:02.296144 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:02.296094 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:02:11.389489 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:11.389460 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:02:11.806651 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:11.806573 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:02:19.651552 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:19.651514 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:02:21.670063 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:21.670023 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:02:21.797824 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:21.797793 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5fdf7b5b88-s6bxd"] Jun 09 20:02:21.801243 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:21.801228 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" Jun 09 20:02:21.807314 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:21.807287 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 09 20:02:21.807468 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:21.807328 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 09 20:02:21.807468 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:21.807397 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-92rjr\"" Jun 09 20:02:21.813146 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:21.813109 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fdf7b5b88-s6bxd"] Jun 09 20:02:21.971093 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:21.971003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjxp4\" (UniqueName: \"kubernetes.io/projected/aa1ce856-dedc-4a28-a192-64a3a80af112-kube-api-access-xjxp4\") pod \"maas-controller-5fdf7b5b88-s6bxd\" (UID: \"aa1ce856-dedc-4a28-a192-64a3a80af112\") " pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" Jun 09 20:02:21.971093 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:21.971052 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa1ce856-dedc-4a28-a192-64a3a80af112-webhook-cert\") pod \"maas-controller-5fdf7b5b88-s6bxd\" (UID: \"aa1ce856-dedc-4a28-a192-64a3a80af112\") " pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" Jun 09 20:02:22.071774 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:22.071738 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjxp4\" (UniqueName: \"kubernetes.io/projected/aa1ce856-dedc-4a28-a192-64a3a80af112-kube-api-access-xjxp4\") pod \"maas-controller-5fdf7b5b88-s6bxd\" (UID: \"aa1ce856-dedc-4a28-a192-64a3a80af112\") " pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" Jun 09 20:02:22.071959 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:22.071848 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa1ce856-dedc-4a28-a192-64a3a80af112-webhook-cert\") pod \"maas-controller-5fdf7b5b88-s6bxd\" (UID: \"aa1ce856-dedc-4a28-a192-64a3a80af112\") " pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" Jun 09 20:02:22.074378 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:22.074354 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/aa1ce856-dedc-4a28-a192-64a3a80af112-webhook-cert\") pod \"maas-controller-5fdf7b5b88-s6bxd\" (UID: \"aa1ce856-dedc-4a28-a192-64a3a80af112\") " pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" Jun 09 20:02:22.080205 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:22.080185 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjxp4\" (UniqueName: \"kubernetes.io/projected/aa1ce856-dedc-4a28-a192-64a3a80af112-kube-api-access-xjxp4\") pod \"maas-controller-5fdf7b5b88-s6bxd\" (UID: \"aa1ce856-dedc-4a28-a192-64a3a80af112\") " pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" Jun 09 20:02:22.111628 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:22.111601 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" Jun 09 20:02:22.242548 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:22.242517 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5fdf7b5b88-s6bxd"] Jun 09 20:02:22.243607 ip-10-0-140-8 kubenswrapper[2573]: W0609 20:02:22.243583 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa1ce856_dedc_4a28_a192_64a3a80af112.slice/crio-bdfdbd7d2ef40e6a5f94c988873f3839b0982d6aa0ac095e5a016bd675f64274 WatchSource:0}: Error finding container bdfdbd7d2ef40e6a5f94c988873f3839b0982d6aa0ac095e5a016bd675f64274: Status 404 returned error can't find the container with id bdfdbd7d2ef40e6a5f94c988873f3839b0982d6aa0ac095e5a016bd675f64274 Jun 09 20:02:22.244940 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:22.244924 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 20:02:22.504798 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:22.504705 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" event={"ID":"aa1ce856-dedc-4a28-a192-64a3a80af112","Type":"ContainerStarted","Data":"bdfdbd7d2ef40e6a5f94c988873f3839b0982d6aa0ac095e5a016bd675f64274"} Jun 09 20:02:23.511870 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:23.511830 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" event={"ID":"aa1ce856-dedc-4a28-a192-64a3a80af112","Type":"ContainerStarted","Data":"3fa96d9a077a2fab8b5cf31dc9cb3224c5fc45ee29a15c993db0d6bec03c9e5e"} Jun 09 20:02:23.512284 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:23.511922 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" Jun 09 20:02:23.530404 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:23.530260 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" podStartSLOduration=2.018050108 podStartE2EDuration="2.530242514s" totalImagesPullingTime="512.192406ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 20:02:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:02:23.529461481 +0000 UTC m=+1128.767627093" watchObservedRunningTime="2026-06-09 20:02:23.530242514 +0000 UTC m=+1128.768408125" Jun 09 20:02:34.522626 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:34.522591 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5fdf7b5b88-s6bxd" Jun 09 20:02:45.306724 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:45.306689 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:02:48.506011 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:48.505929 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:02:53.900089 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:53.900047 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:02:56.800591 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:02:56.800560 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:03:01.918405 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:03:01.918363 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:03:02.016517 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:03:02.016480 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:03:10.380409 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:03:10.380367 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:03:16.273820 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:03:16.273770 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:03:16.370892 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:03:16.370849 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:03:25.108064 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:03:25.108022 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:03:41.616573 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:03:41.616530 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:03:48.396329 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:03:48.396292 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:03:49.406307 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:03:49.406273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:01.043722 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:01.043688 2573 generic.go:356] "Generic (PLEG): container finished" podID="edd96816-ef7d-481e-b361-9b4568d20a52" containerID="d95d5f4694aa2ca4957c08ead961233f0fa25fd0ef8904b9394b685dc1f655dd" exitCode=1 Jun 09 20:04:01.044248 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:01.043722 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerDied","Data":"d95d5f4694aa2ca4957c08ead961233f0fa25fd0ef8904b9394b685dc1f655dd"} Jun 09 20:04:01.044248 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:01.043783 2573 scope.go:117] "RemoveContainer" containerID="89e5d08622ead36b6d19a74ebe7c302e91a554ea23df751481929b67443b4095" Jun 09 20:04:01.044248 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:01.044083 2573 scope.go:117] "RemoveContainer" containerID="d95d5f4694aa2ca4957c08ead961233f0fa25fd0ef8904b9394b685dc1f655dd" Jun 09 20:04:01.044436 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:04:01.044294 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:04:01.387554 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:01.387532 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:04:02.051392 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:02.051368 2573 scope.go:117] "RemoveContainer" containerID="d95d5f4694aa2ca4957c08ead961233f0fa25fd0ef8904b9394b685dc1f655dd" Jun 09 20:04:02.051858 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:04:02.051600 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:04:05.339318 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:05.339288 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:04:05.339693 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:05.339663 2573 scope.go:117] "RemoveContainer" containerID="d95d5f4694aa2ca4957c08ead961233f0fa25fd0ef8904b9394b685dc1f655dd" Jun 09 20:04:05.339853 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:04:05.339833 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:04:12.339890 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:12.339852 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:18.184717 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:18.184634 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:18.257028 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:18.257003 2573 scope.go:117] "RemoveContainer" containerID="d95d5f4694aa2ca4957c08ead961233f0fa25fd0ef8904b9394b685dc1f655dd" Jun 09 20:04:18.257221 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:04:18.257199 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:04:18.288979 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:18.288951 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:18.384921 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:18.384883 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:18.539011 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:18.538933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:18.638010 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:18.637978 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:19.503807 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:19.503766 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:04:33.256696 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:33.256666 2573 scope.go:117] "RemoveContainer" containerID="d95d5f4694aa2ca4957c08ead961233f0fa25fd0ef8904b9394b685dc1f655dd" Jun 09 20:04:34.227148 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:34.227095 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerStarted","Data":"9619f7cd45a64bdb5239b2b09f6058144aa9673533b7180a6cb1ae4d8b34d912"} Jun 09 20:04:34.233506 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:34.228335 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:04:35.052491 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:35.052450 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:35.158086 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:35.158050 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:35.263337 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:35.263306 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:35.787979 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:35.787932 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:38.400970 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:38.400932 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:04:40.965864 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:40.965825 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:41.066192 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:41.066156 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:45.234316 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:45.234282 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:04:49.164880 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:49.164841 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:49.264062 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:49.264014 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:49.363157 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:49.363111 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:49.475540 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:49.475454 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:04:50.604588 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:04:50.604558 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:05:06.114843 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:06.114807 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:06.246757 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:06.246706 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:06.366287 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:06.366190 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:07.006532 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:07.006499 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:05:08.199435 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:08.199407 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:05:12.165589 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:12.165546 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:12.225003 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:12.224966 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:32.716743 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:32.716713 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:32.815530 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:32.815492 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:32.913792 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:32.913756 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:38.440960 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:38.440926 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:38.564237 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:38.564203 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:38.724881 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:38.724796 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:38.862546 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:38.862504 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:44.522719 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:44.522680 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:44.621062 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:44.621027 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:05:45.500580 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:45.500550 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:05:48.507915 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:05:48.507876 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:06:10.801288 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:10.801254 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:06:20.195802 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:20.195768 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:06:33.872299 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:33.872267 2573 generic.go:356] "Generic (PLEG): container finished" podID="edd96816-ef7d-481e-b361-9b4568d20a52" containerID="9619f7cd45a64bdb5239b2b09f6058144aa9673533b7180a6cb1ae4d8b34d912" exitCode=1 Jun 09 20:06:33.872677 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:33.872347 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerDied","Data":"9619f7cd45a64bdb5239b2b09f6058144aa9673533b7180a6cb1ae4d8b34d912"} Jun 09 20:06:33.872677 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:33.872411 2573 scope.go:117] "RemoveContainer" containerID="d95d5f4694aa2ca4957c08ead961233f0fa25fd0ef8904b9394b685dc1f655dd" Jun 09 20:06:33.872780 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:33.872753 2573 scope.go:117] "RemoveContainer" containerID="9619f7cd45a64bdb5239b2b09f6058144aa9673533b7180a6cb1ae4d8b34d912" Jun 09 20:06:33.872969 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:06:33.872948 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:06:35.233359 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:35.233324 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:06:35.233762 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:35.233691 2573 scope.go:117] "RemoveContainer" containerID="9619f7cd45a64bdb5239b2b09f6058144aa9673533b7180a6cb1ae4d8b34d912" Jun 09 20:06:35.233943 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:06:35.233920 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:06:36.604872 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:36.604838 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:06:44.797473 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:44.797440 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:06:45.339166 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:45.339119 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:06:45.339488 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:45.339473 2573 scope.go:117] "RemoveContainer" containerID="9619f7cd45a64bdb5239b2b09f6058144aa9673533b7180a6cb1ae4d8b34d912" Jun 09 20:06:45.339656 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:06:45.339635 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:06:53.308381 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:53.308350 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:06:56.256484 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:06:56.256451 2573 scope.go:117] "RemoveContainer" containerID="9619f7cd45a64bdb5239b2b09f6058144aa9673533b7180a6cb1ae4d8b34d912" Jun 09 20:06:56.256872 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:06:56.256654 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:07:09.256785 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:07:09.256744 2573 scope.go:117] "RemoveContainer" containerID="9619f7cd45a64bdb5239b2b09f6058144aa9673533b7180a6cb1ae4d8b34d912" Jun 09 20:07:09.257213 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:07:09.256928 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 40s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:07:24.257016 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:07:24.256937 2573 scope.go:117] "RemoveContainer" containerID="9619f7cd45a64bdb5239b2b09f6058144aa9673533b7180a6cb1ae4d8b34d912" Jun 09 20:07:25.151974 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:07:25.151938 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerStarted","Data":"1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8"} Jun 09 20:07:25.152206 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:07:25.152186 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:07:36.159300 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:07:36.159272 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:07:38.199146 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:07:38.199099 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:07:47.707165 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:07:47.707115 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:07:55.901625 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:07:55.901589 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:08:19.237924 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:08:19.237892 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:08:19.325569 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:08:19.325537 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:08:26.435295 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:08:26.435261 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:08:27.805827 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:08:27.805796 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:08:35.903372 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:08:35.903331 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:08:38.608851 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:08:38.608821 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:08:45.595347 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:08:45.595314 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:08:53.098451 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:08:53.098418 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:09:01.509680 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:01.509640 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:09:01.512247 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:01.510964 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:09:10.000062 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:10.000029 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:09:13.200115 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:13.200076 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:09:18.701923 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:18.701891 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:09:24.801004 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:24.800967 2573 generic.go:356] "Generic (PLEG): container finished" podID="edd96816-ef7d-481e-b361-9b4568d20a52" containerID="1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8" exitCode=1 Jun 09 20:09:24.801451 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:24.801037 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerDied","Data":"1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8"} Jun 09 20:09:24.801451 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:24.801117 2573 scope.go:117] "RemoveContainer" containerID="9619f7cd45a64bdb5239b2b09f6058144aa9673533b7180a6cb1ae4d8b34d912" Jun 09 20:09:24.801451 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:24.801371 2573 scope.go:117] "RemoveContainer" containerID="1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8" Jun 09 20:09:24.801624 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:09:24.801602 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:09:25.340057 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:25.340030 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:09:25.807876 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:25.807853 2573 scope.go:117] "RemoveContainer" containerID="1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8" Jun 09 20:09:25.808283 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:09:25.808049 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:09:26.157899 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:26.157868 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:09:26.813493 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:26.813468 2573 scope.go:117] "RemoveContainer" containerID="1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8" Jun 09 20:09:26.813869 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:09:26.813692 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:09:27.697175 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:27.697116 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:09:41.257413 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:41.257381 2573 scope.go:117] "RemoveContainer" containerID="1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8" Jun 09 20:09:41.257839 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:09:41.257571 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:09:55.260051 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:09:55.260024 2573 scope.go:117] "RemoveContainer" containerID="1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8" Jun 09 20:09:55.260480 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:09:55.260227 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:10:05.602008 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:05.601973 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:10:07.256991 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:07.256954 2573 scope.go:117] "RemoveContainer" containerID="1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8" Jun 09 20:10:07.257611 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:10:07.257193 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:10:08.095560 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:08.095527 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-pczcq"] Jun 09 20:10:18.256767 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:18.256679 2573 scope.go:117] "RemoveContainer" containerID="1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8" Jun 09 20:10:18.257253 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:10:18.256882 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:10:27.875832 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:27.875801 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7568d8cfb9-84l8t_2f6694b6-9dae-4158-9e3f-3a6b7248f5f9/nginx/0.log" Jun 09 20:10:28.085043 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:28.085016 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-zjt8v_0515e67d-404a-4d19-be4d-570abcfd1564/manager/0.log" Jun 09 20:10:28.193089 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:28.193062 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-fjngp_ca0548aa-1127-42bf-aab4-a8e33b315805/manager/0.log" Jun 09 20:10:28.539171 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:28.539068 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5fdf7b5b88-s6bxd_aa1ce856-dedc-4a28-a192-64a3a80af112/manager/0.log" Jun 09 20:10:28.642918 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:28.642893 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-zwfs6_170cfd8a-4109-4ae3-ade7-54ab83aefcc8/server/0.log" Jun 09 20:10:28.753396 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:28.753371 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-qmmnl_64bbeaa0-21e6-4197-9527-446b5ad44b91/manager/0.log" Jun 09 20:10:29.080351 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:29.080319 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696b96fdb9-wnnrw_111ecf4b-3fca-4981-ba8c-da928688122b/copy-manifests/0.log" Jun 09 20:10:29.093162 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:29.093110 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696b96fdb9-wnnrw_111ecf4b-3fca-4981-ba8c-da928688122b/manager/0.log" Jun 09 20:10:29.932288 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:29.932259 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r_6c19535f-d2fc-489c-8967-fb37ec6e80b4/util/0.log" Jun 09 20:10:29.939095 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:29.939073 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r_6c19535f-d2fc-489c-8967-fb37ec6e80b4/pull/0.log" Jun 09 20:10:29.945796 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:29.945772 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r_6c19535f-d2fc-489c-8967-fb37ec6e80b4/extract/0.log" Jun 09 20:10:30.052114 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:30.052085 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz_5923d134-dc70-48f9-b273-f9321ddb2c66/pull/0.log" Jun 09 20:10:30.057557 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:30.057541 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz_5923d134-dc70-48f9-b273-f9321ddb2c66/extract/0.log" Jun 09 20:10:30.063074 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:30.063054 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz_5923d134-dc70-48f9-b273-f9321ddb2c66/util/0.log" Jun 09 20:10:30.166535 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:30.166504 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg_44eaa12e-d82c-4ee4-9050-ba2ad45c193f/util/0.log" Jun 09 20:10:30.172467 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:30.172443 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg_44eaa12e-d82c-4ee4-9050-ba2ad45c193f/pull/0.log" Jun 09 20:10:30.178056 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:30.178039 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg_44eaa12e-d82c-4ee4-9050-ba2ad45c193f/extract/0.log" Jun 09 20:10:30.284737 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:30.284654 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz_be406039-4815-46ae-aa57-34591a0bb199/extract/0.log" Jun 09 20:10:30.291453 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:30.291432 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz_be406039-4815-46ae-aa57-34591a0bb199/util/0.log" Jun 09 20:10:30.297205 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:30.297178 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz_be406039-4815-46ae-aa57-34591a0bb199/pull/0.log" Jun 09 20:10:30.841648 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:30.841621 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-p948w_0a3d1234-c74a-4ca1-8f3f-25e21d202bb6/registry-server/0.log" Jun 09 20:10:30.950954 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:30.950917 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bfhpj_597e3315-989d-458b-affd-cd47137fd3f7/manager/0.log" Jun 09 20:10:31.064036 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:31.064009 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pczcq_383f6ab9-8740-42ef-97c8-953253ebbbcb/limitador/0.log" Jun 09 20:10:31.612108 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:31.612078 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-t7pbg_969fcfa4-cc74-4209-827e-5a3c3aef9286/discovery/0.log" Jun 09 20:10:31.720953 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:31.720919 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d8c95444f-nh6wj_19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c/kube-auth-proxy/0.log" Jun 09 20:10:32.047008 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:32.046981 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4g4m7_0b665cc0-b1a8-4e73-a91e-367d594c4947/payload-pre-processing/0.log" Jun 09 20:10:32.151169 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:32.151120 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqbmc_edd96816-ef7d-481e-b361-9b4568d20a52/payload-processing/4.log" Jun 09 20:10:32.692340 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:32.692307 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-ddpks_6d6abec3-ac72-4097-8b42-16ded11667fa/storage-initializer/0.log" Jun 09 20:10:32.698790 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:32.698772 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-ddpks_6d6abec3-ac72-4097-8b42-16ded11667fa/main/0.log" Jun 09 20:10:32.915365 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:32.915335 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx_eb984f59-d415-47c2-b103-6820a3f8e670/main/0.log" Jun 09 20:10:32.922245 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:32.922224 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477c8pshx_eb984f59-d415-47c2-b103-6820a3f8e670/storage-initializer/0.log" Jun 09 20:10:33.257138 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:33.257110 2573 scope.go:117] "RemoveContainer" containerID="1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8" Jun 09 20:10:33.257401 ip-10-0-140-8 kubenswrapper[2573]: E0609 20:10:33.257377 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"payload-processing\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=payload-processing pod=payload-processing-7c6c859784-fqbmc_openshift-ingress(edd96816-ef7d-481e-b361-9b4568d20a52)\"" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" podUID="edd96816-ef7d-481e-b361-9b4568d20a52" Jun 09 20:10:37.454537 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:37.454493 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:10:37.512962 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:37.512921 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" limit=1024 Jun 09 20:10:40.377193 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:40.377149 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9phnt_d5a3d736-aaad-4c34-b800-4d9d6579adaf/global-pull-secret-syncer/0.log" Jun 09 20:10:40.537541 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:40.537497 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2d4sj_acc1d971-051b-4cf1-ac84-768d60732d3c/konnectivity-agent/0.log" Jun 09 20:10:40.704435 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:40.704403 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-8.ec2.internal_98bac051df6d1eb92d9dcd6f09edbb90/haproxy/0.log" Jun 09 20:10:44.742587 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:44.742557 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-5h84r_a835446b-04ef-47ab-ac8c-385769d5447f/sail-operator/0.log" Jun 09 20:10:45.377433 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.377409 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r_6c19535f-d2fc-489c-8967-fb37ec6e80b4/extract/0.log" Jun 09 20:10:45.398835 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.398814 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r_6c19535f-d2fc-489c-8967-fb37ec6e80b4/util/0.log" Jun 09 20:10:45.418806 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.418777 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759gzd7r_6c19535f-d2fc-489c-8967-fb37ec6e80b4/pull/0.log" Jun 09 20:10:45.462931 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.462906 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz_5923d134-dc70-48f9-b273-f9321ddb2c66/extract/0.log" Jun 09 20:10:45.487066 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.487046 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz_5923d134-dc70-48f9-b273-f9321ddb2c66/util/0.log" Jun 09 20:10:45.508426 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.508402 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sdcwz_5923d134-dc70-48f9-b273-f9321ddb2c66/pull/0.log" Jun 09 20:10:45.537575 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.537552 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg_44eaa12e-d82c-4ee4-9050-ba2ad45c193f/extract/0.log" Jun 09 20:10:45.567926 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.567899 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg_44eaa12e-d82c-4ee4-9050-ba2ad45c193f/util/0.log" Jun 09 20:10:45.594638 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.594613 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73vkgpg_44eaa12e-d82c-4ee4-9050-ba2ad45c193f/pull/0.log" Jun 09 20:10:45.627306 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.627284 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz_be406039-4815-46ae-aa57-34591a0bb199/extract/0.log" Jun 09 20:10:45.654011 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.653990 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz_be406039-4815-46ae-aa57-34591a0bb199/util/0.log" Jun 09 20:10:45.678864 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.678842 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1hjkqz_be406039-4815-46ae-aa57-34591a0bb199/pull/0.log" Jun 09 20:10:45.927817 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.927739 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-p948w_0a3d1234-c74a-4ca1-8f3f-25e21d202bb6/registry-server/0.log" Jun 09 20:10:45.980813 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:45.980785 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-bfhpj_597e3315-989d-458b-affd-cd47137fd3f7/manager/0.log" Jun 09 20:10:46.001477 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:46.001451 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-pczcq_383f6ab9-8740-42ef-97c8-953253ebbbcb/limitador/0.log" Jun 09 20:10:46.256941 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:46.256865 2573 scope.go:117] "RemoveContainer" containerID="1c6f2b90687c0b62a2b09639e10e3364dc7c151b37683978c41843f71b7c1aa8" Jun 09 20:10:47.249606 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.249566 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" event={"ID":"edd96816-ef7d-481e-b361-9b4568d20a52","Type":"ContainerStarted","Data":"66f464c8b71af99f5ee735456096b8163aef721d94de9d2b8db9e50c16e12e7a"} Jun 09 20:10:47.250001 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.249814 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:10:47.606283 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.606206 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46813f9f-07bc-4f94-a64a-38d94c5822f4/alertmanager/0.log" Jun 09 20:10:47.635574 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.635548 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46813f9f-07bc-4f94-a64a-38d94c5822f4/config-reloader/0.log" Jun 09 20:10:47.660149 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.660116 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46813f9f-07bc-4f94-a64a-38d94c5822f4/kube-rbac-proxy-web/0.log" Jun 09 20:10:47.682080 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.682057 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46813f9f-07bc-4f94-a64a-38d94c5822f4/kube-rbac-proxy/0.log" Jun 09 20:10:47.706326 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.706279 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46813f9f-07bc-4f94-a64a-38d94c5822f4/kube-rbac-proxy-metric/0.log" Jun 09 20:10:47.732380 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.732356 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46813f9f-07bc-4f94-a64a-38d94c5822f4/prom-label-proxy/0.log" Jun 09 20:10:47.757301 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.757262 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_46813f9f-07bc-4f94-a64a-38d94c5822f4/init-config-reloader/0.log" Jun 09 20:10:47.928696 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.928663 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-qzmf7_f9b86e87-1b7d-4e25-8906-aa20b477c1f6/monitoring-plugin/0.log" Jun 09 20:10:47.978939 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.978895 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcp78_70a340bf-36f5-4424-adfa-b956495e2956/node-exporter/0.log" Jun 09 20:10:47.997796 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:47.997773 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcp78_70a340bf-36f5-4424-adfa-b956495e2956/kube-rbac-proxy/0.log" Jun 09 20:10:48.024536 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:48.024508 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kcp78_70a340bf-36f5-4424-adfa-b956495e2956/init-textfile/0.log" Jun 09 20:10:48.735746 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:48.735716 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7b8846d6-f4bxq_3b1675bd-6c0c-47df-b1ca-4f03ac920673/thanos-query/0.log" Jun 09 20:10:48.766700 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:48.766667 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7b8846d6-f4bxq_3b1675bd-6c0c-47df-b1ca-4f03ac920673/kube-rbac-proxy-web/0.log" Jun 09 20:10:48.787335 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:48.787314 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7b8846d6-f4bxq_3b1675bd-6c0c-47df-b1ca-4f03ac920673/kube-rbac-proxy/0.log" Jun 09 20:10:48.810893 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:48.810873 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7b8846d6-f4bxq_3b1675bd-6c0c-47df-b1ca-4f03ac920673/prom-label-proxy/0.log" Jun 09 20:10:48.832908 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:48.832882 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7b8846d6-f4bxq_3b1675bd-6c0c-47df-b1ca-4f03ac920673/kube-rbac-proxy-rules/0.log" Jun 09 20:10:48.854010 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:48.853987 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6c7b8846d6-f4bxq_3b1675bd-6c0c-47df-b1ca-4f03ac920673/kube-rbac-proxy-metrics/0.log" Jun 09 20:10:51.251392 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.251360 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26"] Jun 09 20:10:51.254996 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.254979 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.257822 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.257803 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jlbvb\"/\"openshift-service-ca.crt\"" Jun 09 20:10:51.258893 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.258872 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jlbvb\"/\"default-dockercfg-9ln6w\"" Jun 09 20:10:51.258893 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.258883 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jlbvb\"/\"kube-root-ca.crt\"" Jun 09 20:10:51.267585 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.267563 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26"] Jun 09 20:10:51.375902 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.375864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-sys\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.376085 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.375919 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-lib-modules\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.376085 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.376003 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-proc\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.376190 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.376098 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxgrj\" (UniqueName: \"kubernetes.io/projected/2cef546c-df18-4a1f-a508-303b317d6a59-kube-api-access-mxgrj\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.376190 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.376176 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-podres\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.385037 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.385020 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-858c698c98-tvnwr_0bab3dd5-9f26-452a-8379-570cd570523b/console/0.log" Jun 09 20:10:51.476915 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.476889 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-sys\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.477052 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.476926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-lib-modules\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.477052 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.476966 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-proc\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.477052 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.477011 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-sys\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.477187 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.477055 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxgrj\" (UniqueName: \"kubernetes.io/projected/2cef546c-df18-4a1f-a508-303b317d6a59-kube-api-access-mxgrj\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.477187 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.477062 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-proc\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.477187 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.477066 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-lib-modules\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.477187 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.477089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-podres\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.477316 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.477217 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2cef546c-df18-4a1f-a508-303b317d6a59-podres\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.485569 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.485543 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxgrj\" (UniqueName: \"kubernetes.io/projected/2cef546c-df18-4a1f-a508-303b317d6a59-kube-api-access-mxgrj\") pod \"perf-node-gather-daemonset-tlr26\" (UID: \"2cef546c-df18-4a1f-a508-303b317d6a59\") " pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.566018 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.565956 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:51.695631 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:51.695598 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26"] Jun 09 20:10:51.696362 ip-10-0-140-8 kubenswrapper[2573]: W0609 20:10:51.696331 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2cef546c_df18_4a1f_a508_303b317d6a59.slice/crio-4401e4a7223da06e0384694c35c7c53c0def28efcd1c96952727b518f0227697 WatchSource:0}: Error finding container 4401e4a7223da06e0384694c35c7c53c0def28efcd1c96952727b518f0227697: Status 404 returned error can't find the container with id 4401e4a7223da06e0384694c35c7c53c0def28efcd1c96952727b518f0227697 Jun 09 20:10:52.277455 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:52.277420 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" event={"ID":"2cef546c-df18-4a1f-a508-303b317d6a59","Type":"ContainerStarted","Data":"6f52cbf76045deac3ccae0825f0d1b91f546ad0a66f3f5b1828ad4074fbb2f0a"} Jun 09 20:10:52.277836 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:52.277473 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" event={"ID":"2cef546c-df18-4a1f-a508-303b317d6a59","Type":"ContainerStarted","Data":"4401e4a7223da06e0384694c35c7c53c0def28efcd1c96952727b518f0227697"} Jun 09 20:10:52.277836 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:52.277499 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:52.293234 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:52.293189 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" podStartSLOduration=1.293174912 podStartE2EDuration="1.293174912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 20:10:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 20:10:52.292102625 +0000 UTC m=+1637.530268238" watchObservedRunningTime="2026-06-09 20:10:52.293174912 +0000 UTC m=+1637.531340522" Jun 09 20:10:53.152357 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:53.152325 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hwhdb_05b48888-07bb-43ac-a02e-87c8e52020d5/dns/0.log" Jun 09 20:10:53.175005 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:53.174981 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hwhdb_05b48888-07bb-43ac-a02e-87c8e52020d5/kube-rbac-proxy/0.log" Jun 09 20:10:53.282342 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:53.282314 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-xpmj4_da2dc5fe-acfa-4eb4-81bb-fd5e8f01ee2a/dns-node-resolver/0.log" Jun 09 20:10:53.831088 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:53.831057 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bvf2b_f8c2937d-ae68-425d-a9b2-7d2970afbcbf/node-ca/0.log" Jun 09 20:10:54.838370 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:54.838343 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-t7pbg_969fcfa4-cc74-4209-827e-5a3c3aef9286/discovery/0.log" Jun 09 20:10:54.865122 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:54.865098 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d8c95444f-nh6wj_19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c/kube-auth-proxy/0.log" Jun 09 20:10:54.976302 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:54.976278 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4g4m7_0b665cc0-b1a8-4e73-a91e-367d594c4947/payload-pre-processing/0.log" Jun 09 20:10:54.995345 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:54.995322 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqbmc_edd96816-ef7d-481e-b361-9b4568d20a52/payload-processing/5.log" Jun 09 20:10:54.997466 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:54.997447 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqbmc_edd96816-ef7d-481e-b361-9b4568d20a52/payload-processing/4.log" Jun 09 20:10:55.598523 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:55.598486 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fmtbl_74d2baf0-98cd-4c3e-a79a-a63b8db23646/serve-healthcheck-canary/0.log" Jun 09 20:10:56.152986 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:56.152963 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57hwp_f9bc14ef-85cb-410a-8eb8-7d1076d594c9/kube-rbac-proxy/0.log" Jun 09 20:10:56.173071 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:56.173039 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57hwp_f9bc14ef-85cb-410a-8eb8-7d1076d594c9/exporter/0.log" Jun 09 20:10:56.191917 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:56.191898 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57hwp_f9bc14ef-85cb-410a-8eb8-7d1076d594c9/extractor/0.log" Jun 09 20:10:58.256684 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:58.256656 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-fqbmc" Jun 09 20:10:58.293896 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:58.293868 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jlbvb/perf-node-gather-daemonset-tlr26" Jun 09 20:10:58.474056 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:58.474027 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7568d8cfb9-84l8t_2f6694b6-9dae-4158-9e3f-3a6b7248f5f9/nginx/0.log" Jun 09 20:10:58.531308 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:58.531227 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-zjt8v_0515e67d-404a-4d19-be4d-570abcfd1564/manager/0.log" Jun 09 20:10:58.578597 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:58.578571 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-fjngp_ca0548aa-1127-42bf-aab4-a8e33b315805/manager/0.log" Jun 09 20:10:58.661862 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:58.661832 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-5fdf7b5b88-s6bxd_aa1ce856-dedc-4a28-a192-64a3a80af112/manager/0.log" Jun 09 20:10:58.681266 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:58.681244 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-zwfs6_170cfd8a-4109-4ae3-ade7-54ab83aefcc8/server/0.log" Jun 09 20:10:58.727865 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:58.727840 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-qmmnl_64bbeaa0-21e6-4197-9527-446b5ad44b91/manager/0.log" Jun 09 20:10:58.872549 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:58.872455 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696b96fdb9-wnnrw_111ecf4b-3fca-4981-ba8c-da928688122b/manager/0.log" Jun 09 20:10:58.888227 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:10:58.888202 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-696b96fdb9-wnnrw_111ecf4b-3fca-4981-ba8c-da928688122b/copy-manifests/0.log" Jun 09 20:11:00.622442 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:00.622414 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-fc8c5_19b7d5b1-388d-4ef6-94c8-350886d5b10b/openshift-lws-operator/0.log" Jun 09 20:11:05.186935 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:05.186906 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-t7pbg_969fcfa4-cc74-4209-827e-5a3c3aef9286/discovery/0.log" Jun 09 20:11:05.196712 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:05.196691 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d8c95444f-nh6wj_19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c/kube-auth-proxy/0.log" Jun 09 20:11:05.288044 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:05.288017 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4g4m7_0b665cc0-b1a8-4e73-a91e-367d594c4947/payload-pre-processing/0.log" Jun 09 20:11:05.299709 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:05.299683 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqbmc_edd96816-ef7d-481e-b361-9b4568d20a52/payload-processing/5.log" Jun 09 20:11:05.301628 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:05.301610 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqbmc_edd96816-ef7d-481e-b361-9b4568d20a52/payload-processing/4.log" Jun 09 20:11:06.436857 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:06.436827 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-t7pbg_969fcfa4-cc74-4209-827e-5a3c3aef9286/discovery/0.log" Jun 09 20:11:06.450237 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:06.450217 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d8c95444f-nh6wj_19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c/kube-auth-proxy/0.log" Jun 09 20:11:06.551357 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:06.551327 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4g4m7_0b665cc0-b1a8-4e73-a91e-367d594c4947/payload-pre-processing/0.log" Jun 09 20:11:06.563637 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:06.563613 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqbmc_edd96816-ef7d-481e-b361-9b4568d20a52/payload-processing/5.log" Jun 09 20:11:06.565467 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:06.565438 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqbmc_edd96816-ef7d-481e-b361-9b4568d20a52/payload-processing/4.log" Jun 09 20:11:07.445663 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:07.445633 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sprsl_65742759-dc96-475d-aebd-9b748549a587/kube-multus-additional-cni-plugins/0.log" Jun 09 20:11:07.466813 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:07.466787 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sprsl_65742759-dc96-475d-aebd-9b748549a587/egress-router-binary-copy/0.log" Jun 09 20:11:07.486347 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:07.486325 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sprsl_65742759-dc96-475d-aebd-9b748549a587/cni-plugins/0.log" Jun 09 20:11:07.507430 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:07.507403 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sprsl_65742759-dc96-475d-aebd-9b748549a587/bond-cni-plugin/0.log" Jun 09 20:11:07.526529 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:07.526508 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sprsl_65742759-dc96-475d-aebd-9b748549a587/routeoverride-cni/0.log" Jun 09 20:11:07.549517 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:07.549499 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sprsl_65742759-dc96-475d-aebd-9b748549a587/whereabouts-cni-bincopy/0.log" Jun 09 20:11:07.568913 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:07.568851 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sprsl_65742759-dc96-475d-aebd-9b748549a587/whereabouts-cni/0.log" Jun 09 20:11:07.753503 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:07.753473 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pfptq_41b5cd67-f64b-45b1-94c1-0f253e1ac8f1/kube-multus/0.log" Jun 09 20:11:07.818243 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:07.818217 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-74jvx_70cf497e-8c3e-4fb1-8981-cb9754626d08/network-metrics-daemon/0.log" Jun 09 20:11:07.836938 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:07.836859 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-74jvx_70cf497e-8c3e-4fb1-8981-cb9754626d08/kube-rbac-proxy/0.log" Jun 09 20:11:08.185838 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:08.185808 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-t7pbg_969fcfa4-cc74-4209-827e-5a3c3aef9286/discovery/0.log" Jun 09 20:11:08.194957 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:08.194938 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7d8c95444f-nh6wj_19a5ecbf-1a4b-46c4-a4c7-8a76ab5b8d9c/kube-auth-proxy/0.log" Jun 09 20:11:08.279642 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:08.279615 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-4g4m7_0b665cc0-b1a8-4e73-a91e-367d594c4947/payload-pre-processing/0.log" Jun 09 20:11:08.290211 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:08.290167 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqbmc_edd96816-ef7d-481e-b361-9b4568d20a52/payload-processing/5.log" Jun 09 20:11:08.292960 ip-10-0-140-8 kubenswrapper[2573]: I0609 20:11:08.292936 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-fqbmc_edd96816-ef7d-481e-b361-9b4568d20a52/payload-processing/4.log"