Jun 11 21:09:44.553425 ip-10-0-129-28 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 11 21:09:44.553440 ip-10-0-129-28 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 11 21:09:44.553450 ip-10-0-129-28 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 11 21:09:44.553809 ip-10-0-129-28 systemd[1]: Failed to start Kubernetes Kubelet. Jun 11 21:09:54.271527 ip-10-0-129-28 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 11 21:09:54.271543 ip-10-0-129-28 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 444a3afb700843c9b7a6493685533d84 -- Jun 11 21:12:02.791865 ip-10-0-129-28 systemd[1]: Starting Kubernetes Kubelet... Jun 11 21:12:03.246436 ip-10-0-129-28 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:12:03.246436 ip-10-0-129-28 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 21:12:03.246436 ip-10-0-129-28 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:12:03.246436 ip-10-0-129-28 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 21:12:03.246436 ip-10-0-129-28 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 21:12:03.247468 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.247290 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 21:12:03.253200 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253185 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:12:03.253200 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253199 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:12:03.253200 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253203 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253206 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253209 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253213 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253217 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253220 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253224 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253228 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253231 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253234 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253237 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253240 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253243 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253246 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253248 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253251 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253254 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253257 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253259 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253262 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:12:03.253292 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253265 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253268 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253270 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253273 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253275 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253278 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253281 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253283 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253286 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253288 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253291 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253293 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253296 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253299 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253302 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253306 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253309 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253311 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253314 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:12:03.253797 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253316 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253319 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253321 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253323 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253326 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253328 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253331 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253334 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253337 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253339 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253341 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253344 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253347 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253349 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253351 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253355 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253357 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253360 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253363 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253365 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:12:03.254259 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253368 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253371 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253373 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253376 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253378 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253381 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253383 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253386 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253388 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253391 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253394 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253396 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253399 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253402 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253405 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253408 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253410 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253413 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253417 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253420 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:12:03.254757 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253434 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253437 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253440 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253444 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253447 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253450 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253452 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253457 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253459 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253462 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253465 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253468 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253470 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253473 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253476 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253479 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253493 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.253496 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254194 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:12:03.255228 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254201 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254204 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254208 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254211 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254214 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254217 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254220 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254222 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254225 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254229 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254233 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254235 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254238 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254241 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254243 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254246 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254248 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254251 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254253 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254256 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:12:03.255708 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254259 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254262 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254265 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254268 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254271 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254273 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254276 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254278 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254281 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254284 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254286 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254288 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254291 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254293 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254296 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254299 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254302 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254304 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254307 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:12:03.256199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254309 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254312 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254315 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254317 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254320 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254322 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254325 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254327 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254330 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254332 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254335 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254337 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254341 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254344 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254346 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254349 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254351 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254354 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254359 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254362 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:12:03.256703 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254365 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254368 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254371 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254373 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254376 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254379 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254381 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254384 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254386 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254389 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254395 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254399 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254401 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254404 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254407 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254409 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254412 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254414 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254417 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254419 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:12:03.257185 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254422 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254424 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254427 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254430 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254433 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254435 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254438 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254440 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254443 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254446 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254448 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254451 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254455 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254458 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254461 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254464 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254467 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254470 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254472 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:12:03.257692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254821 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254826 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254829 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254832 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254834 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254837 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254841 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254843 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254846 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254849 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254851 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254855 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254857 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254860 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254863 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254865 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254868 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254870 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254873 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254875 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:12:03.258190 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254878 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254880 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254883 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254886 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254888 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254890 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254893 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254895 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254898 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254900 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254903 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254905 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254907 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254910 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254912 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254915 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254918 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254920 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254923 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:12:03.258687 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254926 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254928 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254931 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254935 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254939 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254942 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254945 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254947 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254950 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254952 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254955 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254958 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254962 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254965 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254968 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254971 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254974 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254977 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254979 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:12:03.259175 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254982 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254985 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254987 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254990 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254992 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254995 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.254998 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255001 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255004 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255007 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255010 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255013 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255015 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255018 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255020 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255023 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255025 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255028 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255031 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255034 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:12:03.259649 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255036 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255039 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255042 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255045 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255047 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255049 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255052 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255054 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255056 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255059 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255061 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255064 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255066 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255069 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255071 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255073 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255076 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255079 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255081 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255084 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:12:03.260168 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255086 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255153 2573 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255163 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255169 2573 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255173 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255177 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255180 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255184 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255188 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255191 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255195 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255198 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255201 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255204 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255207 2573 flags.go:64] FLAG: --cgroup-root="" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255210 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255213 2573 flags.go:64] FLAG: --client-ca-file="" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255215 2573 flags.go:64] FLAG: --cloud-provider="external" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255218 2573 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255222 2573 flags.go:64] FLAG: --cluster-domain="" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255224 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255230 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255233 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255237 2573 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 21:12:03.260725 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255240 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255243 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255246 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255249 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255252 2573 flags.go:64] FLAG: --contention-profiling="false" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255255 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255258 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255261 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255264 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255268 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255271 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255274 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255276 2573 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255280 2573 flags.go:64] FLAG: --enable-server="true" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255283 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255287 2573 flags.go:64] FLAG: --event-burst="100" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255290 2573 flags.go:64] FLAG: --event-qps="50" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255296 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255298 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255301 2573 flags.go:64] FLAG: --eviction-hard="" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255305 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255309 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255312 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255314 2573 flags.go:64] FLAG: --eviction-soft="" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255317 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 21:12:03.261692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255320 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255323 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255326 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255328 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255336 2573 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255339 2573 flags.go:64] FLAG: --feature-gates="" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255343 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255346 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255349 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255352 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255355 2573 flags.go:64] FLAG: --healthz-port="10248" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255358 2573 flags.go:64] FLAG: --help="false" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255361 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255364 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255367 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255369 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255373 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255376 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255379 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255381 2573 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255384 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255388 2573 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255391 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255394 2573 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 21:12:03.262311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255398 2573 flags.go:64] FLAG: --kube-reserved="" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255401 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255404 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255407 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255410 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255413 2573 flags.go:64] FLAG: --lock-file="" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255415 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255418 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255421 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255427 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255429 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255432 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255436 2573 flags.go:64] FLAG: --logging-format="text" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255439 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255442 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255445 2573 flags.go:64] FLAG: --manifest-url="" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255448 2573 flags.go:64] FLAG: --manifest-url-header="" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255451 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255454 2573 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255458 2573 flags.go:64] FLAG: --max-pods="110" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255461 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255464 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255466 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255469 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255472 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 21:12:03.263000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255475 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255478 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255497 2573 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255500 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255503 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255507 2573 flags.go:64] FLAG: --pod-cidr="" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255510 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255514 2573 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255519 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255522 2573 flags.go:64] FLAG: --pods-per-core="0" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255525 2573 flags.go:64] FLAG: --port="10250" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255528 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255531 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09e9d670c14fe7cfe" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255534 2573 flags.go:64] FLAG: --qos-reserved="" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255537 2573 flags.go:64] FLAG: --read-only-port="10255" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255540 2573 flags.go:64] FLAG: --register-node="true" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255542 2573 flags.go:64] FLAG: --register-with-taints="" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255547 2573 flags.go:64] FLAG: --registry-burst="10" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255549 2573 flags.go:64] FLAG: --registry-qps="5" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255554 2573 flags.go:64] FLAG: --reserved-cpus="" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255556 2573 flags.go:64] FLAG: --reserved-memory="" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255560 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255563 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255566 2573 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255568 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 21:12:03.263664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255571 2573 flags.go:64] FLAG: --runonce="false" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255574 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255577 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255580 2573 flags.go:64] FLAG: --seccomp-default="false" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255583 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255585 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255588 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255591 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255594 2573 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255596 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255599 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255602 2573 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255605 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255608 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255611 2573 flags.go:64] FLAG: --system-cgroups="" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255614 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255620 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255622 2573 flags.go:64] FLAG: --tls-cert-file="" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255625 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255628 2573 flags.go:64] FLAG: --tls-min-version="" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255631 2573 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255634 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255636 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255639 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255642 2573 flags.go:64] FLAG: --v="2" Jun 11 21:12:03.264273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255645 2573 flags.go:64] FLAG: --version="false" Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255651 2573 flags.go:64] FLAG: --vmodule="" Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255655 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.255658 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255768 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255772 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255775 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255779 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255782 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255784 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255787 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255789 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255792 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255794 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255797 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255800 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255802 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255805 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255807 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255810 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:12:03.264886 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255812 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255819 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255823 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255826 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255828 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255831 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255833 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255836 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255838 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255841 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255843 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255846 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255848 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255852 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255855 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255857 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255861 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255866 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255870 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:12:03.265367 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255873 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255876 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255879 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255882 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255884 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255887 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255889 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255892 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255894 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255897 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255899 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255902 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255904 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255907 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255909 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255914 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255916 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255919 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255922 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255925 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:12:03.266023 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255927 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255929 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255932 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255935 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255938 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255940 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255944 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255946 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255949 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255953 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255956 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255959 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255962 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255965 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255968 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255970 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255973 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255975 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255978 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:12:03.266521 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255980 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255983 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255986 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255988 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255990 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255993 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255996 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.255998 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256002 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256005 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256008 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256010 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256013 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256015 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256018 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256020 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256023 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256026 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256028 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256033 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:12:03.266977 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256035 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256038 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256040 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256043 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.256046 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.256820 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.264374 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.264389 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.264402 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.264408 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264463 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264469 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264473 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264477 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:12:03.267457 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264498 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264504 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264507 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264511 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264514 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264517 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264520 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264523 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264526 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264528 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264531 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264534 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264536 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264539 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264541 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264544 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264546 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264549 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264551 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264554 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:12:03.267827 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264557 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264560 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264562 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264565 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264568 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264572 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264575 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264577 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264580 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264583 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264586 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264588 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264591 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264593 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264596 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264598 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264601 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264603 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264606 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264608 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:12:03.268306 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264611 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264614 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264616 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264619 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264621 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264624 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264627 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264629 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264632 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264634 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264637 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264640 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264642 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264645 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264648 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264651 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264653 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264656 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264659 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264662 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:12:03.268853 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264664 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264666 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264669 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264671 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264674 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264676 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264679 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264681 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264684 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264686 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264689 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264692 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264694 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264696 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264699 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264702 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264705 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264709 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264712 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:12:03.269327 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264715 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264718 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264721 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264723 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264726 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264728 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264731 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264734 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264736 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264739 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264742 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264744 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264747 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264749 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264752 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:12:03.269932 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264755 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.264760 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264865 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264870 2573 feature_gate.go:328] unrecognized feature gate: Example Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264873 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264876 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264878 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264881 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264884 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264886 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264889 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264892 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264894 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264897 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264901 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 21:12:03.270284 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264904 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264906 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264909 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264913 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264917 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264920 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264922 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264925 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264928 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264931 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264934 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264937 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264940 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264943 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264946 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264949 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264952 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264954 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264957 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 21:12:03.270663 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264959 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264962 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264965 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264967 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264970 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264972 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264975 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264977 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264980 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264982 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264985 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264988 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264991 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264995 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.264997 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265000 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265003 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265005 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265008 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265010 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 21:12:03.271113 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265012 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265015 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265018 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265020 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265023 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265026 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265028 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265031 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265033 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265036 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265039 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265041 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265044 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265046 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265049 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265051 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265054 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265058 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265061 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265082 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 21:12:03.271602 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265085 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265088 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265091 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265094 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265097 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265099 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265102 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265105 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265108 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265110 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265113 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265115 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265118 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265120 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265123 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265125 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265128 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265131 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265133 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 21:12:03.272090 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265136 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265138 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265141 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265145 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265148 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265151 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265153 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:03.265155 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.265160 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.265263 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.268439 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.270170 2573 server.go:1019] "Starting client certificate rotation" Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.270271 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:12:03.272563 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.270306 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 21:12:03.272898 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.272885 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:12:03.274078 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.274063 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 21:12:03.284111 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.284096 2573 log.go:25] "Validated CRI v1 runtime API" Jun 11 21:12:03.287875 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.287860 2573 log.go:25] "Validated CRI v1 image API" Jun 11 21:12:03.288721 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.288708 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 21:12:03.291652 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.291631 2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b37ab491-b541-439b-aa0a-fa55ec6aa851:/dev/nvme0n1p4 ec062713-8f02-41d6-a3bc-57237715d70d:/dev/nvme0n1p3] Jun 11 21:12:03.291714 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.291649 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 21:12:03.298167 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.298056 2573 manager.go:216] Machine: {Timestamp:2026-06-11 21:12:03.296467701 +0000 UTC m=+0.368526674 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100439 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e74b00ec4af3087283b46d837ed22 SystemUUID:ec2e74b0-0ec4-af30-8728-3b46d837ed22 BootID:444a3afb-7008-43c9-b7a6-493685533d84 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3c:f2:9a:ce:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3c:f2:9a:ce:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2a:11:7e:67:eb:a0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 21:12:03.298167 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.298156 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 21:12:03.298311 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.298253 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 21:12:03.299162 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.299147 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:12:03.300270 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.300246 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 21:12:03.300396 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.300274 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-28.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 21:12:03.301081 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.301070 2573 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 21:12:03.301116 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.301083 2573 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 21:12:03.301116 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.301091 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:12:03.301116 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.301105 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 21:12:03.302940 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.302929 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 21:12:03.307555 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.307544 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:12:03.307658 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.307649 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 21:12:03.307699 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.307678 2573 kubelet.go:486] "Attempting to sync node with API server" Jun 11 21:12:03.307699 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.307687 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 21:12:03.307761 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.307702 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 21:12:03.307761 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.307711 2573 kubelet.go:398] "Adding apiserver pod source" Jun 11 21:12:03.307761 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.307719 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 21:12:03.308040 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.308027 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:12:03.308073 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.308054 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 21:12:03.310440 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.310423 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 21:12:03.312134 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.312121 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 21:12:03.312193 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.312151 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 21:12:03.312309 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.312299 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 21:12:03.312348 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.312314 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 21:12:03.312348 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.312320 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 21:12:03.312348 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.312325 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 21:12:03.312348 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.312333 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 21:12:03.312348 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.312339 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 21:12:03.313062 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.313051 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 21:12:03.313062 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.313061 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 21:12:03.313164 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.313067 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 21:12:03.313164 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.313074 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 21:12:03.313164 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.313082 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 21:12:03.313164 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.313090 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 21:12:03.314834 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.314823 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 21:12:03.314834 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.314835 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 21:12:03.317644 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.317631 2573 server.go:1268] "Started kubelet" Jun 11 21:12:03.317743 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.317694 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 21:12:03.317900 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.317865 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 21:12:03.317953 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.317920 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 21:12:03.318591 ip-10-0-129-28 systemd[1]: Started Kubernetes Kubelet. Jun 11 21:12:03.319018 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.318663 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-28.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 21:12:03.319018 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.318700 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 21:12:03.319018 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.318731 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 21:12:03.319954 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.319937 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 21:12:03.320423 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.320410 2573 server.go:310] "Adding debug handlers to kubelet server" Jun 11 21:12:03.324148 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.324117 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 21:12:03.325747 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.324609 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-28.ec2.internal.18b8232bb8e4eb49 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-28.ec2.internal,UID:ip-10-0-129-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-28.ec2.internal,},FirstTimestamp:2026-06-11 21:12:03.317607241 +0000 UTC m=+0.389666214,LastTimestamp:2026-06-11 21:12:03.317607241 +0000 UTC m=+0.389666214,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-28.ec2.internal,}" Jun 11 21:12:03.326249 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.326228 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 21:12:03.326249 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.326242 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 21:12:03.326498 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.326468 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:03.326972 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.326959 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 21:12:03.327076 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.327058 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 21:12:03.327191 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.326961 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 21:12:03.327191 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.326961 2573 factory.go:55] Registering systemd factory Jun 11 21:12:03.327191 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.327144 2573 factory.go:223] Registration of the systemd container factory successfully Jun 11 21:12:03.327327 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.327225 2573 reconstruct.go:97] "Volume reconstruction finished" Jun 11 21:12:03.327327 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.327235 2573 reconciler.go:29] "Reconciler: start to sync state" Jun 11 21:12:03.327430 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.327417 2573 factory.go:153] Registering CRI-O factory Jun 11 21:12:03.327477 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.327446 2573 factory.go:223] Registration of the crio container factory successfully Jun 11 21:12:03.327541 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.327534 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 21:12:03.327589 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.327556 2573 factory.go:103] Registering Raw factory Jun 11 21:12:03.327628 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.327590 2573 manager.go:1196] Started watching for new ooms in manager Jun 11 21:12:03.328138 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.328125 2573 manager.go:349] Starting recovery of all containers Jun 11 21:12:03.333155 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.332853 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-28.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 21:12:03.333155 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.333018 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 21:12:03.340806 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.340791 2573 manager.go:354] Recovery completed Jun 11 21:12:03.341741 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.341706 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fl4gb" Jun 11 21:12:03.342260 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.342244 2573 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 11 21:12:03.345141 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.345124 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:12:03.346664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.346649 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fl4gb" Jun 11 21:12:03.347052 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.347038 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:12:03.347134 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.347066 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:12:03.347134 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.347083 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:12:03.347663 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.347588 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:12:03.347663 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.347578 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 21:12:03.347663 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.347628 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 21:12:03.347663 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.347646 2573 state_mem.go:36] "Initialized new in-memory state store" Jun 11 21:12:03.348303 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.348286 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:12:03.348388 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.348311 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:12:03.348388 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.348320 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:12:03.349098 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.349035 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-28.ec2.internal.18b8232bbaa63123 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-28.ec2.internal,UID:ip-10-0-129-28.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-28.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-28.ec2.internal,},FirstTimestamp:2026-06-11 21:12:03.347050787 +0000 UTC m=+0.419109766,LastTimestamp:2026-06-11 21:12:03.347050787 +0000 UTC m=+0.419109766,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-28.ec2.internal,}" Jun 11 21:12:03.350327 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.350314 2573 policy_none.go:49] "None policy: Start" Jun 11 21:12:03.350388 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.350330 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 21:12:03.350388 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.350341 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 21:12:03.352868 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.352855 2573 policy_none.go:47] "Start" Jun 11 21:12:03.389112 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.389086 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.390283 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.390313 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.390330 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.390400 2573 kubelet.go:2472] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.391290 2573 manager.go:337] "Starting Device Plugin manager" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.391330 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.391344 2573 server.go:87] "Starting device plugin registration server" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.391605 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.391618 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.391787 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.391873 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.391884 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.392392 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.392446 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:03.402640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.392553 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:12:03.490976 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.490927 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal"] Jun 11 21:12:03.491076 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.491015 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:12:03.491706 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.491691 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:12:03.491873 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.491858 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:12:03.491943 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.491896 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:12:03.491943 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.491912 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:12:03.492299 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.492286 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:12:03.492370 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.492312 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:12:03.492370 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.492326 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:12:03.492370 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.492358 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.494359 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.494344 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:12:03.494500 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.494474 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.494555 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.494515 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:12:03.495025 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.495010 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:12:03.495122 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.495022 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:12:03.495122 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.495039 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:12:03.495122 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.495046 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:12:03.495122 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.495059 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:12:03.495122 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.495062 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:12:03.497490 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.497437 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.497490 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.497466 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 21:12:03.498141 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.498125 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientMemory" Jun 11 21:12:03.498202 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.498155 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 21:12:03.498202 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.498169 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeHasSufficientPID" Jun 11 21:12:03.500156 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.500140 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.500232 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.500160 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-28.ec2.internal\": node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:03.518040 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.518019 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-28.ec2.internal\" not found" node="ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.522446 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.522431 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-28.ec2.internal\" not found" node="ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.523760 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.523743 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:03.528345 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.528330 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1dccc7348b0eed6bcd73a2e707de76f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"f1dccc7348b0eed6bcd73a2e707de76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.528407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.528352 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1dccc7348b0eed6bcd73a2e707de76f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"f1dccc7348b0eed6bcd73a2e707de76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.528407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.528379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/df1df9ac03d74b94621cc8c32b56e28e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-28.ec2.internal\" (UID: \"df1df9ac03d74b94621cc8c32b56e28e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.624615 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.624593 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:03.628939 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.628923 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/df1df9ac03d74b94621cc8c32b56e28e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-28.ec2.internal\" (UID: \"df1df9ac03d74b94621cc8c32b56e28e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.629037 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.628951 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1dccc7348b0eed6bcd73a2e707de76f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"f1dccc7348b0eed6bcd73a2e707de76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.629037 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.628974 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1dccc7348b0eed6bcd73a2e707de76f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"f1dccc7348b0eed6bcd73a2e707de76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.629037 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.629008 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f1dccc7348b0eed6bcd73a2e707de76f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"f1dccc7348b0eed6bcd73a2e707de76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.629129 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.629030 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f1dccc7348b0eed6bcd73a2e707de76f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal\" (UID: \"f1dccc7348b0eed6bcd73a2e707de76f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.629129 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.629028 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/df1df9ac03d74b94621cc8c32b56e28e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-28.ec2.internal\" (UID: \"df1df9ac03d74b94621cc8c32b56e28e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.725093 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.725073 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:03.820824 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.820777 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.825301 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.825219 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:03.826831 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:03.826814 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" Jun 11 21:12:03.926092 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:03.926069 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:04.026533 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:04.026507 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:04.126971 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:04.126918 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:04.227369 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:04.227343 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:04.269689 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.269665 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 21:12:04.270204 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.269792 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 21:12:04.327544 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:04.327516 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:04.352696 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.352665 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 21:07:03 +0000 UTC" deadline="2027-12-25 11:07:57.831147394 +0000 UTC" Jun 11 21:12:04.352696 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.352692 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13477h55m53.478459768s" Jun 11 21:12:04.428381 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:04.428326 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-28.ec2.internal\" not found" Jun 11 21:12:04.469069 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.469051 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:12:04.496224 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:04.496020 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1df9ac03d74b94621cc8c32b56e28e.slice/crio-7f2f207bf011a90620c178d50df4824237cf03f9356c381d6e0b51c6e635fb9f WatchSource:0}: Error finding container 7f2f207bf011a90620c178d50df4824237cf03f9356c381d6e0b51c6e635fb9f: Status 404 returned error can't find the container with id 7f2f207bf011a90620c178d50df4824237cf03f9356c381d6e0b51c6e635fb9f Jun 11 21:12:04.496504 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:04.496468 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1dccc7348b0eed6bcd73a2e707de76f.slice/crio-8f2f59d4c11eeca8800062bed65f14e0f4af5fb3c74ce3dddcf4475896f24681 WatchSource:0}: Error finding container 8f2f59d4c11eeca8800062bed65f14e0f4af5fb3c74ce3dddcf4475896f24681: Status 404 returned error can't find the container with id 8f2f59d4c11eeca8800062bed65f14e0f4af5fb3c74ce3dddcf4475896f24681 Jun 11 21:12:04.501541 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.501524 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:12:04.527091 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.527066 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" Jun 11 21:12:04.541492 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.541473 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:12:04.543543 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.543530 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" Jun 11 21:12:04.551457 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.551443 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 21:12:04.604963 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.604944 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:12:04.918460 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:04.918399 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:12:05.308704 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.308635 2573 apiserver.go:52] "Watching apiserver" Jun 11 21:12:05.317684 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.317661 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 21:12:05.318108 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.318079 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-bvwbr","openshift-network-diagnostics/network-check-target-nz67n","openshift-network-operator/iptables-alerter-ct8rh","openshift-ovn-kubernetes/ovnkube-node-x2kcd","kube-system/global-pull-secret-syncer-qxjsz","kube-system/konnectivity-agent-kkngg","kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal","openshift-dns/node-resolver-cjxnx","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal","openshift-multus/multus-additional-cni-plugins-sshd7","openshift-multus/multus-djn25","openshift-multus/network-metrics-daemon-fvn2h","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj","openshift-cluster-node-tuning-operator/tuned-7k8dc"] Jun 11 21:12:05.320736 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.320717 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.322916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.322894 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.323447 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.323426 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 21:12:05.323550 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.323427 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 21:12:05.323656 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.323640 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 21:12:05.324074 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.323833 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 21:12:05.324074 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.323888 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ksf7b\"" Jun 11 21:12:05.324074 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.324020 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 21:12:05.325164 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.325128 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 21:12:05.325385 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.325368 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 21:12:05.326135 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.325622 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ct8rh" Jun 11 21:12:05.326135 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.325781 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 21:12:05.326135 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.325972 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m97zs\"" Jun 11 21:12:05.327155 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.327087 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 21:12:05.327821 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.327801 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.328568 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.328550 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:12:05.328568 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.328565 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 21:12:05.328905 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.328765 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 21:12:05.328905 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.328821 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q67fh\"" Jun 11 21:12:05.329835 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.329817 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 21:12:05.330206 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.330188 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:05.330277 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.330223 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 21:12:05.330333 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.330283 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:05.331167 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.330474 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9k772\"" Jun 11 21:12:05.331167 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.330761 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 21:12:05.331304 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.331179 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 21:12:05.333503 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.332271 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 21:12:05.333503 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.333094 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 21:12:05.333503 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.333400 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:05.335943 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.335703 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336592 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-system-cni-dir\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336628 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-node-log\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336656 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336683 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-ovnkube-config\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336709 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a107736-77c3-4fda-b030-f5adee9d83c3-dbus\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336733 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-os-release\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336758 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-socket-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-sys-fs\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336811 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e2338eb-2497-454a-92d9-672ce03db7df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336838 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-registration-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336877 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-run-netns\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336900 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-cni-bin\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.336916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336922 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6clj7\" (UniqueName: \"kubernetes.io/projected/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-kube-api-access-6clj7\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336938 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.336943 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-device-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337082 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ggvk5\"" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337118 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337088 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/501998d6-4e79-4da0-bbdd-5feb942d5c0a-host-slash\") pod \"iptables-alerter-ct8rh\" (UID: \"501998d6-4e79-4da0-bbdd-5feb942d5c0a\") " pod="openshift-network-operator/iptables-alerter-ct8rh" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337184 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-run-openvswitch\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337210 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-cni-netd\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337235 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68nqt\" (UniqueName: \"kubernetes.io/projected/501998d6-4e79-4da0-bbdd-5feb942d5c0a-kube-api-access-68nqt\") pod \"iptables-alerter-ct8rh\" (UID: \"501998d6-4e79-4da0-bbdd-5feb942d5c0a\") " pod="openshift-network-operator/iptables-alerter-ct8rh" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337261 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-slash\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-run-systemd\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337305 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-var-lib-openvswitch\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337326 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-log-socket\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-ovn-node-metrics-cert\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337403 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e2338eb-2497-454a-92d9-672ce03db7df-cni-binary-copy\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-cnibin\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337510 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-run-ovn-kubernetes\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.337826 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337579 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-env-overrides\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337602 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-ovnkube-script-lib\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337624 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a107736-77c3-4fda-b030-f5adee9d83c3-kubelet-config\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337663 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337689 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e2338eb-2497-454a-92d9-672ce03db7df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-systemd-units\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337737 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337760 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337782 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c9h9\" (UniqueName: \"kubernetes.io/projected/9719ea19-af44-4595-8ef9-0396a820b29c-kube-api-access-7c9h9\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-kubelet\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337826 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-etc-openvswitch\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337853 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-run-ovn\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337893 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79zk9\" (UniqueName: \"kubernetes.io/projected/6e2338eb-2497-454a-92d9-672ce03db7df-kube-api-access-79zk9\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.338659 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.337929 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/501998d6-4e79-4da0-bbdd-5feb942d5c0a-iptables-alerter-script\") pod \"iptables-alerter-ct8rh\" (UID: \"501998d6-4e79-4da0-bbdd-5feb942d5c0a\") " pod="openshift-network-operator/iptables-alerter-ct8rh" Jun 11 21:12:05.339253 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.338694 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cjxnx" Jun 11 21:12:05.339253 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.338737 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p6bvl\"" Jun 11 21:12:05.339253 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.338800 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 21:12:05.339253 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.339169 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:12:05.339782 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.339589 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 21:12:05.340975 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.340905 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 21:12:05.341252 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.341231 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-44rn5\"" Jun 11 21:12:05.341336 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.341242 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:05.341398 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.341353 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:05.341497 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.341465 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 21:12:05.343505 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.343470 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bvwbr" Jun 11 21:12:05.345877 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.345857 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 21:12:05.346002 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.345985 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 21:12:05.346059 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.346050 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vfprf\"" Jun 11 21:12:05.346234 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.346219 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 21:12:05.346288 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.346274 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-djn25" Jun 11 21:12:05.348470 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.348451 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:05.348593 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.348549 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:05.348818 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.348800 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5dpbq\"" Jun 11 21:12:05.349038 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.349023 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 21:12:05.357257 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.357240 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jc5f5" Jun 11 21:12:05.362963 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.362945 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jc5f5" Jun 11 21:12:05.395854 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.395809 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" event={"ID":"f1dccc7348b0eed6bcd73a2e707de76f","Type":"ContainerStarted","Data":"8f2f59d4c11eeca8800062bed65f14e0f4af5fb3c74ce3dddcf4475896f24681"} Jun 11 21:12:05.397597 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.397574 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" event={"ID":"df1df9ac03d74b94621cc8c32b56e28e","Type":"ContainerStarted","Data":"7f2f207bf011a90620c178d50df4824237cf03f9356c381d6e0b51c6e635fb9f"} Jun 11 21:12:05.428613 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.428595 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 21:12:05.439133 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.439083 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-var-lib-openvswitch\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.439245 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.439159 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.439176 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-var-lib-openvswitch\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.439727 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e2338eb-2497-454a-92d9-672ce03db7df-cni-binary-copy\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.439778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.439816 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-os-release\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.439849 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-var-lib-kubelet\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.439865 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.439875 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-kubernetes\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.439907 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-sys\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.439946 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret podName:0a107736-77c3-4fda-b030-f5adee9d83c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:05.939924656 +0000 UTC m=+3.011983629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret") pod "global-pull-secret-syncer-qxjsz" (UID: "0a107736-77c3-4fda-b030-f5adee9d83c3") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.439977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-env-overrides\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440006 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440139 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-run-netns\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440408 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhhgp\" (UniqueName: \"kubernetes.io/projected/e4884252-8b16-4975-a50b-4de635e9a60a-kube-api-access-xhhgp\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440454 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-systemd-units\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440495 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d7dcf20-a0b1-412b-9f87-f920735902c5-host\") pod \"node-ca-bvwbr\" (UID: \"4d7dcf20-a0b1-412b-9f87-f920735902c5\") " pod="openshift-image-registry/node-ca-bvwbr" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440527 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-etc-kubernetes\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.441000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440574 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-kubelet\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440607 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-etc-openvswitch\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440635 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79zk9\" (UniqueName: \"kubernetes.io/projected/6e2338eb-2497-454a-92d9-672ce03db7df-kube-api-access-79zk9\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440671 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-lib-modules\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440706 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-tuned\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440709 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-env-overrides\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440732 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-cnibin\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-hostroot\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440784 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-multus-conf-dir\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440815 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-node-log\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440826 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-kubelet\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440849 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440893 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-systemd-units\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440910 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440955 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a107736-77c3-4fda-b030-f5adee9d83c3-dbus\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.440983 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-etc-openvswitch\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441040 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-os-release\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.441878 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441090 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-node-log\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441122 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0a107736-77c3-4fda-b030-f5adee9d83c3-dbus\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441174 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-sys-fs\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441242 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-os-release\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441274 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-host\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441362 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-sys-fs\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441371 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6e2338eb-2497-454a-92d9-672ce03db7df-cni-binary-copy\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441398 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-var-lib-cni-bin\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441500 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-run-multus-certs\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441552 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-registration-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441591 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-var-lib-kubelet\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-device-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/501998d6-4e79-4da0-bbdd-5feb942d5c0a-host-slash\") pod \"iptables-alerter-ct8rh\" (UID: \"501998d6-4e79-4da0-bbdd-5feb942d5c0a\") " pod="openshift-network-operator/iptables-alerter-ct8rh" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441660 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-registration-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441681 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/178d8e7c-8abe-4c2d-8d8c-70617d65e4a9-agent-certs\") pod \"konnectivity-agent-kkngg\" (UID: \"178d8e7c-8abe-4c2d-8d8c-70617d65e4a9\") " pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441714 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5frs\" (UniqueName: \"kubernetes.io/projected/9323e683-7099-43c9-a8d3-23a369dd8280-kube-api-access-n5frs\") pod \"node-resolver-cjxnx\" (UID: \"9323e683-7099-43c9-a8d3-23a369dd8280\") " pod="openshift-dns/node-resolver-cjxnx" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441719 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-device-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.442698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441756 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9323e683-7099-43c9-a8d3-23a369dd8280-tmp-dir\") pod \"node-resolver-cjxnx\" (UID: \"9323e683-7099-43c9-a8d3-23a369dd8280\") " pod="openshift-dns/node-resolver-cjxnx" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4884252-8b16-4975-a50b-4de635e9a60a-cni-binary-copy\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441837 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-sysctl-d\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441884 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/501998d6-4e79-4da0-bbdd-5feb942d5c0a-host-slash\") pod \"iptables-alerter-ct8rh\" (UID: \"501998d6-4e79-4da0-bbdd-5feb942d5c0a\") " pod="openshift-network-operator/iptables-alerter-ct8rh" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441941 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-run-systemd\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.441977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-log-socket\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-ovn-node-metrics-cert\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c9h9\" (UniqueName: \"kubernetes.io/projected/9719ea19-af44-4595-8ef9-0396a820b29c-kube-api-access-7c9h9\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442113 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-systemd\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442142 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-cnibin\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442149 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-run-systemd\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442204 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-run-ovn-kubernetes\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442233 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-ovnkube-script-lib\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442292 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-run-ovn-kubernetes\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442347 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-cnibin\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442398 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-log-socket\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442443 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a107736-77c3-4fda-b030-f5adee9d83c3-kubelet-config\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:05.443459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442503 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e2338eb-2497-454a-92d9-672ce03db7df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442535 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-run-k8s-cni-cncf-io\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442574 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442605 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442609 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0a107736-77c3-4fda-b030-f5adee9d83c3-kubelet-config\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442652 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-multus-cni-dir\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442676 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-etc-selinux\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442686 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-run-ovn\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442718 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/501998d6-4e79-4da0-bbdd-5feb942d5c0a-iptables-alerter-script\") pod \"iptables-alerter-ct8rh\" (UID: \"501998d6-4e79-4da0-bbdd-5feb942d5c0a\") " pod="openshift-network-operator/iptables-alerter-ct8rh" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442748 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-sysctl-conf\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442804 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-system-cni-dir\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442835 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-ovnkube-config\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-socket-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442901 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-run\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442934 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-ovnkube-script-lib\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442934 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrzpm\" (UniqueName: \"kubernetes.io/projected/a79908fe-edaf-40a3-aeeb-b201a92a447d-kube-api-access-hrzpm\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.444149 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.442986 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8hwx\" (UniqueName: \"kubernetes.io/projected/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-kube-api-access-t8hwx\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-run-ovn\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443017 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d7dcf20-a0b1-412b-9f87-f920735902c5-serviceca\") pod \"node-ca-bvwbr\" (UID: \"4d7dcf20-a0b1-412b-9f87-f920735902c5\") " pod="openshift-image-registry/node-ca-bvwbr" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e2338eb-2497-454a-92d9-672ce03db7df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443078 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-modprobe-d\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443105 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79908fe-edaf-40a3-aeeb-b201a92a447d-tmp\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443132 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9323e683-7099-43c9-a8d3-23a369dd8280-hosts-file\") pod \"node-resolver-cjxnx\" (UID: \"9323e683-7099-43c9-a8d3-23a369dd8280\") " pod="openshift-dns/node-resolver-cjxnx" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443131 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6e2338eb-2497-454a-92d9-672ce03db7df-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443159 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e4884252-8b16-4975-a50b-4de635e9a60a-multus-daemon-config\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443188 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-run-netns\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-cni-bin\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443220 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443246 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6clj7\" (UniqueName: \"kubernetes.io/projected/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-kube-api-access-6clj7\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443304 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-run-netns\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-sysconfig\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443476 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/501998d6-4e79-4da0-bbdd-5feb942d5c0a-iptables-alerter-script\") pod \"iptables-alerter-ct8rh\" (UID: \"501998d6-4e79-4da0-bbdd-5feb942d5c0a\") " pod="openshift-network-operator/iptables-alerter-ct8rh" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443666 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 21:12:05.444925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443763 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-cni-bin\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443806 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6e2338eb-2497-454a-92d9-672ce03db7df-system-cni-dir\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6e2338eb-2497-454a-92d9-672ce03db7df-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.443943 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2497\" (UniqueName: \"kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497\") pod \"network-check-target-nz67n\" (UID: \"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d\") " pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444088 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/9719ea19-af44-4595-8ef9-0396a820b29c-socket-dir\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444319 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd58r\" (UniqueName: \"kubernetes.io/projected/4d7dcf20-a0b1-412b-9f87-f920735902c5-kube-api-access-jd58r\") pod \"node-ca-bvwbr\" (UID: \"4d7dcf20-a0b1-412b-9f87-f920735902c5\") " pod="openshift-image-registry/node-ca-bvwbr" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444360 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-multus-socket-dir-parent\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-run-openvswitch\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444504 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-run-openvswitch\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444630 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-ovnkube-config\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444550 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-cni-netd\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444653 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-cni-netd\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444723 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68nqt\" (UniqueName: \"kubernetes.io/projected/501998d6-4e79-4da0-bbdd-5feb942d5c0a-kube-api-access-68nqt\") pod \"iptables-alerter-ct8rh\" (UID: \"501998d6-4e79-4da0-bbdd-5feb942d5c0a\") " pod="openshift-network-operator/iptables-alerter-ct8rh" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444771 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-system-cni-dir\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444798 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-var-lib-cni-multus\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444829 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/178d8e7c-8abe-4c2d-8d8c-70617d65e4a9-konnectivity-ca\") pod \"konnectivity-agent-kkngg\" (UID: \"178d8e7c-8abe-4c2d-8d8c-70617d65e4a9\") " pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.444872 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-slash\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.445767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.445002 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-host-slash\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.447315 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.447294 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-ovn-node-metrics-cert\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.451791 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.451720 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79zk9\" (UniqueName: \"kubernetes.io/projected/6e2338eb-2497-454a-92d9-672ce03db7df-kube-api-access-79zk9\") pod \"multus-additional-cni-plugins-sshd7\" (UID: \"6e2338eb-2497-454a-92d9-672ce03db7df\") " pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.452536 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.452514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68nqt\" (UniqueName: \"kubernetes.io/projected/501998d6-4e79-4da0-bbdd-5feb942d5c0a-kube-api-access-68nqt\") pod \"iptables-alerter-ct8rh\" (UID: \"501998d6-4e79-4da0-bbdd-5feb942d5c0a\") " pod="openshift-network-operator/iptables-alerter-ct8rh" Jun 11 21:12:05.453244 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.453220 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6clj7\" (UniqueName: \"kubernetes.io/projected/19eb4850-5b28-4a9f-a0c0-cc30e5808f42-kube-api-access-6clj7\") pod \"ovnkube-node-x2kcd\" (UID: \"19eb4850-5b28-4a9f-a0c0-cc30e5808f42\") " pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.454084 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.454060 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c9h9\" (UniqueName: \"kubernetes.io/projected/9719ea19-af44-4595-8ef9-0396a820b29c-kube-api-access-7c9h9\") pod \"aws-ebs-csi-driver-node-jxxkj\" (UID: \"9719ea19-af44-4595-8ef9-0396a820b29c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.545469 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545436 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-os-release\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.545642 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-var-lib-kubelet\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.545642 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-kubernetes\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.545642 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545544 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-sys\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.545642 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545614 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-os-release\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.545848 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545645 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-var-lib-kubelet\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.545848 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545742 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-run-netns\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.545848 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545784 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-kubernetes\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.545848 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545845 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-sys\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.546018 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545847 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhhgp\" (UniqueName: \"kubernetes.io/projected/e4884252-8b16-4975-a50b-4de635e9a60a-kube-api-access-xhhgp\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546018 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545877 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-run-netns\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546018 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545882 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d7dcf20-a0b1-412b-9f87-f920735902c5-host\") pod \"node-ca-bvwbr\" (UID: \"4d7dcf20-a0b1-412b-9f87-f920735902c5\") " pod="openshift-image-registry/node-ca-bvwbr" Jun 11 21:12:05.546018 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545919 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4d7dcf20-a0b1-412b-9f87-f920735902c5-host\") pod \"node-ca-bvwbr\" (UID: \"4d7dcf20-a0b1-412b-9f87-f920735902c5\") " pod="openshift-image-registry/node-ca-bvwbr" Jun 11 21:12:05.546018 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-etc-kubernetes\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546018 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545955 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-lib-modules\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.546018 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.545977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-tuned\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.546018 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546001 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-cnibin\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546024 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-hostroot\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546060 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-multus-conf-dir\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546086 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-host\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546104 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-lib-modules\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546109 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-var-lib-cni-bin\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546144 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-hostroot\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546151 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-run-multus-certs\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546190 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-etc-kubernetes\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546145 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-var-lib-cni-bin\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546206 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-cnibin\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546194 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-var-lib-kubelet\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546216 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-multus-conf-dir\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546234 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-run-multus-certs\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546251 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-var-lib-kubelet\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546284 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/178d8e7c-8abe-4c2d-8d8c-70617d65e4a9-agent-certs\") pod \"konnectivity-agent-kkngg\" (UID: \"178d8e7c-8abe-4c2d-8d8c-70617d65e4a9\") " pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546312 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5frs\" (UniqueName: \"kubernetes.io/projected/9323e683-7099-43c9-a8d3-23a369dd8280-kube-api-access-n5frs\") pod \"node-resolver-cjxnx\" (UID: \"9323e683-7099-43c9-a8d3-23a369dd8280\") " pod="openshift-dns/node-resolver-cjxnx" Jun 11 21:12:05.546407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546320 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-host\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546383 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9323e683-7099-43c9-a8d3-23a369dd8280-tmp-dir\") pod \"node-resolver-cjxnx\" (UID: \"9323e683-7099-43c9-a8d3-23a369dd8280\") " pod="openshift-dns/node-resolver-cjxnx" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546505 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4884252-8b16-4975-a50b-4de635e9a60a-cni-binary-copy\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546557 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-sysctl-d\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546697 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-systemd\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-run-k8s-cni-cncf-io\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546759 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9323e683-7099-43c9-a8d3-23a369dd8280-tmp-dir\") pod \"node-resolver-cjxnx\" (UID: \"9323e683-7099-43c9-a8d3-23a369dd8280\") " pod="openshift-dns/node-resolver-cjxnx" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546770 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-multus-cni-dir\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546814 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-sysctl-conf\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546845 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-sysctl-d\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546857 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546849 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-run-k8s-cni-cncf-io\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546885 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-run\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546902 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-systemd\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546965 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrzpm\" (UniqueName: \"kubernetes.io/projected/a79908fe-edaf-40a3-aeeb-b201a92a447d-kube-api-access-hrzpm\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546980 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-sysctl-conf\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.546991 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8hwx\" (UniqueName: \"kubernetes.io/projected/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-kube-api-access-t8hwx\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.546996 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:05.547248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547036 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-multus-cni-dir\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.547049 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs podName:d80e86ad-3e9e-4ae9-9666-8f639b3d84fc nodeName:}" failed. No retries permitted until 2026-06-11 21:12:06.047031152 +0000 UTC m=+3.119090117 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs") pod "network-metrics-daemon-fvn2h" (UID: "d80e86ad-3e9e-4ae9-9666-8f639b3d84fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547058 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e4884252-8b16-4975-a50b-4de635e9a60a-cni-binary-copy\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547086 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-run\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547030 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d7dcf20-a0b1-412b-9f87-f920735902c5-serviceca\") pod \"node-ca-bvwbr\" (UID: \"4d7dcf20-a0b1-412b-9f87-f920735902c5\") " pod="openshift-image-registry/node-ca-bvwbr" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547126 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-modprobe-d\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547151 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79908fe-edaf-40a3-aeeb-b201a92a447d-tmp\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547176 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9323e683-7099-43c9-a8d3-23a369dd8280-hosts-file\") pod \"node-resolver-cjxnx\" (UID: \"9323e683-7099-43c9-a8d3-23a369dd8280\") " pod="openshift-dns/node-resolver-cjxnx" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547198 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e4884252-8b16-4975-a50b-4de635e9a60a-multus-daemon-config\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547226 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-sysconfig\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547250 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2497\" (UniqueName: \"kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497\") pod \"network-check-target-nz67n\" (UID: \"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d\") " pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd58r\" (UniqueName: \"kubernetes.io/projected/4d7dcf20-a0b1-412b-9f87-f920735902c5-kube-api-access-jd58r\") pod \"node-ca-bvwbr\" (UID: \"4d7dcf20-a0b1-412b-9f87-f920735902c5\") " pod="openshift-image-registry/node-ca-bvwbr" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547298 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-multus-socket-dir-parent\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547326 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-modprobe-d\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547329 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-system-cni-dir\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547374 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-system-cni-dir\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547391 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-var-lib-cni-multus\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.548151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547421 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/178d8e7c-8abe-4c2d-8d8c-70617d65e4a9-konnectivity-ca\") pod \"konnectivity-agent-kkngg\" (UID: \"178d8e7c-8abe-4c2d-8d8c-70617d65e4a9\") " pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:05.549009 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547424 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9323e683-7099-43c9-a8d3-23a369dd8280-hosts-file\") pod \"node-resolver-cjxnx\" (UID: \"9323e683-7099-43c9-a8d3-23a369dd8280\") " pod="openshift-dns/node-resolver-cjxnx" Jun 11 21:12:05.549009 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547550 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-multus-socket-dir-parent\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.549009 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547706 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e4884252-8b16-4975-a50b-4de635e9a60a-host-var-lib-cni-multus\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.549009 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547762 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4d7dcf20-a0b1-412b-9f87-f920735902c5-serviceca\") pod \"node-ca-bvwbr\" (UID: \"4d7dcf20-a0b1-412b-9f87-f920735902c5\") " pod="openshift-image-registry/node-ca-bvwbr" Jun 11 21:12:05.549009 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.547801 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-sysconfig\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.549009 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.548022 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/178d8e7c-8abe-4c2d-8d8c-70617d65e4a9-konnectivity-ca\") pod \"konnectivity-agent-kkngg\" (UID: \"178d8e7c-8abe-4c2d-8d8c-70617d65e4a9\") " pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:05.549009 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.548177 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e4884252-8b16-4975-a50b-4de635e9a60a-multus-daemon-config\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.549663 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.549643 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a79908fe-edaf-40a3-aeeb-b201a92a447d-tmp\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.549978 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.549953 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/178d8e7c-8abe-4c2d-8d8c-70617d65e4a9-agent-certs\") pod \"konnectivity-agent-kkngg\" (UID: \"178d8e7c-8abe-4c2d-8d8c-70617d65e4a9\") " pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:05.550087 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.550061 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/a79908fe-edaf-40a3-aeeb-b201a92a447d-etc-tuned\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.553574 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.553541 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:12:05.553574 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.553565 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:12:05.553777 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.553579 2573 projected.go:196] Error preparing data for projected volume kube-api-access-b2497 for pod openshift-network-diagnostics/network-check-target-nz67n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:05.553777 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.553651 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497 podName:b5e1fcec-cd44-4d3e-aa8c-32e09be2440d nodeName:}" failed. No retries permitted until 2026-06-11 21:12:06.053634547 +0000 UTC m=+3.125693525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b2497" (UniqueName: "kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497") pod "network-check-target-nz67n" (UID: "b5e1fcec-cd44-4d3e-aa8c-32e09be2440d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:05.554985 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.554962 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5frs\" (UniqueName: \"kubernetes.io/projected/9323e683-7099-43c9-a8d3-23a369dd8280-kube-api-access-n5frs\") pod \"node-resolver-cjxnx\" (UID: \"9323e683-7099-43c9-a8d3-23a369dd8280\") " pod="openshift-dns/node-resolver-cjxnx" Jun 11 21:12:05.556234 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.556211 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhhgp\" (UniqueName: \"kubernetes.io/projected/e4884252-8b16-4975-a50b-4de635e9a60a-kube-api-access-xhhgp\") pod \"multus-djn25\" (UID: \"e4884252-8b16-4975-a50b-4de635e9a60a\") " pod="openshift-multus/multus-djn25" Jun 11 21:12:05.556787 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.556738 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8hwx\" (UniqueName: \"kubernetes.io/projected/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-kube-api-access-t8hwx\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:05.559653 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.559575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd58r\" (UniqueName: \"kubernetes.io/projected/4d7dcf20-a0b1-412b-9f87-f920735902c5-kube-api-access-jd58r\") pod \"node-ca-bvwbr\" (UID: \"4d7dcf20-a0b1-412b-9f87-f920735902c5\") " pod="openshift-image-registry/node-ca-bvwbr" Jun 11 21:12:05.559746 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.559656 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrzpm\" (UniqueName: \"kubernetes.io/projected/a79908fe-edaf-40a3-aeeb-b201a92a447d-kube-api-access-hrzpm\") pod \"tuned-7k8dc\" (UID: \"a79908fe-edaf-40a3-aeeb-b201a92a447d\") " pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.635661 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.635638 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 21:12:05.639957 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.639934 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sshd7" Jun 11 21:12:05.650139 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.650119 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ct8rh" Jun 11 21:12:05.656880 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.656862 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" Jun 11 21:12:05.663480 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.663464 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:05.671146 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.671129 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:05.678818 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.678801 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" Jun 11 21:12:05.686292 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.686273 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cjxnx" Jun 11 21:12:05.692825 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.692807 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bvwbr" Jun 11 21:12:05.698392 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.698371 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-djn25" Jun 11 21:12:05.949714 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:05.949642 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:05.949849 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.949768 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:05.949849 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:05.949819 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret podName:0a107736-77c3-4fda-b030-f5adee9d83c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:06.949806213 +0000 UTC m=+4.021865174 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret") pod "global-pull-secret-syncer-qxjsz" (UID: "0a107736-77c3-4fda-b030-f5adee9d83c3") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:06.050031 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:06.049997 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:06.050203 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:06.050145 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:06.050270 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:06.050211 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs podName:d80e86ad-3e9e-4ae9-9666-8f639b3d84fc nodeName:}" failed. No retries permitted until 2026-06-11 21:12:07.050192773 +0000 UTC m=+4.122251747 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs") pod "network-metrics-daemon-fvn2h" (UID: "d80e86ad-3e9e-4ae9-9666-8f639b3d84fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:06.151161 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:06.151129 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2497\" (UniqueName: \"kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497\") pod \"network-check-target-nz67n\" (UID: \"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d\") " pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:06.151311 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:06.151273 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:12:06.151311 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:06.151293 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:12:06.151311 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:06.151303 2573 projected.go:196] Error preparing data for projected volume kube-api-access-b2497 for pod openshift-network-diagnostics/network-check-target-nz67n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:06.151444 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:06.151345 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497 podName:b5e1fcec-cd44-4d3e-aa8c-32e09be2440d nodeName:}" failed. No retries permitted until 2026-06-11 21:12:07.151332362 +0000 UTC m=+4.223391322 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2497" (UniqueName: "kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497") pod "network-check-target-nz67n" (UID: "b5e1fcec-cd44-4d3e-aa8c-32e09be2440d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:06.366599 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:06.366511 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:07:05 +0000 UTC" deadline="2028-01-30 20:47:04.319747368 +0000 UTC" Jun 11 21:12:06.366599 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:06.366550 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14351h34m57.953204453s" Jun 11 21:12:06.585199 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:06.585178 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4884252_8b16_4975_a50b_4de635e9a60a.slice/crio-eaae6cd0d0fd601aa02b41d2261e0e671a13ab8eb555c85903c4f841a0ec435d WatchSource:0}: Error finding container eaae6cd0d0fd601aa02b41d2261e0e671a13ab8eb555c85903c4f841a0ec435d: Status 404 returned error can't find the container with id eaae6cd0d0fd601aa02b41d2261e0e671a13ab8eb555c85903c4f841a0ec435d Jun 11 21:12:06.586162 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:06.586134 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19eb4850_5b28_4a9f_a0c0_cc30e5808f42.slice/crio-4d101fba8a71348f29253eff541ba0eb9d088fecfc2c7985f9d1f65824580f78 WatchSource:0}: Error finding container 4d101fba8a71348f29253eff541ba0eb9d088fecfc2c7985f9d1f65824580f78: Status 404 returned error can't find the container with id 4d101fba8a71348f29253eff541ba0eb9d088fecfc2c7985f9d1f65824580f78 Jun 11 21:12:06.586918 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:06.586890 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501998d6_4e79_4da0_bbdd_5feb942d5c0a.slice/crio-df182d531ba1443138d9edf64ac55e389f56273758593805f05838c749967846 WatchSource:0}: Error finding container df182d531ba1443138d9edf64ac55e389f56273758593805f05838c749967846: Status 404 returned error can't find the container with id df182d531ba1443138d9edf64ac55e389f56273758593805f05838c749967846 Jun 11 21:12:06.590134 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:06.590112 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2338eb_2497_454a_92d9_672ce03db7df.slice/crio-b8570fe9c9982c251a3c96e10c544d60ef0005a7836cfc1dfc7fa6d71477cc9e WatchSource:0}: Error finding container b8570fe9c9982c251a3c96e10c544d60ef0005a7836cfc1dfc7fa6d71477cc9e: Status 404 returned error can't find the container with id b8570fe9c9982c251a3c96e10c544d60ef0005a7836cfc1dfc7fa6d71477cc9e Jun 11 21:12:06.591035 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:06.590987 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7dcf20_a0b1_412b_9f87_f920735902c5.slice/crio-223eea7979ca61afb9e5142da859fbb88da8df649073af7609250a3892641d71 WatchSource:0}: Error finding container 223eea7979ca61afb9e5142da859fbb88da8df649073af7609250a3892641d71: Status 404 returned error can't find the container with id 223eea7979ca61afb9e5142da859fbb88da8df649073af7609250a3892641d71 Jun 11 21:12:06.592001 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:06.591934 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda79908fe_edaf_40a3_aeeb_b201a92a447d.slice/crio-5608811cfa77b21cb62af8e9558a0c5473b0f59a2abe577724f291409e496f60 WatchSource:0}: Error finding container 5608811cfa77b21cb62af8e9558a0c5473b0f59a2abe577724f291409e496f60: Status 404 returned error can't find the container with id 5608811cfa77b21cb62af8e9558a0c5473b0f59a2abe577724f291409e496f60 Jun 11 21:12:06.592817 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:06.592777 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod178d8e7c_8abe_4c2d_8d8c_70617d65e4a9.slice/crio-7e05e04c0ab76b11678a2be84af93f2b1e75f1ad27a5068070dd059542a3c777 WatchSource:0}: Error finding container 7e05e04c0ab76b11678a2be84af93f2b1e75f1ad27a5068070dd059542a3c777: Status 404 returned error can't find the container with id 7e05e04c0ab76b11678a2be84af93f2b1e75f1ad27a5068070dd059542a3c777 Jun 11 21:12:06.594124 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:06.593840 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9719ea19_af44_4595_8ef9_0396a820b29c.slice/crio-afad1cc57d78a5d738085b3258e96726e7334399b13f3afeebc75c26d20c52d8 WatchSource:0}: Error finding container afad1cc57d78a5d738085b3258e96726e7334399b13f3afeebc75c26d20c52d8: Status 404 returned error can't find the container with id afad1cc57d78a5d738085b3258e96726e7334399b13f3afeebc75c26d20c52d8 Jun 11 21:12:06.595282 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:06.595236 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9323e683_7099_43c9_a8d3_23a369dd8280.slice/crio-5f763624f78196147695c805ce07f5fe583b0c0ac41db6f1e08f71cc29a1121f WatchSource:0}: Error finding container 5f763624f78196147695c805ce07f5fe583b0c0ac41db6f1e08f71cc29a1121f: Status 404 returned error can't find the container with id 5f763624f78196147695c805ce07f5fe583b0c0ac41db6f1e08f71cc29a1121f Jun 11 21:12:06.957295 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:06.957232 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:06.957402 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:06.957368 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:06.957440 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:06.957426 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret podName:0a107736-77c3-4fda-b030-f5adee9d83c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:08.957407903 +0000 UTC m=+6.029466866 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret") pod "global-pull-secret-syncer-qxjsz" (UID: "0a107736-77c3-4fda-b030-f5adee9d83c3") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:07.058645 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.058561 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:07.058800 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:07.058726 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:07.058869 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:07.058836 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs podName:d80e86ad-3e9e-4ae9-9666-8f639b3d84fc nodeName:}" failed. No retries permitted until 2026-06-11 21:12:09.05881405 +0000 UTC m=+6.130873012 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs") pod "network-metrics-daemon-fvn2h" (UID: "d80e86ad-3e9e-4ae9-9666-8f639b3d84fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:07.159593 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.158914 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2497\" (UniqueName: \"kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497\") pod \"network-check-target-nz67n\" (UID: \"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d\") " pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:07.159593 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:07.159127 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:12:07.159593 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:07.159153 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:12:07.159593 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:07.159166 2573 projected.go:196] Error preparing data for projected volume kube-api-access-b2497 for pod openshift-network-diagnostics/network-check-target-nz67n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:07.159593 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:07.159223 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497 podName:b5e1fcec-cd44-4d3e-aa8c-32e09be2440d nodeName:}" failed. No retries permitted until 2026-06-11 21:12:09.159205802 +0000 UTC m=+6.231264763 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2497" (UniqueName: "kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497") pod "network-check-target-nz67n" (UID: "b5e1fcec-cd44-4d3e-aa8c-32e09be2440d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:07.367069 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.366946 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 21:07:05 +0000 UTC" deadline="2027-11-16 13:09:24.4941677 +0000 UTC" Jun 11 21:12:07.367069 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.367002 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12543h57m17.12716964s" Jun 11 21:12:07.391425 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.391399 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:07.391560 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:07.391537 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:07.391972 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.391953 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:07.392072 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:07.392052 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:07.392146 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.392118 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:07.392212 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:07.392195 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:07.403428 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.403396 2573 generic.go:356] "Generic (PLEG): container finished" podID="f1dccc7348b0eed6bcd73a2e707de76f" containerID="7be8c06c93bf3332b8ad71824b1f31ed5e83aba819dd3e54e58a698fbee12df5" exitCode=0 Jun 11 21:12:07.403554 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.403476 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" event={"ID":"f1dccc7348b0eed6bcd73a2e707de76f","Type":"ContainerDied","Data":"7be8c06c93bf3332b8ad71824b1f31ed5e83aba819dd3e54e58a698fbee12df5"} Jun 11 21:12:07.406391 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.406362 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bvwbr" event={"ID":"4d7dcf20-a0b1-412b-9f87-f920735902c5","Type":"ContainerStarted","Data":"223eea7979ca61afb9e5142da859fbb88da8df649073af7609250a3892641d71"} Jun 11 21:12:07.408063 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.407974 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" event={"ID":"9719ea19-af44-4595-8ef9-0396a820b29c","Type":"ContainerStarted","Data":"afad1cc57d78a5d738085b3258e96726e7334399b13f3afeebc75c26d20c52d8"} Jun 11 21:12:07.416774 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.416711 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cjxnx" event={"ID":"9323e683-7099-43c9-a8d3-23a369dd8280","Type":"ContainerStarted","Data":"5f763624f78196147695c805ce07f5fe583b0c0ac41db6f1e08f71cc29a1121f"} Jun 11 21:12:07.421010 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.420943 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" event={"ID":"a79908fe-edaf-40a3-aeeb-b201a92a447d","Type":"ContainerStarted","Data":"5608811cfa77b21cb62af8e9558a0c5473b0f59a2abe577724f291409e496f60"} Jun 11 21:12:07.436640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.436569 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sshd7" event={"ID":"6e2338eb-2497-454a-92d9-672ce03db7df","Type":"ContainerStarted","Data":"b8570fe9c9982c251a3c96e10c544d60ef0005a7836cfc1dfc7fa6d71477cc9e"} Jun 11 21:12:07.459708 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.459635 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ct8rh" event={"ID":"501998d6-4e79-4da0-bbdd-5feb942d5c0a","Type":"ContainerStarted","Data":"df182d531ba1443138d9edf64ac55e389f56273758593805f05838c749967846"} Jun 11 21:12:07.466604 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.466479 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" event={"ID":"19eb4850-5b28-4a9f-a0c0-cc30e5808f42","Type":"ContainerStarted","Data":"4d101fba8a71348f29253eff541ba0eb9d088fecfc2c7985f9d1f65824580f78"} Jun 11 21:12:07.471318 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.471278 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" event={"ID":"df1df9ac03d74b94621cc8c32b56e28e","Type":"ContainerStarted","Data":"f93da49946915effb12a7ef00607a41a3f3c677bfd6c3897768f4ced9d19361a"} Jun 11 21:12:07.489894 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.489868 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kkngg" event={"ID":"178d8e7c-8abe-4c2d-8d8c-70617d65e4a9","Type":"ContainerStarted","Data":"7e05e04c0ab76b11678a2be84af93f2b1e75f1ad27a5068070dd059542a3c777"} Jun 11 21:12:07.496900 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:07.496839 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-djn25" event={"ID":"e4884252-8b16-4975-a50b-4de635e9a60a","Type":"ContainerStarted","Data":"eaae6cd0d0fd601aa02b41d2261e0e671a13ab8eb555c85903c4f841a0ec435d"} Jun 11 21:12:08.515059 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:08.514961 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" event={"ID":"f1dccc7348b0eed6bcd73a2e707de76f","Type":"ContainerStarted","Data":"426d294c18a265c921a908c62190e04d8b46c8731582143e202537e54b357826"} Jun 11 21:12:08.530282 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:08.529135 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-28.ec2.internal" podStartSLOduration=4.529116891 podStartE2EDuration="4.529116891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:12:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:07.486105577 +0000 UTC m=+4.558164558" watchObservedRunningTime="2026-06-11 21:12:08.529116891 +0000 UTC m=+5.601175874" Jun 11 21:12:08.975543 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:08.975415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:08.975703 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:08.975573 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:08.975703 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:08.975631 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret podName:0a107736-77c3-4fda-b030-f5adee9d83c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:12.9756131 +0000 UTC m=+10.047672074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret") pod "global-pull-secret-syncer-qxjsz" (UID: "0a107736-77c3-4fda-b030-f5adee9d83c3") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:09.076238 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:09.076187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:09.076384 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:09.076361 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:09.076442 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:09.076417 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs podName:d80e86ad-3e9e-4ae9-9666-8f639b3d84fc nodeName:}" failed. No retries permitted until 2026-06-11 21:12:13.076400247 +0000 UTC m=+10.148459215 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs") pod "network-metrics-daemon-fvn2h" (UID: "d80e86ad-3e9e-4ae9-9666-8f639b3d84fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:09.177076 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:09.177046 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2497\" (UniqueName: \"kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497\") pod \"network-check-target-nz67n\" (UID: \"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d\") " pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:09.177286 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:09.177253 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:12:09.177286 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:09.177275 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:12:09.177286 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:09.177288 2573 projected.go:196] Error preparing data for projected volume kube-api-access-b2497 for pod openshift-network-diagnostics/network-check-target-nz67n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:09.177470 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:09.177352 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497 podName:b5e1fcec-cd44-4d3e-aa8c-32e09be2440d nodeName:}" failed. No retries permitted until 2026-06-11 21:12:13.177325962 +0000 UTC m=+10.249384927 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2497" (UniqueName: "kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497") pod "network-check-target-nz67n" (UID: "b5e1fcec-cd44-4d3e-aa8c-32e09be2440d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:09.396131 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:09.395358 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:09.396131 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:09.395474 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:09.396131 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:09.395834 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:09.396131 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:09.395925 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:09.396131 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:09.395971 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:09.396131 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:09.396050 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:11.393273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:11.392588 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:11.393273 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:11.392712 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:11.393273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:11.393131 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:11.393273 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:11.393226 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:11.393991 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:11.393968 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:11.394107 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:11.394079 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:13.010315 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:13.010282 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:13.010703 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:13.010440 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:13.010703 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:13.010526 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret podName:0a107736-77c3-4fda-b030-f5adee9d83c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:21.010506459 +0000 UTC m=+18.082565420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret") pod "global-pull-secret-syncer-qxjsz" (UID: "0a107736-77c3-4fda-b030-f5adee9d83c3") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:13.111174 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:13.111124 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:13.111321 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:13.111257 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:13.111388 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:13.111332 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs podName:d80e86ad-3e9e-4ae9-9666-8f639b3d84fc nodeName:}" failed. No retries permitted until 2026-06-11 21:12:21.111311738 +0000 UTC m=+18.183370703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs") pod "network-metrics-daemon-fvn2h" (UID: "d80e86ad-3e9e-4ae9-9666-8f639b3d84fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:13.212262 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:13.212229 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2497\" (UniqueName: \"kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497\") pod \"network-check-target-nz67n\" (UID: \"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d\") " pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:13.212396 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:13.212370 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:12:13.212461 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:13.212398 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:12:13.212461 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:13.212411 2573 projected.go:196] Error preparing data for projected volume kube-api-access-b2497 for pod openshift-network-diagnostics/network-check-target-nz67n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:13.212549 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:13.212467 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497 podName:b5e1fcec-cd44-4d3e-aa8c-32e09be2440d nodeName:}" failed. No retries permitted until 2026-06-11 21:12:21.212447337 +0000 UTC m=+18.284506298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2497" (UniqueName: "kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497") pod "network-check-target-nz67n" (UID: "b5e1fcec-cd44-4d3e-aa8c-32e09be2440d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:13.391905 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:13.391836 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:13.392060 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:13.391957 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:13.392218 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:13.392194 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:13.392300 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:13.392232 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:13.392353 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:13.392320 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:13.392431 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:13.392402 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:15.391617 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:15.391582 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:15.392056 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:15.391716 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:15.392155 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:15.392128 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:15.392289 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:15.392229 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:15.392289 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:15.392254 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:15.392400 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:15.392375 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:16.533920 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:16.533141 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bvwbr" event={"ID":"4d7dcf20-a0b1-412b-9f87-f920735902c5","Type":"ContainerStarted","Data":"9a309273bff141b817ef980d5574b6d52e2029f777c173ba5a5b8adf1631a2a4"} Jun 11 21:12:16.536611 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:16.536558 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" event={"ID":"9719ea19-af44-4595-8ef9-0396a820b29c","Type":"ContainerStarted","Data":"c368f61b565398bec8dd2760dad0eba5473443ee8197227e1e0de33259a463c3"} Jun 11 21:12:16.540165 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:16.540135 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cjxnx" event={"ID":"9323e683-7099-43c9-a8d3-23a369dd8280","Type":"ContainerStarted","Data":"53c897d670d17271aa5901049eab0301128b017e0207c48af6c0ae182d8324fe"} Jun 11 21:12:16.541925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:16.541902 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" event={"ID":"a79908fe-edaf-40a3-aeeb-b201a92a447d","Type":"ContainerStarted","Data":"847f9ce76e47208f459eb4beb57359f9fc8289a7d1c46fd9291fa3dba43a248d"} Jun 11 21:12:16.544017 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:16.543954 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sshd7" event={"ID":"6e2338eb-2497-454a-92d9-672ce03db7df","Type":"ContainerStarted","Data":"abbbe1f3ff583be943c0a122131b55a6b4605dcf0884dae1fcbcf6709b268217"} Jun 11 21:12:16.545568 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:16.545506 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kkngg" event={"ID":"178d8e7c-8abe-4c2d-8d8c-70617d65e4a9","Type":"ContainerStarted","Data":"57cf1e572b7b5ecb96d090164b178df8c12bad55d81ea0777da44ca5f791c61b"} Jun 11 21:12:16.547012 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:16.546980 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-28.ec2.internal" podStartSLOduration=12.546970392 podStartE2EDuration="12.546970392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:12:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:08.530258235 +0000 UTC m=+5.602317218" watchObservedRunningTime="2026-06-11 21:12:16.546970392 +0000 UTC m=+13.619029373" Jun 11 21:12:16.547462 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:16.547321 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bvwbr" podStartSLOduration=3.920173619 podStartE2EDuration="13.547313833s" totalImagesPullingTime="9.627140214s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:16.547026965 +0000 UTC m=+13.619085950" watchObservedRunningTime="2026-06-11 21:12:16.547313833 +0000 UTC m=+13.619372816" Jun 11 21:12:16.563908 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:16.563689 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kkngg" podStartSLOduration=3.940093798 podStartE2EDuration="13.563672531s" totalImagesPullingTime="9.623578733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:16.563469761 +0000 UTC m=+13.635528786" watchObservedRunningTime="2026-06-11 21:12:16.563672531 +0000 UTC m=+13.635731514" Jun 11 21:12:16.579629 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:16.579588 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7k8dc" podStartSLOduration=3.898429584 podStartE2EDuration="13.579571553s" totalImagesPullingTime="9.681141969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:16.579216337 +0000 UTC m=+13.651275319" watchObservedRunningTime="2026-06-11 21:12:16.579571553 +0000 UTC m=+13.651630538" Jun 11 21:12:16.592837 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:16.592794 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-cjxnx" podStartSLOduration=3.970121447 podStartE2EDuration="13.592777087s" totalImagesPullingTime="9.62265564s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:16.592158349 +0000 UTC m=+13.664217332" watchObservedRunningTime="2026-06-11 21:12:16.592777087 +0000 UTC m=+13.664836070" Jun 11 21:12:17.391586 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:17.391498 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:17.391743 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:17.391634 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:17.391743 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:17.391640 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:17.391867 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:17.391748 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:17.391867 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:17.391813 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:17.391981 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:17.391892 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:17.548883 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:17.548847 2573 generic.go:356] "Generic (PLEG): container finished" podID="6e2338eb-2497-454a-92d9-672ce03db7df" containerID="abbbe1f3ff583be943c0a122131b55a6b4605dcf0884dae1fcbcf6709b268217" exitCode=0 Jun 11 21:12:17.549358 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:17.548989 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sshd7" event={"ID":"6e2338eb-2497-454a-92d9-672ce03db7df","Type":"ContainerDied","Data":"abbbe1f3ff583be943c0a122131b55a6b4605dcf0884dae1fcbcf6709b268217"} Jun 11 21:12:18.115223 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:18.115137 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:18.115746 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:18.115724 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:18.553548 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:18.553341 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ct8rh" event={"ID":"501998d6-4e79-4da0-bbdd-5feb942d5c0a","Type":"ContainerStarted","Data":"78c9bf605591a6cecd89ac5bc8dacda2d427f5a1ac06afa96c71d091b1196205"} Jun 11 21:12:18.569160 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:18.569116 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ct8rh" podStartSLOduration=5.912338655 podStartE2EDuration="15.569100009s" totalImagesPullingTime="9.656761354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:18.568527045 +0000 UTC m=+15.640586029" watchObservedRunningTime="2026-06-11 21:12:18.569100009 +0000 UTC m=+15.641158993" Jun 11 21:12:19.391610 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:19.391112 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:19.391610 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:19.391142 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:19.391610 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:19.391124 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:19.391610 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:19.391230 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:19.391610 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:19.391353 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:19.391610 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:19.391436 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:19.554991 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:19.554959 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 21:12:21.075584 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:21.075314 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:21.076069 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:21.075501 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:21.076069 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:21.075679 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret podName:0a107736-77c3-4fda-b030-f5adee9d83c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:37.075658843 +0000 UTC m=+34.147717809 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret") pod "global-pull-secret-syncer-qxjsz" (UID: "0a107736-77c3-4fda-b030-f5adee9d83c3") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:21.176796 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:21.176692 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:21.176954 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:21.176810 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:21.176954 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:21.176875 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs podName:d80e86ad-3e9e-4ae9-9666-8f639b3d84fc nodeName:}" failed. No retries permitted until 2026-06-11 21:12:37.17685717 +0000 UTC m=+34.248916134 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs") pod "network-metrics-daemon-fvn2h" (UID: "d80e86ad-3e9e-4ae9-9666-8f639b3d84fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:21.277972 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:21.277940 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2497\" (UniqueName: \"kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497\") pod \"network-check-target-nz67n\" (UID: \"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d\") " pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:21.278131 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:21.278076 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:12:21.278131 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:21.278093 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:12:21.278131 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:21.278103 2573 projected.go:196] Error preparing data for projected volume kube-api-access-b2497 for pod openshift-network-diagnostics/network-check-target-nz67n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:21.278244 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:21.278147 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497 podName:b5e1fcec-cd44-4d3e-aa8c-32e09be2440d nodeName:}" failed. No retries permitted until 2026-06-11 21:12:37.278135077 +0000 UTC m=+34.350194038 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2497" (UniqueName: "kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497") pod "network-check-target-nz67n" (UID: "b5e1fcec-cd44-4d3e-aa8c-32e09be2440d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:21.390923 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:21.390848 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:21.391077 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:21.390848 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:21.391077 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:21.390953 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:21.391077 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:21.390967 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:21.391077 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:21.391065 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:21.391282 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:21.391154 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:23.391620 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:23.391585 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:23.392071 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:23.391673 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:23.392071 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:23.391726 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:23.392071 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:23.391840 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:23.392071 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:23.391868 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:23.392071 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:23.391934 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:25.393531 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:25.393502 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:25.393883 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:25.393616 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:25.393971 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:25.393955 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:25.394217 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:25.394056 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:25.394217 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:25.394102 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:25.394217 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:25.394168 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:27.393516 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:27.393470 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:27.394028 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:27.393585 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:27.394028 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:27.393596 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:27.394028 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:27.393662 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:27.394028 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:27.393672 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:27.394028 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:27.393740 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:27.779473 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:27.779441 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 21:12:28.408119 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.407831 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T21:12:27.779470601Z","UUID":"e0a74926-d9e8-433b-8550-9310103d900d","Handler":null,"Name":"","Endpoint":""} Jun 11 21:12:28.409333 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.409305 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 21:12:28.409436 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.409352 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 21:12:28.572349 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.572316 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-djn25" event={"ID":"e4884252-8b16-4975-a50b-4de635e9a60a","Type":"ContainerStarted","Data":"67f13d554a7902100b4f000b4f0412a411ba7360a35dc48f59801f22d753af36"} Jun 11 21:12:28.574371 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.574347 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" event={"ID":"9719ea19-af44-4595-8ef9-0396a820b29c","Type":"ContainerStarted","Data":"0a284b32673618e519170e87935ed37ac6dc54642ac8943d26852313607b93d2"} Jun 11 21:12:28.576426 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.576407 2573 generic.go:356] "Generic (PLEG): container finished" podID="6e2338eb-2497-454a-92d9-672ce03db7df" containerID="6ca302fda1503bfa808b425aa4b5e7ba5f1fd4115580032f3f14ed8a64fde56d" exitCode=0 Jun 11 21:12:28.576522 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.576454 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sshd7" event={"ID":"6e2338eb-2497-454a-92d9-672ce03db7df","Type":"ContainerDied","Data":"6ca302fda1503bfa808b425aa4b5e7ba5f1fd4115580032f3f14ed8a64fde56d"} Jun 11 21:12:28.579515 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.579501 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/0.log" Jun 11 21:12:28.579789 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.579770 2573 generic.go:356] "Generic (PLEG): container finished" podID="19eb4850-5b28-4a9f-a0c0-cc30e5808f42" containerID="399ec7c96000235b9b970214e04b0cf532e2406ad7bcac1ac21c33e3168ef316" exitCode=1 Jun 11 21:12:28.579879 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.579798 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" event={"ID":"19eb4850-5b28-4a9f-a0c0-cc30e5808f42","Type":"ContainerStarted","Data":"5c26650e9bc5eb82e7bce58bbb61a7f87aece81c0fa8d12e5c4b76ee94236b85"} Jun 11 21:12:28.579879 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.579847 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" event={"ID":"19eb4850-5b28-4a9f-a0c0-cc30e5808f42","Type":"ContainerStarted","Data":"163f4d7c5edd719274c60d1ccbfee557e78ebab66b490492c8800ed1616140e9"} Jun 11 21:12:28.579879 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.579876 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" event={"ID":"19eb4850-5b28-4a9f-a0c0-cc30e5808f42","Type":"ContainerStarted","Data":"595c48191264571cfd917d46da3fdb27953bcbf70b38228738ab45e83aeb9e83"} Jun 11 21:12:28.579974 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.579910 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" event={"ID":"19eb4850-5b28-4a9f-a0c0-cc30e5808f42","Type":"ContainerStarted","Data":"8bfdc2a1055b67d6700ae0e1a467e0c311ac515f3dd1471b17ba2b15729ad6f6"} Jun 11 21:12:28.579974 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.579941 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" event={"ID":"19eb4850-5b28-4a9f-a0c0-cc30e5808f42","Type":"ContainerDied","Data":"399ec7c96000235b9b970214e04b0cf532e2406ad7bcac1ac21c33e3168ef316"} Jun 11 21:12:28.579974 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.579968 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" event={"ID":"19eb4850-5b28-4a9f-a0c0-cc30e5808f42","Type":"ContainerStarted","Data":"1e98a95186585657366d7cf70963e0080dd4da6a0c073b9a3e385473a3ba0b83"} Jun 11 21:12:28.588235 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:28.588166 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-djn25" podStartSLOduration=4.635907693 podStartE2EDuration="25.588148358s" totalImagesPullingTime="20.952240665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:28.587727334 +0000 UTC m=+25.659786317" watchObservedRunningTime="2026-06-11 21:12:28.588148358 +0000 UTC m=+25.660207331" Jun 11 21:12:29.391459 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:29.391432 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:29.391581 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:29.391439 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:29.391581 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:29.391567 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:29.391694 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:29.391637 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:29.391694 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:29.391677 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:29.391883 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:29.391769 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:29.583112 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:29.583086 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" event={"ID":"9719ea19-af44-4595-8ef9-0396a820b29c","Type":"ContainerStarted","Data":"44acfebae507ba90e685f1f33a60267a18192da813e05b29f65242b24a1e714d"} Jun 11 21:12:29.585124 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:29.585075 2573 generic.go:356] "Generic (PLEG): container finished" podID="6e2338eb-2497-454a-92d9-672ce03db7df" containerID="87ed18b78de7a031f5859aab8974a939a95688dae38c87d5cbeb9954e6b32029" exitCode=0 Jun 11 21:12:29.585219 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:29.585157 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sshd7" event={"ID":"6e2338eb-2497-454a-92d9-672ce03db7df","Type":"ContainerDied","Data":"87ed18b78de7a031f5859aab8974a939a95688dae38c87d5cbeb9954e6b32029"} Jun 11 21:12:29.600253 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:29.600215 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jxxkj" podStartSLOduration=4.836310978 podStartE2EDuration="26.600204269s" totalImagesPullingTime="21.763893291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:29.59983233 +0000 UTC m=+26.671891311" watchObservedRunningTime="2026-06-11 21:12:29.600204269 +0000 UTC m=+26.672263251" Jun 11 21:12:30.589269 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:30.589205 2573 generic.go:356] "Generic (PLEG): container finished" podID="6e2338eb-2497-454a-92d9-672ce03db7df" containerID="9ece171d72a5ac002d629b0ebb98d1678d8ba50633388ffb5cbb33233f489f0a" exitCode=0 Jun 11 21:12:30.589654 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:30.589292 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sshd7" event={"ID":"6e2338eb-2497-454a-92d9-672ce03db7df","Type":"ContainerDied","Data":"9ece171d72a5ac002d629b0ebb98d1678d8ba50633388ffb5cbb33233f489f0a"} Jun 11 21:12:30.592635 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:30.592614 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/0.log" Jun 11 21:12:30.593102 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:30.593083 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" event={"ID":"19eb4850-5b28-4a9f-a0c0-cc30e5808f42","Type":"ContainerStarted","Data":"af6f9a97e1dd7ac3180344da70db472c56982ac503b946936264868fd5ffe62f"} Jun 11 21:12:31.391102 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:31.391072 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:31.391102 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:31.391089 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:31.391304 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:31.391176 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:31.391304 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:31.391251 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:31.391304 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:31.391273 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:31.391436 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:31.391371 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:32.601905 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:32.601698 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/0.log" Jun 11 21:12:32.602310 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:32.602205 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" event={"ID":"19eb4850-5b28-4a9f-a0c0-cc30e5808f42","Type":"ContainerStarted","Data":"20bb65fafd636cf2af52aba3a628728a4c1b9d5a0007f112990f00cedea03dff"} Jun 11 21:12:32.602640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:32.602606 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:32.602761 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:32.602735 2573 scope.go:117] "RemoveContainer" containerID="399ec7c96000235b9b970214e04b0cf532e2406ad7bcac1ac21c33e3168ef316" Jun 11 21:12:32.620963 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:32.620942 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:33.392267 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:33.392229 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:33.392478 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:33.392306 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:33.392478 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:33.392346 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:33.392478 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:33.392376 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:33.392478 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:33.392402 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:33.392740 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:33.392502 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:33.625889 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:33.623315 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/0.log" Jun 11 21:12:33.628469 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:33.627601 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" event={"ID":"19eb4850-5b28-4a9f-a0c0-cc30e5808f42","Type":"ContainerStarted","Data":"72abf05999ed212f0b18498d826c41963e353e21868ade3595d538280877d8e0"} Jun 11 21:12:33.629143 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:33.628825 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:33.629143 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:33.628910 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:33.646497 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:33.646405 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:12:33.698407 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:33.698363 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" podStartSLOduration=9.747651641000001 podStartE2EDuration="30.698349578s" totalImagesPullingTime="20.950697937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:33.661058594 +0000 UTC m=+30.733117602" watchObservedRunningTime="2026-06-11 21:12:33.698349578 +0000 UTC m=+30.770408574" Jun 11 21:12:34.336741 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:34.336711 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nz67n"] Jun 11 21:12:34.336890 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:34.336809 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:34.336890 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:34.336881 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:34.342509 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:34.342473 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qxjsz"] Jun 11 21:12:34.342618 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:34.342561 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:34.342666 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:34.342637 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:34.345703 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:34.345684 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fvn2h"] Jun 11 21:12:34.345784 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:34.345760 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:34.345860 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:34.345834 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:35.238104 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:35.238068 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:35.238562 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:35.238244 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 11 21:12:35.238738 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:35.238661 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kkngg" Jun 11 21:12:36.391278 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:36.391241 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:36.391278 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:36.391272 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:36.391807 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:36.391249 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:36.391807 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:36.391416 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:36.391807 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:36.391511 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:36.391807 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:36.391568 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:37.104591 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:37.104360 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:37.104761 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:37.104519 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:37.104761 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:37.104716 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret podName:0a107736-77c3-4fda-b030-f5adee9d83c3 nodeName:}" failed. No retries permitted until 2026-06-11 21:13:09.104692061 +0000 UTC m=+66.176751042 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret") pod "global-pull-secret-syncer-qxjsz" (UID: "0a107736-77c3-4fda-b030-f5adee9d83c3") : object "kube-system"/"original-pull-secret" not registered Jun 11 21:12:37.205409 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:37.205308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:37.205564 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:37.205471 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:37.205564 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:37.205549 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs podName:d80e86ad-3e9e-4ae9-9666-8f639b3d84fc nodeName:}" failed. No retries permitted until 2026-06-11 21:13:09.205528371 +0000 UTC m=+66.277587356 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs") pod "network-metrics-daemon-fvn2h" (UID: "d80e86ad-3e9e-4ae9-9666-8f639b3d84fc") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 21:12:37.305903 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:37.305864 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2497\" (UniqueName: \"kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497\") pod \"network-check-target-nz67n\" (UID: \"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d\") " pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:37.306072 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:37.306016 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 21:12:37.306072 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:37.306039 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 21:12:37.306072 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:37.306052 2573 projected.go:196] Error preparing data for projected volume kube-api-access-b2497 for pod openshift-network-diagnostics/network-check-target-nz67n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:37.306227 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:37.306110 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497 podName:b5e1fcec-cd44-4d3e-aa8c-32e09be2440d nodeName:}" failed. No retries permitted until 2026-06-11 21:13:09.306092169 +0000 UTC m=+66.378151130 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b2497" (UniqueName: "kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497") pod "network-check-target-nz67n" (UID: "b5e1fcec-cd44-4d3e-aa8c-32e09be2440d") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 21:12:38.391233 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:38.391172 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:38.391752 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:38.391273 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:38.391752 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:38.391277 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nz67n" podUID="b5e1fcec-cd44-4d3e-aa8c-32e09be2440d" Jun 11 21:12:38.391752 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:38.391298 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:38.391752 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:38.391410 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:12:38.391752 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:38.391510 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qxjsz" podUID="0a107736-77c3-4fda-b030-f5adee9d83c3" Jun 11 21:12:38.641313 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:38.641240 2573 generic.go:356] "Generic (PLEG): container finished" podID="6e2338eb-2497-454a-92d9-672ce03db7df" containerID="1f21c2a90c99c18ec63486d66d206d6f1acbe924e32cdb2a2d44c6dc21872336" exitCode=0 Jun 11 21:12:38.641313 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:38.641304 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sshd7" event={"ID":"6e2338eb-2497-454a-92d9-672ce03db7df","Type":"ContainerDied","Data":"1f21c2a90c99c18ec63486d66d206d6f1acbe924e32cdb2a2d44c6dc21872336"} Jun 11 21:12:39.646059 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:39.646032 2573 generic.go:356] "Generic (PLEG): container finished" podID="6e2338eb-2497-454a-92d9-672ce03db7df" containerID="c84b246bd64b49d1d5fddf70bc3ff45946b4c6331b356ab859e167dc9c901f30" exitCode=0 Jun 11 21:12:39.646534 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:39.646081 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sshd7" event={"ID":"6e2338eb-2497-454a-92d9-672ce03db7df","Type":"ContainerDied","Data":"c84b246bd64b49d1d5fddf70bc3ff45946b4c6331b356ab859e167dc9c901f30"} Jun 11 21:12:40.262921 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.262864 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-28.ec2.internal" event="NodeReady" Jun 11 21:12:40.263017 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.262966 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 21:12:40.295072 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.295037 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg"] Jun 11 21:12:40.297262 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.297245 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" Jun 11 21:12:40.298694 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.298674 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7869b7bb9c-qxgz5"] Jun 11 21:12:40.299650 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.299633 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-pcqtj\"" Jun 11 21:12:40.299841 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.299824 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 21:12:40.299841 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.299835 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 11 21:12:40.300013 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.299835 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 21:12:40.300013 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.299933 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 21:12:40.303400 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.303380 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5"] Jun 11 21:12:40.303578 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.303558 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.305522 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.305506 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8"] Jun 11 21:12:40.305615 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.305547 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:40.306224 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.306109 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-82hkw\"" Jun 11 21:12:40.306224 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.306117 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 21:12:40.306224 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.306149 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 21:12:40.306224 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.306202 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 21:12:40.308130 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.307964 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.308686 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.308668 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 21:12:40.309617 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.309601 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg"] Jun 11 21:12:40.310854 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.310838 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 21:12:40.310934 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.310853 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 21:12:40.311069 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.311052 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 21:12:40.311387 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.311372 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 21:12:40.311463 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.311410 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 21:12:40.317724 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.317706 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-bnkjs"] Jun 11 21:12:40.320006 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.319987 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5"] Jun 11 21:12:40.320143 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.320090 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bnkjs" Jun 11 21:12:40.322576 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.322513 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8"] Jun 11 21:12:40.322837 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.322819 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-n4ctv\"" Jun 11 21:12:40.323189 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.323170 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 21:12:40.323295 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.323192 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 21:12:40.323295 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.323197 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 21:12:40.323413 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.323306 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7869b7bb9c-qxgz5"] Jun 11 21:12:40.324122 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.324090 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-flfvn"] Jun 11 21:12:40.326354 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.326312 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.328387 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.328368 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 21:12:40.328549 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.328533 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mkdsh\"" Jun 11 21:12:40.328651 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.328633 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 21:12:40.331680 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.331658 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bnkjs"] Jun 11 21:12:40.335740 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.335720 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-flfvn"] Jun 11 21:12:40.390587 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.390569 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:12:40.390672 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.390569 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:12:40.390751 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.390575 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:12:40.392917 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.392896 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kmmbr\"" Jun 11 21:12:40.392993 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.392906 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:12:40.393047 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.393022 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:12:40.393099 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.393071 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-twb7l\"" Jun 11 21:12:40.393406 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.393390 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:12:40.393925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.393910 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:12:40.428683 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428661 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-image-registry-private-configuration\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.428769 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428688 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.428769 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428707 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8445994-0fd5-4dd8-8971-5103c5431127-config-volume\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.428769 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428722 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs8dh\" (UniqueName: \"kubernetes.io/projected/e8445994-0fd5-4dd8-8971-5103c5431127-kube-api-access-gs8dh\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.428890 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00dc8383-d3ff-4f95-88ab-bc09c5e5f001-cert\") pod \"ingress-canary-bnkjs\" (UID: \"00dc8383-d3ff-4f95-88ab-bc09c5e5f001\") " pod="openshift-ingress-canary/ingress-canary-bnkjs" Jun 11 21:12:40.428890 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428810 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62-klusterlet-config\") pod \"klusterlet-addon-workmgr-6576b7fc45-8rpl5\" (UID: \"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:40.428890 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428827 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-bound-sa-token\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.428890 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428842 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv2s6\" (UniqueName: \"kubernetes.io/projected/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-kube-api-access-rv2s6\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.428890 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428874 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgpbz\" (UniqueName: \"kubernetes.io/projected/57c6a03e-75f5-4fb8-a604-763c110f886d-kube-api-access-bgpbz\") pod \"managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg\" (UID: \"57c6a03e-75f5-4fb8-a604-763c110f886d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" Jun 11 21:12:40.429121 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428906 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-registry-certificates\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.429121 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62-tmp\") pod \"klusterlet-addon-workmgr-6576b7fc45-8rpl5\" (UID: \"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:40.429121 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.428997 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57c6a03e-75f5-4fb8-a604-763c110f886d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg\" (UID: \"57c6a03e-75f5-4fb8-a604-763c110f886d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" Jun 11 21:12:40.429121 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429028 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-installation-pull-secrets\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.429121 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429053 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.429121 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429078 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8445994-0fd5-4dd8-8971-5103c5431127-tmp-dir\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.429343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429123 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32f7838f-4008-44ee-a983-f802235cc073-ca-trust-extracted\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.429343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429144 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxrjh\" (UniqueName: \"kubernetes.io/projected/86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62-kube-api-access-wxrjh\") pod \"klusterlet-addon-workmgr-6576b7fc45-8rpl5\" (UID: \"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:40.429343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429162 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kntx6\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-kube-api-access-kntx6\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.429343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429184 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-hub\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.429343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-ca\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.429343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429216 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.429343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429235 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rk2td\" (UniqueName: \"kubernetes.io/projected/00dc8383-d3ff-4f95-88ab-bc09c5e5f001-kube-api-access-rk2td\") pod \"ingress-canary-bnkjs\" (UID: \"00dc8383-d3ff-4f95-88ab-bc09c5e5f001\") " pod="openshift-ingress-canary/ingress-canary-bnkjs" Jun 11 21:12:40.429343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429255 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.429343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429272 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.429343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.429307 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-trusted-ca\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.444663 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.444638 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:40.517377 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.517283 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:40.530309 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530291 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32f7838f-4008-44ee-a983-f802235cc073-ca-trust-extracted\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.530365 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530317 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxrjh\" (UniqueName: \"kubernetes.io/projected/86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62-kube-api-access-wxrjh\") pod \"klusterlet-addon-workmgr-6576b7fc45-8rpl5\" (UID: \"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:40.530365 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kntx6\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-kube-api-access-kntx6\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.530365 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530349 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-hub\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.530526 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530478 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-ca\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.530597 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530541 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.530597 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530576 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rk2td\" (UniqueName: \"kubernetes.io/projected/00dc8383-d3ff-4f95-88ab-bc09c5e5f001-kube-api-access-rk2td\") pod \"ingress-canary-bnkjs\" (UID: \"00dc8383-d3ff-4f95-88ab-bc09c5e5f001\") " pod="openshift-ingress-canary/ingress-canary-bnkjs" Jun 11 21:12:40.530694 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530602 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.530694 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530627 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.530694 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530653 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-trusted-ca\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.530821 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530692 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-image-registry-private-configuration\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.530821 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.530821 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530753 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8445994-0fd5-4dd8-8971-5103c5431127-config-volume\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.530821 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs8dh\" (UniqueName: \"kubernetes.io/projected/e8445994-0fd5-4dd8-8971-5103c5431127-kube-api-access-gs8dh\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.530821 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530820 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00dc8383-d3ff-4f95-88ab-bc09c5e5f001-cert\") pod \"ingress-canary-bnkjs\" (UID: \"00dc8383-d3ff-4f95-88ab-bc09c5e5f001\") " pod="openshift-ingress-canary/ingress-canary-bnkjs" Jun 11 21:12:40.531048 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62-klusterlet-config\") pod \"klusterlet-addon-workmgr-6576b7fc45-8rpl5\" (UID: \"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:40.531048 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-bound-sa-token\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.531048 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:40.530894 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:12:40.531048 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:40.530911 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b7bb9c-qxgz5: secret "image-registry-tls" not found Jun 11 21:12:40.531048 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:40.530959 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls podName:32f7838f-4008-44ee-a983-f802235cc073 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:41.0309424 +0000 UTC m=+38.103001376 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls") pod "image-registry-7869b7bb9c-qxgz5" (UID: "32f7838f-4008-44ee-a983-f802235cc073") : secret "image-registry-tls" not found Jun 11 21:12:40.531267 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530897 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv2s6\" (UniqueName: \"kubernetes.io/projected/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-kube-api-access-rv2s6\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.531267 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.531125 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgpbz\" (UniqueName: \"kubernetes.io/projected/57c6a03e-75f5-4fb8-a604-763c110f886d-kube-api-access-bgpbz\") pod \"managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg\" (UID: \"57c6a03e-75f5-4fb8-a604-763c110f886d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" Jun 11 21:12:40.531383 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:40.530664 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:12:40.531534 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:40.531516 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls podName:e8445994-0fd5-4dd8-8971-5103c5431127 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:41.031479742 +0000 UTC m=+38.103538710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls") pod "dns-default-flfvn" (UID: "e8445994-0fd5-4dd8-8971-5103c5431127") : secret "dns-default-metrics-tls" not found Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.531845 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-trusted-ca\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.531941 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.530817 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32f7838f-4008-44ee-a983-f802235cc073-ca-trust-extracted\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.532016 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-registry-certificates\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.532053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62-tmp\") pod \"klusterlet-addon-workmgr-6576b7fc45-8rpl5\" (UID: \"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.532081 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57c6a03e-75f5-4fb8-a604-763c110f886d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg\" (UID: \"57c6a03e-75f5-4fb8-a604-763c110f886d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.532108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-installation-pull-secrets\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.532132 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.532156 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8445994-0fd5-4dd8-8971-5103c5431127-tmp-dir\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.532383 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e8445994-0fd5-4dd8-8971-5103c5431127-config-volume\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.532416 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8445994-0fd5-4dd8-8971-5103c5431127-tmp-dir\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.532583 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-registry-certificates\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.533669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.532783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62-tmp\") pod \"klusterlet-addon-workmgr-6576b7fc45-8rpl5\" (UID: \"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:40.535369 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.535318 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-ca\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.535497 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.535438 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62-klusterlet-config\") pod \"klusterlet-addon-workmgr-6576b7fc45-8rpl5\" (UID: \"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:40.535567 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.535472 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-image-registry-private-configuration\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.535619 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.535584 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00dc8383-d3ff-4f95-88ab-bc09c5e5f001-cert\") pod \"ingress-canary-bnkjs\" (UID: \"00dc8383-d3ff-4f95-88ab-bc09c5e5f001\") " pod="openshift-ingress-canary/ingress-canary-bnkjs" Jun 11 21:12:40.535811 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.535793 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.535896 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.535854 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-installation-pull-secrets\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.536190 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.536168 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-hub\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.536859 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.536833 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.537147 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.537123 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/57c6a03e-75f5-4fb8-a604-763c110f886d-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg\" (UID: \"57c6a03e-75f5-4fb8-a604-763c110f886d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" Jun 11 21:12:40.538991 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.538973 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rk2td\" (UniqueName: \"kubernetes.io/projected/00dc8383-d3ff-4f95-88ab-bc09c5e5f001-kube-api-access-rk2td\") pod \"ingress-canary-bnkjs\" (UID: \"00dc8383-d3ff-4f95-88ab-bc09c5e5f001\") " pod="openshift-ingress-canary/ingress-canary-bnkjs" Jun 11 21:12:40.539166 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.539149 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs8dh\" (UniqueName: \"kubernetes.io/projected/e8445994-0fd5-4dd8-8971-5103c5431127-kube-api-access-gs8dh\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:40.539510 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.539471 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kntx6\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-kube-api-access-kntx6\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.540076 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.540059 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxrjh\" (UniqueName: \"kubernetes.io/projected/86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62-kube-api-access-wxrjh\") pod \"klusterlet-addon-workmgr-6576b7fc45-8rpl5\" (UID: \"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:40.540207 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.540192 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv2s6\" (UniqueName: \"kubernetes.io/projected/7181fec5-7a0b-4a7f-bc42-da3b72096ba4-kube-api-access-rv2s6\") pod \"cluster-proxy-proxy-agent-6856569648-f8hg8\" (UID: \"7181fec5-7a0b-4a7f-bc42-da3b72096ba4\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.542866 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.542847 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-bound-sa-token\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:40.544892 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.544869 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgpbz\" (UniqueName: \"kubernetes.io/projected/57c6a03e-75f5-4fb8-a604-763c110f886d-kube-api-access-bgpbz\") pod \"managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg\" (UID: \"57c6a03e-75f5-4fb8-a604-763c110f886d\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" Jun 11 21:12:40.615511 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.615477 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" Jun 11 21:12:40.630684 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.630662 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:40.637304 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.637285 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:12:40.653194 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.653165 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sshd7" event={"ID":"6e2338eb-2497-454a-92d9-672ce03db7df","Type":"ContainerStarted","Data":"7f1024334a09ce5a54e0582cd878d48f09912915bbc48f95daf1d21d3c5f37e2"} Jun 11 21:12:40.657025 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.656998 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-bnkjs" Jun 11 21:12:40.662839 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.662817 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:40.675404 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.675354 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sshd7" podStartSLOduration=8.112215662 podStartE2EDuration="37.675334401s" totalImagesPullingTime="29.563118739s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:40.674855657 +0000 UTC m=+37.746914675" watchObservedRunningTime="2026-06-11 21:12:40.675334401 +0000 UTC m=+37.747393384" Jun 11 21:12:40.767916 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.767368 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:40.798687 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.798659 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5"] Jun 11 21:12:40.803755 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:40.803633 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86e23d9e_1bdc_4f6a_bc92_fcadc42a0a62.slice/crio-126ee8ef93ec5871493120524d8710925c7f8bfb95623adaa7413aee268b5dab WatchSource:0}: Error finding container 126ee8ef93ec5871493120524d8710925c7f8bfb95623adaa7413aee268b5dab: Status 404 returned error can't find the container with id 126ee8ef93ec5871493120524d8710925c7f8bfb95623adaa7413aee268b5dab Jun 11 21:12:40.813936 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.813910 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg"] Jun 11 21:12:40.816750 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:40.816723 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod57c6a03e_75f5_4fb8_a604_763c110f886d.slice/crio-e2e288ed4634af5f88dccde7d8cfbca719b17d060d1cfa0c138bf92f8e10ce44 WatchSource:0}: Error finding container e2e288ed4634af5f88dccde7d8cfbca719b17d060d1cfa0c138bf92f8e10ce44: Status 404 returned error can't find the container with id e2e288ed4634af5f88dccde7d8cfbca719b17d060d1cfa0c138bf92f8e10ce44 Jun 11 21:12:40.818803 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.818785 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8"] Jun 11 21:12:40.822496 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:40.822465 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7181fec5_7a0b_4a7f_bc42_da3b72096ba4.slice/crio-3ff122085d7412f65595dc8f13bd6e8a39115eb4730fe7aa3d81f6a5bb33c0cb WatchSource:0}: Error finding container 3ff122085d7412f65595dc8f13bd6e8a39115eb4730fe7aa3d81f6a5bb33c0cb: Status 404 returned error can't find the container with id 3ff122085d7412f65595dc8f13bd6e8a39115eb4730fe7aa3d81f6a5bb33c0cb Jun 11 21:12:40.839056 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.839036 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-bnkjs"] Jun 11 21:12:40.841789 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:12:40.841770 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00dc8383_d3ff_4f95_88ab_bc09c5e5f001.slice/crio-7255de04a6d6092a8d67f8cd51f0377dd7668a53aec54c7b13aaa6c0ce800db8 WatchSource:0}: Error finding container 7255de04a6d6092a8d67f8cd51f0377dd7668a53aec54c7b13aaa6c0ce800db8: Status 404 returned error can't find the container with id 7255de04a6d6092a8d67f8cd51f0377dd7668a53aec54c7b13aaa6c0ce800db8 Jun 11 21:12:40.875369 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.875347 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:40.926143 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:40.926121 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:41.041073 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:41.041024 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:41.041073 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:41.041053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:41.041180 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:41.041164 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:12:41.041219 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:41.041205 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:12:41.041219 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:41.041215 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b7bb9c-qxgz5: secret "image-registry-tls" not found Jun 11 21:12:41.041276 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:41.041216 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls podName:e8445994-0fd5-4dd8-8971-5103c5431127 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:42.041201644 +0000 UTC m=+39.113260606 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls") pod "dns-default-flfvn" (UID: "e8445994-0fd5-4dd8-8971-5103c5431127") : secret "dns-default-metrics-tls" not found Jun 11 21:12:41.041276 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:41.041254 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls podName:32f7838f-4008-44ee-a983-f802235cc073 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:42.041244031 +0000 UTC m=+39.113302990 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls") pod "image-registry-7869b7bb9c-qxgz5" (UID: "32f7838f-4008-44ee-a983-f802235cc073") : secret "image-registry-tls" not found Jun 11 21:12:41.666199 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:41.666165 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" event={"ID":"57c6a03e-75f5-4fb8-a604-763c110f886d","Type":"ContainerStarted","Data":"e2e288ed4634af5f88dccde7d8cfbca719b17d060d1cfa0c138bf92f8e10ce44"} Jun 11 21:12:41.670903 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:41.670805 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" event={"ID":"7181fec5-7a0b-4a7f-bc42-da3b72096ba4","Type":"ContainerStarted","Data":"3ff122085d7412f65595dc8f13bd6e8a39115eb4730fe7aa3d81f6a5bb33c0cb"} Jun 11 21:12:41.674032 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:41.673909 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" event={"ID":"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62","Type":"ContainerStarted","Data":"126ee8ef93ec5871493120524d8710925c7f8bfb95623adaa7413aee268b5dab"} Jun 11 21:12:41.678241 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:41.678126 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bnkjs" event={"ID":"00dc8383-d3ff-4f95-88ab-bc09c5e5f001","Type":"ContainerStarted","Data":"7255de04a6d6092a8d67f8cd51f0377dd7668a53aec54c7b13aaa6c0ce800db8"} Jun 11 21:12:42.048334 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:42.047375 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:42.048334 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:42.047430 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:42.048334 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:42.047611 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:12:42.048334 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:42.047627 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b7bb9c-qxgz5: secret "image-registry-tls" not found Jun 11 21:12:42.048334 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:42.047686 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls podName:32f7838f-4008-44ee-a983-f802235cc073 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:44.047667272 +0000 UTC m=+41.119726247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls") pod "image-registry-7869b7bb9c-qxgz5" (UID: "32f7838f-4008-44ee-a983-f802235cc073") : secret "image-registry-tls" not found Jun 11 21:12:42.048334 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:42.048176 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:12:42.048334 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:42.048294 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls podName:e8445994-0fd5-4dd8-8971-5103c5431127 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:44.048276688 +0000 UTC m=+41.120335648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls") pod "dns-default-flfvn" (UID: "e8445994-0fd5-4dd8-8971-5103c5431127") : secret "dns-default-metrics-tls" not found Jun 11 21:12:44.065838 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:44.065800 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:44.066250 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:44.065851 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:44.066250 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:44.065970 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:12:44.066250 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:44.065978 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:12:44.066250 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:44.066069 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls podName:e8445994-0fd5-4dd8-8971-5103c5431127 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:48.06604768 +0000 UTC m=+45.138106654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls") pod "dns-default-flfvn" (UID: "e8445994-0fd5-4dd8-8971-5103c5431127") : secret "dns-default-metrics-tls" not found Jun 11 21:12:44.066250 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:44.065986 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b7bb9c-qxgz5: secret "image-registry-tls" not found Jun 11 21:12:44.066250 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:44.066197 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls podName:32f7838f-4008-44ee-a983-f802235cc073 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:48.066178649 +0000 UTC m=+45.138237622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls") pod "image-registry-7869b7bb9c-qxgz5" (UID: "32f7838f-4008-44ee-a983-f802235cc073") : secret "image-registry-tls" not found Jun 11 21:12:47.670828 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:47.670794 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:48.097672 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.097642 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:48.097810 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.097736 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:48.097810 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:48.097749 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:12:48.097810 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:48.097768 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b7bb9c-qxgz5: secret "image-registry-tls" not found Jun 11 21:12:48.097964 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:48.097822 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls podName:32f7838f-4008-44ee-a983-f802235cc073 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:56.097804036 +0000 UTC m=+53.169862998 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls") pod "image-registry-7869b7bb9c-qxgz5" (UID: "32f7838f-4008-44ee-a983-f802235cc073") : secret "image-registry-tls" not found Jun 11 21:12:48.097964 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:48.097827 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:12:48.097964 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:48.097865 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls podName:e8445994-0fd5-4dd8-8971-5103c5431127 nodeName:}" failed. No retries permitted until 2026-06-11 21:12:56.097853758 +0000 UTC m=+53.169912737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls") pod "dns-default-flfvn" (UID: "e8445994-0fd5-4dd8-8971-5103c5431127") : secret "dns-default-metrics-tls" not found Jun 11 21:12:48.698365 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.698278 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" event={"ID":"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62","Type":"ContainerStarted","Data":"f57fb0b69a7d14766f865cd6b973ccc57d03ea554e00d7f496452f8a7fdae1d7"} Jun 11 21:12:48.699111 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.698385 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:48.700050 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.700020 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-bnkjs" event={"ID":"00dc8383-d3ff-4f95-88ab-bc09c5e5f001","Type":"ContainerStarted","Data":"06590bf1d759f6e9e95d45d50e2d559d73dc886cf00a72234bf828bcb883db7b"} Jun 11 21:12:48.700554 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.700531 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:12:48.701549 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.701514 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" event={"ID":"57c6a03e-75f5-4fb8-a604-763c110f886d","Type":"ContainerStarted","Data":"c16057eb31ccd681764ab61c9480ee5065225b5a0be5c72ba1b2be2fe07403ea"} Jun 11 21:12:48.703537 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.703512 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" event={"ID":"7181fec5-7a0b-4a7f-bc42-da3b72096ba4","Type":"ContainerStarted","Data":"fe2ee9148a584a81209aca154fa4ab35003804fa3c35c169709b7a743c0cbd4a"} Jun 11 21:12:48.703651 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.703550 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" event={"ID":"7181fec5-7a0b-4a7f-bc42-da3b72096ba4","Type":"ContainerStarted","Data":"5276f14d916c3a5e2c29a1a309dbde2dd4c85f6ecfc78f34cdc78bd0a70dd3cb"} Jun 11 21:12:48.703651 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.703568 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" event={"ID":"7181fec5-7a0b-4a7f-bc42-da3b72096ba4","Type":"ContainerStarted","Data":"c7deb4158f370ae54162c215806c779bb4e8f260e4eac12ad311c835ec70a263"} Jun 11 21:12:48.714190 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.714150 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" podStartSLOduration=13.525530411 podStartE2EDuration="20.714138894s" totalImagesPullingTime="7.188608483s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:48.713643688 +0000 UTC m=+45.785702671" watchObservedRunningTime="2026-06-11 21:12:48.714138894 +0000 UTC m=+45.786197854" Jun 11 21:12:48.727853 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.727813 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-bnkjs" podStartSLOduration=1.595224896 podStartE2EDuration="8.727804961s" totalImagesPullingTime="7.132580065s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:48.726786021 +0000 UTC m=+45.798845003" watchObservedRunningTime="2026-06-11 21:12:48.727804961 +0000 UTC m=+45.799863920" Jun 11 21:12:48.760651 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.760615 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" podStartSLOduration=13.586600098 podStartE2EDuration="20.760603643s" totalImagesPullingTime="7.174003545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:48.759449446 +0000 UTC m=+45.831508425" watchObservedRunningTime="2026-06-11 21:12:48.760603643 +0000 UTC m=+45.832662624" Jun 11 21:12:48.774161 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:48.774129 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" podStartSLOduration=13.61854312 podStartE2EDuration="20.774117996s" totalImagesPullingTime="7.155574876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:12:48.773884212 +0000 UTC m=+45.845943194" watchObservedRunningTime="2026-06-11 21:12:48.774117996 +0000 UTC m=+45.846176978" Jun 11 21:12:50.290120 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:50.290075 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:53.229639 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:53.229603 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:54.660167 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:54.660136 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:54.757780 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:54.757752 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:54.957800 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:54.957731 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:55.057964 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:55.057925 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:55.157390 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:55.157370 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:55.660360 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:55.660335 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:55.760363 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:55.760341 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:55.999186 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:55.999161 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:56.044217 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:56.044194 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:12:56.152999 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:56.152975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:12:56.153087 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:56.153021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:12:56.153135 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:56.153116 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:12:56.153178 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:56.153140 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:12:56.153178 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:56.153151 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b7bb9c-qxgz5: secret "image-registry-tls" not found Jun 11 21:12:56.153256 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:56.153182 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls podName:e8445994-0fd5-4dd8-8971-5103c5431127 nodeName:}" failed. No retries permitted until 2026-06-11 21:13:12.153167852 +0000 UTC m=+69.225226812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls") pod "dns-default-flfvn" (UID: "e8445994-0fd5-4dd8-8971-5103c5431127") : secret "dns-default-metrics-tls" not found Jun 11 21:12:56.153256 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:12:56.153197 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls podName:32f7838f-4008-44ee-a983-f802235cc073 nodeName:}" failed. No retries permitted until 2026-06-11 21:13:12.153190853 +0000 UTC m=+69.225249812 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls") pod "image-registry-7869b7bb9c-qxgz5" (UID: "32f7838f-4008-44ee-a983-f802235cc073") : secret "image-registry-tls" not found Jun 11 21:12:58.826073 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:12:58.826042 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:05.643281 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:05.643248 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-x2kcd" Jun 11 21:13:05.788243 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:05.788209 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:05.833303 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:05.833279 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:07.860234 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:07.860203 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:07.921420 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:07.921377 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:09.150781 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.150747 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:13:09.153441 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.153419 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 21:13:09.165452 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.165422 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0a107736-77c3-4fda-b030-f5adee9d83c3-original-pull-secret\") pod \"global-pull-secret-syncer-qxjsz\" (UID: \"0a107736-77c3-4fda-b030-f5adee9d83c3\") " pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:13:09.199990 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.199968 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qxjsz" Jun 11 21:13:09.251628 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.251555 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:13:09.254268 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.254246 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 21:13:09.262317 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:09.262295 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:13:09.262426 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:09.262415 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs podName:d80e86ad-3e9e-4ae9-9666-8f639b3d84fc nodeName:}" failed. No retries permitted until 2026-06-11 21:14:13.262375609 +0000 UTC m=+130.334434571 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs") pod "network-metrics-daemon-fvn2h" (UID: "d80e86ad-3e9e-4ae9-9666-8f639b3d84fc") : secret "metrics-daemon-secret" not found Jun 11 21:13:09.320853 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.320822 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qxjsz"] Jun 11 21:13:09.323813 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:13:09.323791 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a107736_77c3_4fda_b030_f5adee9d83c3.slice/crio-b70fb7c5a4fa177ef4245323568d5bb38f2d350ddf9f8e2f292ecb7b7f360403 WatchSource:0}: Error finding container b70fb7c5a4fa177ef4245323568d5bb38f2d350ddf9f8e2f292ecb7b7f360403: Status 404 returned error can't find the container with id b70fb7c5a4fa177ef4245323568d5bb38f2d350ddf9f8e2f292ecb7b7f360403 Jun 11 21:13:09.352589 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.352562 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2497\" (UniqueName: \"kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497\") pod \"network-check-target-nz67n\" (UID: \"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d\") " pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:13:09.355093 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.355076 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 21:13:09.365008 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.364991 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 21:13:09.376159 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.376139 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2497\" (UniqueName: \"kubernetes.io/projected/b5e1fcec-cd44-4d3e-aa8c-32e09be2440d-kube-api-access-b2497\") pod \"network-check-target-nz67n\" (UID: \"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d\") " pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:13:09.513460 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.513440 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-twb7l\"" Jun 11 21:13:09.521544 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.521528 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:13:09.674915 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.674888 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nz67n"] Jun 11 21:13:09.677469 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:13:09.677443 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e1fcec_cd44_4d3e_aa8c_32e09be2440d.slice/crio-b2df56fe47a97e3241c6456151888e78e42c4c4926517c18685329c126f2f683 WatchSource:0}: Error finding container b2df56fe47a97e3241c6456151888e78e42c4c4926517c18685329c126f2f683: Status 404 returned error can't find the container with id b2df56fe47a97e3241c6456151888e78e42c4c4926517c18685329c126f2f683 Jun 11 21:13:09.764829 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.764765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nz67n" event={"ID":"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d","Type":"ContainerStarted","Data":"b2df56fe47a97e3241c6456151888e78e42c4c4926517c18685329c126f2f683"} Jun 11 21:13:09.765749 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:09.765728 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qxjsz" event={"ID":"0a107736-77c3-4fda-b030-f5adee9d83c3","Type":"ContainerStarted","Data":"b70fb7c5a4fa177ef4245323568d5bb38f2d350ddf9f8e2f292ecb7b7f360403"} Jun 11 21:13:12.174252 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:12.174215 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:13:12.174764 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:12.174274 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:13:12.174764 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:12.174329 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:13:12.174764 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:12.174399 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls podName:e8445994-0fd5-4dd8-8971-5103c5431127 nodeName:}" failed. No retries permitted until 2026-06-11 21:13:44.174380764 +0000 UTC m=+101.246439728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls") pod "dns-default-flfvn" (UID: "e8445994-0fd5-4dd8-8971-5103c5431127") : secret "dns-default-metrics-tls" not found Jun 11 21:13:12.174764 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:12.174415 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:13:12.174764 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:12.174432 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b7bb9c-qxgz5: secret "image-registry-tls" not found Jun 11 21:13:12.174764 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:12.174501 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls podName:32f7838f-4008-44ee-a983-f802235cc073 nodeName:}" failed. No retries permitted until 2026-06-11 21:13:44.174464698 +0000 UTC m=+101.246523661 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls") pod "image-registry-7869b7bb9c-qxgz5" (UID: "32f7838f-4008-44ee-a983-f802235cc073") : secret "image-registry-tls" not found Jun 11 21:13:13.069913 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:13.069880 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:13.171623 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:13.171593 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:13.783313 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:13.783254 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nz67n" event={"ID":"b5e1fcec-cd44-4d3e-aa8c-32e09be2440d","Type":"ContainerStarted","Data":"394a304366b5e43a9b23dd9622661e82c37a920b696e1c6b000583a1a44ed4c6"} Jun 11 21:13:13.783767 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:13.783377 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:13:13.799521 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:13.799446 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nz67n" podStartSLOduration=67.260898123 podStartE2EDuration="1m10.799429625s" totalImagesPullingTime="3.538531502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:13:13.799155849 +0000 UTC m=+70.871214832" watchObservedRunningTime="2026-06-11 21:13:13.799429625 +0000 UTC m=+70.871488605" Jun 11 21:13:14.638672 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:14.638639 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:14.688500 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:14.688453 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:15.084691 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:15.084667 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:15.140146 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:15.140117 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:15.790677 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:15.790642 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qxjsz" event={"ID":"0a107736-77c3-4fda-b030-f5adee9d83c3","Type":"ContainerStarted","Data":"e884c8df03addcc972a28418ecf355047b59f51eb55ce6025e946ffbc199041e"} Jun 11 21:13:15.805448 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:15.805402 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qxjsz" podStartSLOduration=67.185087267 podStartE2EDuration="1m12.80538689s" totalImagesPullingTime="5.620299623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:13:15.804345546 +0000 UTC m=+72.876404528" watchObservedRunningTime="2026-06-11 21:13:15.80538689 +0000 UTC m=+72.877445866" Jun 11 21:13:34.015880 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:34.015844 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:34.117333 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:34.117305 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:34.213171 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:34.213144 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:13:44.192900 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:44.192828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:13:44.192900 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:44.192864 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:13:44.193306 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:44.192966 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:13:44.193306 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:44.192967 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:13:44.193306 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:44.193028 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls podName:e8445994-0fd5-4dd8-8971-5103c5431127 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:48.193012289 +0000 UTC m=+165.265071250 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls") pod "dns-default-flfvn" (UID: "e8445994-0fd5-4dd8-8971-5103c5431127") : secret "dns-default-metrics-tls" not found Jun 11 21:13:44.193306 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:44.192976 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b7bb9c-qxgz5: secret "image-registry-tls" not found Jun 11 21:13:44.193306 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:13:44.193108 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls podName:32f7838f-4008-44ee-a983-f802235cc073 nodeName:}" failed. No retries permitted until 2026-06-11 21:14:48.19309604 +0000 UTC m=+165.265155001 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls") pod "image-registry-7869b7bb9c-qxgz5" (UID: "32f7838f-4008-44ee-a983-f802235cc073") : secret "image-registry-tls" not found Jun 11 21:13:44.788803 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:13:44.788767 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nz67n" Jun 11 21:14:13.287654 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:13.287613 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:14:13.288063 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:14:13.287734 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 21:14:13.288063 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:14:13.287794 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs podName:d80e86ad-3e9e-4ae9-9666-8f639b3d84fc nodeName:}" failed. No retries permitted until 2026-06-11 21:16:15.287779073 +0000 UTC m=+252.359838034 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs") pod "network-metrics-daemon-fvn2h" (UID: "d80e86ad-3e9e-4ae9-9666-8f639b3d84fc") : secret "metrics-daemon-secret" not found Jun 11 21:14:43.322914 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:14:43.322873 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" podUID="32f7838f-4008-44ee-a983-f802235cc073" Jun 11 21:14:43.362048 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:14:43.362015 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-flfvn" podUID="e8445994-0fd5-4dd8-8971-5103c5431127" Jun 11 21:14:43.404702 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:14:43.404670 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fvn2h" podUID="d80e86ad-3e9e-4ae9-9666-8f639b3d84fc" Jun 11 21:14:44.048621 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:44.048591 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:14:44.048774 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:44.048623 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-flfvn" Jun 11 21:14:48.221804 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:48.221778 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:14:48.222111 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:48.221822 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:14:48.222111 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:14:48.221923 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 21:14:48.222111 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:14:48.221983 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 21:14:48.222111 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:14:48.221999 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls podName:e8445994-0fd5-4dd8-8971-5103c5431127 nodeName:}" failed. No retries permitted until 2026-06-11 21:16:50.221982763 +0000 UTC m=+287.294041722 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls") pod "dns-default-flfvn" (UID: "e8445994-0fd5-4dd8-8971-5103c5431127") : secret "dns-default-metrics-tls" not found Jun 11 21:14:48.222111 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:14:48.222003 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7869b7bb9c-qxgz5: secret "image-registry-tls" not found Jun 11 21:14:48.222111 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:14:48.222081 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls podName:32f7838f-4008-44ee-a983-f802235cc073 nodeName:}" failed. No retries permitted until 2026-06-11 21:16:50.22206237 +0000 UTC m=+287.294121346 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls") pod "image-registry-7869b7bb9c-qxgz5" (UID: "32f7838f-4008-44ee-a983-f802235cc073") : secret "image-registry-tls" not found Jun 11 21:14:48.699245 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:48.699204 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" podUID="86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.8:8000/readyz\": dial tcp 10.132.0.8:8000: connect: connection refused" Jun 11 21:14:49.069357 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:49.069331 2573 generic.go:356] "Generic (PLEG): container finished" podID="86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62" containerID="f57fb0b69a7d14766f865cd6b973ccc57d03ea554e00d7f496452f8a7fdae1d7" exitCode=1 Jun 11 21:14:49.069510 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:49.069405 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" event={"ID":"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62","Type":"ContainerDied","Data":"f57fb0b69a7d14766f865cd6b973ccc57d03ea554e00d7f496452f8a7fdae1d7"} Jun 11 21:14:49.069763 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:49.069745 2573 scope.go:117] "RemoveContainer" containerID="f57fb0b69a7d14766f865cd6b973ccc57d03ea554e00d7f496452f8a7fdae1d7" Jun 11 21:14:49.071056 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:49.071008 2573 generic.go:356] "Generic (PLEG): container finished" podID="57c6a03e-75f5-4fb8-a604-763c110f886d" containerID="c16057eb31ccd681764ab61c9480ee5065225b5a0be5c72ba1b2be2fe07403ea" exitCode=255 Jun 11 21:14:49.071056 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:49.071046 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" event={"ID":"57c6a03e-75f5-4fb8-a604-763c110f886d","Type":"ContainerDied","Data":"c16057eb31ccd681764ab61c9480ee5065225b5a0be5c72ba1b2be2fe07403ea"} Jun 11 21:14:49.071327 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:49.071307 2573 scope.go:117] "RemoveContainer" containerID="c16057eb31ccd681764ab61c9480ee5065225b5a0be5c72ba1b2be2fe07403ea" Jun 11 21:14:50.076260 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:50.076225 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" event={"ID":"57c6a03e-75f5-4fb8-a604-763c110f886d","Type":"ContainerStarted","Data":"85058b5d2fe1aef7d1dcc7e76c0db4a259f0e4b06e84a95bee7833e4ec7d9590"} Jun 11 21:14:50.078092 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:50.078068 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" event={"ID":"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62","Type":"ContainerStarted","Data":"a018b0cb1ab8c0ed8d7faeea20cd4272874647769a35bce80f0471534135474f"} Jun 11 21:14:50.078335 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:50.078317 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:14:50.078892 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:50.078871 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:14:58.391120 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:14:58.391076 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:15:04.597470 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:04.597435 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:19.002109 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:19.002041 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:37.947820 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:37.947780 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:39.099031 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:39.098996 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:40.366274 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:40.366239 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:40.412890 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:40.412865 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:42.203803 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.203767 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-qp8vh"] Jun 11 21:15:42.206865 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.206843 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.209471 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.209446 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lgkfk\"" Jun 11 21:15:42.210510 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.210477 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 21:15:42.210510 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.210503 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 21:15:42.210624 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.210503 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 21:15:42.210624 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.210478 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 21:15:42.222972 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.222950 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qp8vh"] Jun 11 21:15:42.246185 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.246156 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:42.289366 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.289340 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.289473 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.289428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bb4106be-a30c-4b92-8c05-c770f92b9794-crio-socket\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.289473 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.289466 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z67cm\" (UniqueName: \"kubernetes.io/projected/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-api-access-z67cm\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.289591 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.289516 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.289591 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.289565 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb4106be-a30c-4b92-8c05-c770f92b9794-data-volume\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.299280 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.299247 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:42.390521 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.390478 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bb4106be-a30c-4b92-8c05-c770f92b9794-crio-socket\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.390600 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.390530 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z67cm\" (UniqueName: \"kubernetes.io/projected/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-api-access-z67cm\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.390600 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.390559 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.390600 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.390585 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb4106be-a30c-4b92-8c05-c770f92b9794-data-volume\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.390698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.390599 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bb4106be-a30c-4b92-8c05-c770f92b9794-crio-socket\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.390698 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.390643 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.390698 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:42.390692 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:15:42.390792 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:42.390752 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls podName:bb4106be-a30c-4b92-8c05-c770f92b9794 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:42.890736418 +0000 UTC m=+219.962795392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qp8vh" (UID: "bb4106be-a30c-4b92-8c05-c770f92b9794") : secret "insights-runtime-extractor-tls" not found Jun 11 21:15:42.390792 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:42.390752 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:15:42.390874 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:42.390803 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm podName:bb4106be-a30c-4b92-8c05-c770f92b9794 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:42.890792194 +0000 UTC m=+219.962851154 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qp8vh" (UID: "bb4106be-a30c-4b92-8c05-c770f92b9794") : configmap "kube-rbac-proxy" not found Jun 11 21:15:42.391024 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.391008 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bb4106be-a30c-4b92-8c05-c770f92b9794-data-volume\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.400936 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.400905 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z67cm\" (UniqueName: \"kubernetes.io/projected/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-api-access-z67cm\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.746765 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.746737 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:42.895590 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.895559 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.895708 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.895608 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:42.895708 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:42.895695 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:15:42.895793 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:42.895749 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls podName:bb4106be-a30c-4b92-8c05-c770f92b9794 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:43.895735731 +0000 UTC m=+220.967794691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qp8vh" (UID: "bb4106be-a30c-4b92-8c05-c770f92b9794") : secret "insights-runtime-extractor-tls" not found Jun 11 21:15:42.895793 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:42.895699 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:15:42.895871 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:42.895836 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm podName:bb4106be-a30c-4b92-8c05-c770f92b9794 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:43.89582447 +0000 UTC m=+220.967883430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qp8vh" (UID: "bb4106be-a30c-4b92-8c05-c770f92b9794") : configmap "kube-rbac-proxy" not found Jun 11 21:15:42.908888 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:42.908857 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:43.002262 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:43.002207 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:43.100644 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:43.100617 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:43.200296 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:43.200273 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:43.300910 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:43.300853 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:43.452442 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:43.452417 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:43.555983 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:43.555934 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:43.903052 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:43.903027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:43.903157 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:43.903086 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:43.903157 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:43.903134 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:15:43.903229 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:43.903188 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm podName:bb4106be-a30c-4b92-8c05-c770f92b9794 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:45.903172308 +0000 UTC m=+222.975231268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qp8vh" (UID: "bb4106be-a30c-4b92-8c05-c770f92b9794") : configmap "kube-rbac-proxy" not found Jun 11 21:15:43.903229 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:43.903190 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:15:43.903304 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:43.903229 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls podName:bb4106be-a30c-4b92-8c05-c770f92b9794 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:45.903217529 +0000 UTC m=+222.975276489 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qp8vh" (UID: "bb4106be-a30c-4b92-8c05-c770f92b9794") : secret "insights-runtime-extractor-tls" not found Jun 11 21:15:44.398885 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:44.398856 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjxnx_9323e683-7099-43c9-a8d3-23a369dd8280/dns-node-resolver/0.log" Jun 11 21:15:45.099891 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:45.099855 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:45.146389 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:45.146352 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:45.198172 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:45.198154 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bvwbr_4d7dcf20-a0b1-412b-9f87-f920735902c5/node-ca/0.log" Jun 11 21:15:45.917549 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:45.917510 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:45.917929 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:45.917567 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:45.917929 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:45.917646 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:15:45.917929 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:45.917658 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:15:45.917929 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:45.917730 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls podName:bb4106be-a30c-4b92-8c05-c770f92b9794 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:49.91771169 +0000 UTC m=+226.989770649 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qp8vh" (UID: "bb4106be-a30c-4b92-8c05-c770f92b9794") : secret "insights-runtime-extractor-tls" not found Jun 11 21:15:45.917929 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:45.917747 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm podName:bb4106be-a30c-4b92-8c05-c770f92b9794 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:49.917740187 +0000 UTC m=+226.989799147 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qp8vh" (UID: "bb4106be-a30c-4b92-8c05-c770f92b9794") : configmap "kube-rbac-proxy" not found Jun 11 21:15:45.941515 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:45.941471 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:46.002660 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:46.002630 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bnkjs_00dc8383-d3ff-4f95-88ab-bc09c5e5f001/serve-healthcheck-canary/0.log" Jun 11 21:15:46.881000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:46.880963 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:47.018153 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:47.018120 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:47.161322 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:47.161248 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:47.216214 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:47.216190 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:47.332237 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:47.332212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:47.426295 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:47.426244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:47.580744 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:47.580709 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:48.399135 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:48.399095 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:48.579025 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:48.578991 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:48.979312 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:48.979284 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:49.176351 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:49.176322 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:49.375612 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:49.375544 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:49.577710 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:49.577681 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:49.946664 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:49.946638 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:49.946803 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:49.946683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:49.946803 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:49.946758 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 11 21:15:49.946803 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:49.946784 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 11 21:15:49.946906 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:49.946815 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm podName:bb4106be-a30c-4b92-8c05-c770f92b9794 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:57.946799701 +0000 UTC m=+235.018858662 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm") pod "insights-runtime-extractor-qp8vh" (UID: "bb4106be-a30c-4b92-8c05-c770f92b9794") : configmap "kube-rbac-proxy" not found Jun 11 21:15:49.946906 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:15:49.946836 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls podName:bb4106be-a30c-4b92-8c05-c770f92b9794 nodeName:}" failed. No retries permitted until 2026-06-11 21:15:57.94682226 +0000 UTC m=+235.018881220 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls") pod "insights-runtime-extractor-qp8vh" (UID: "bb4106be-a30c-4b92-8c05-c770f92b9794") : secret "insights-runtime-extractor-tls" not found Jun 11 21:15:50.777291 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:50.777255 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:50.826715 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:50.826682 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:50.976061 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:50.976034 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:51.179568 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:51.179506 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:51.379253 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:51.379219 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:51.577273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:51.577238 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:52.581075 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:52.581039 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:52.776479 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:52.776445 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:52.974271 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:52.974240 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:53.273391 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:53.273303 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:53.381354 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:53.381326 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:53.430793 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:53.430771 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:53.979226 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:53.979193 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:54.578705 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:54.578668 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:54.775499 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:54.775452 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:54.976077 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:54.976053 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:55.179626 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:55.179602 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:55.300863 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:55.300803 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:55.661701 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:55.661638 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:55.711177 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:55.711146 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:56.182129 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:56.182096 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:56.578635 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:56.578600 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:56.776781 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:56.776751 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:56.976757 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:56.976726 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:57.179599 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:57.179571 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:57.579010 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:57.578983 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:15:58.004862 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:58.004831 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:58.005053 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:58.004898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:58.005648 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:58.005623 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bb4106be-a30c-4b92-8c05-c770f92b9794-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:58.007655 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:58.007630 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bb4106be-a30c-4b92-8c05-c770f92b9794-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-qp8vh\" (UID: \"bb4106be-a30c-4b92-8c05-c770f92b9794\") " pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:58.116920 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:58.116902 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-qp8vh" Jun 11 21:15:58.238371 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:58.238256 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-qp8vh"] Jun 11 21:15:58.240793 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:15:58.240761 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb4106be_a30c_4b92_8c05_c770f92b9794.slice/crio-82822ee70e57166d8c32039bb062f3a3b128dd7931e3e1af005e582669485d06 WatchSource:0}: Error finding container 82822ee70e57166d8c32039bb062f3a3b128dd7931e3e1af005e582669485d06: Status 404 returned error can't find the container with id 82822ee70e57166d8c32039bb062f3a3b128dd7931e3e1af005e582669485d06 Jun 11 21:15:58.289102 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:58.289034 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qp8vh" event={"ID":"bb4106be-a30c-4b92-8c05-c770f92b9794","Type":"ContainerStarted","Data":"82822ee70e57166d8c32039bb062f3a3b128dd7931e3e1af005e582669485d06"} Jun 11 21:15:59.046960 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:15:59.046926 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:02.303463 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:02.303436 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qp8vh" event={"ID":"bb4106be-a30c-4b92-8c05-c770f92b9794","Type":"ContainerStarted","Data":"cb8940a0af129f98ebfe8fef59a8b0081894a11b7a02bcc8bfd7337ec7c3bc6a"} Jun 11 21:16:02.303740 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:02.303499 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qp8vh" event={"ID":"bb4106be-a30c-4b92-8c05-c770f92b9794","Type":"ContainerStarted","Data":"fa66c16fa36db958da44fc4218675f4d04af2cb07c4a2b0d5cccb3269ab24ba3"} Jun 11 21:16:04.312385 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:04.312349 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-qp8vh" event={"ID":"bb4106be-a30c-4b92-8c05-c770f92b9794","Type":"ContainerStarted","Data":"c7cc4b4149385f4c417d03cee3cadc74ba7658dcf5190bad41c088b6cf7f135e"} Jun 11 21:16:04.341250 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:04.341200 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-qp8vh" podStartSLOduration=16.792904921999998 podStartE2EDuration="22.341177824s" totalImagesPullingTime="5.548272902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:15:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:16:04.339752064 +0000 UTC m=+241.411811061" watchObservedRunningTime="2026-06-11 21:16:04.341177824 +0000 UTC m=+241.413236805" Jun 11 21:16:04.544497 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:04.544443 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:04.645132 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:04.645066 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:12.174322 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:12.174290 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:12.275069 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:12.275041 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:12.328873 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:12.328846 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:12.398543 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:12.398506 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:12.499210 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:12.499185 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:12.557681 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:12.557621 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:12.743688 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:12.743660 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:15.320721 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:15.320671 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:16:15.323286 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:15.323264 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d80e86ad-3e9e-4ae9-9666-8f639b3d84fc-metrics-certs\") pod \"network-metrics-daemon-fvn2h\" (UID: \"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc\") " pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:16:15.494718 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:15.494686 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kmmbr\"" Jun 11 21:16:15.503187 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:15.503160 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvn2h" Jun 11 21:16:15.584537 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:15.584476 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:15.626235 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:15.626208 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fvn2h"] Jun 11 21:16:15.629136 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:16:15.629111 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd80e86ad_3e9e_4ae9_9666_8f639b3d84fc.slice/crio-df114be1f9539c35c27d23d33510f94ff7d0e4b60d924d169c9302b71a490d95 WatchSource:0}: Error finding container df114be1f9539c35c27d23d33510f94ff7d0e4b60d924d169c9302b71a490d95: Status 404 returned error can't find the container with id df114be1f9539c35c27d23d33510f94ff7d0e4b60d924d169c9302b71a490d95 Jun 11 21:16:15.652376 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:15.652347 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:15.968043 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:15.967961 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:16.348241 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:16.348207 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvn2h" event={"ID":"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc","Type":"ContainerStarted","Data":"df114be1f9539c35c27d23d33510f94ff7d0e4b60d924d169c9302b71a490d95"} Jun 11 21:16:17.353042 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:17.353009 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvn2h" event={"ID":"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc","Type":"ContainerStarted","Data":"1615a862a9f46eb0c661c7860757180c0e09841d591e9fb72e99ede9dacaf9c5"} Jun 11 21:16:17.353415 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:17.353062 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvn2h" event={"ID":"d80e86ad-3e9e-4ae9-9666-8f639b3d84fc","Type":"ContainerStarted","Data":"6311d78e393e33195f8ccef613cf5303faf3af635f746e077ad868b042c97b36"} Jun 11 21:16:17.369310 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:17.369257 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fvn2h" podStartSLOduration=253.291657329 podStartE2EDuration="4m14.369243008s" totalImagesPullingTime="1.077585679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:12:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:16:17.367989196 +0000 UTC m=+254.440048195" watchObservedRunningTime="2026-06-11 21:16:17.369243008 +0000 UTC m=+254.441301989" Jun 11 21:16:17.448831 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:17.448798 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:17.494854 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:17.494826 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:17.538950 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:17.538902 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:18.369190 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:18.369140 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:19.717003 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:19.716967 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:19.942409 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:19.942379 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:19.971654 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:19.971623 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rld67"] Jun 11 21:16:19.974803 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:19.974786 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:19.977416 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:19.977389 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 21:16:19.977546 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:19.977462 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 21:16:19.977546 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:19.977476 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 21:16:19.977546 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:19.977505 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 21:16:19.977714 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:19.977693 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 21:16:19.978872 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:19.978857 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6d99c\"" Jun 11 21:16:19.978928 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:19.978873 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 21:16:20.020398 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.020373 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:20.055515 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.055470 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-wtmp\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.055627 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.055523 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-tls\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.055627 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.055595 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-root\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.055627 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.055623 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j75dt\" (UniqueName: \"kubernetes.io/projected/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-kube-api-access-j75dt\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.055741 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.055654 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-sys\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.055741 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.055673 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-metrics-client-ca\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.055741 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.055724 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-textfile\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.055867 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.055742 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-accelerators-collector-config\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.055867 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.055770 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.112318 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.112295 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:20.156751 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.156727 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-wtmp\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.156857 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.156760 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-tls\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.156857 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.156781 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-root\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.156857 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.156807 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j75dt\" (UniqueName: \"kubernetes.io/projected/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-kube-api-access-j75dt\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.156857 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.156838 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-sys\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.157044 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.156859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-metrics-client-ca\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.157044 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.156911 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-textfile\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.157044 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.156911 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-wtmp\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.157044 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.156935 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-sys\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.157044 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.156856 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-root\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.157044 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.156986 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-accelerators-collector-config\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.157044 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.157040 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.157377 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.157358 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-textfile\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.157503 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.157463 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-metrics-client-ca\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.157607 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.157586 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-accelerators-collector-config\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.159225 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.159203 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.159288 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.159275 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-node-exporter-tls\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.164000 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.163976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j75dt\" (UniqueName: \"kubernetes.io/projected/e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e-kube-api-access-j75dt\") pod \"node-exporter-rld67\" (UID: \"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e\") " pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.212906 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.212884 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:20.264277 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.264212 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:20.283892 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.283873 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rld67" Jun 11 21:16:20.294582 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:16:20.294547 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ca5d6d_a3a1_4b9a_aa98_018d593cb05e.slice/crio-5d334e24f34e52cfa3f2b996ef669ab165a098f044ee2bd640ba70b08c5dec98 WatchSource:0}: Error finding container 5d334e24f34e52cfa3f2b996ef669ab165a098f044ee2bd640ba70b08c5dec98: Status 404 returned error can't find the container with id 5d334e24f34e52cfa3f2b996ef669ab165a098f044ee2bd640ba70b08c5dec98 Jun 11 21:16:20.322928 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.322905 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:20.367451 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.367432 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rld67" event={"ID":"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e","Type":"ContainerStarted","Data":"5d334e24f34e52cfa3f2b996ef669ab165a098f044ee2bd640ba70b08c5dec98"} Jun 11 21:16:20.661141 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.661075 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:20.945927 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:20.945840 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:21.050316 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:21.050284 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:21.256543 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:21.256517 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:21.372100 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:21.372065 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rld67" event={"ID":"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e","Type":"ContainerStarted","Data":"6239a05fa4ac03b5735516273b64032f0f75f92301963ca78523f66b1340070e"} Jun 11 21:16:22.377007 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:22.376967 2573 generic.go:356] "Generic (PLEG): container finished" podID="e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e" containerID="6239a05fa4ac03b5735516273b64032f0f75f92301963ca78523f66b1340070e" exitCode=0 Jun 11 21:16:22.377576 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:22.377044 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rld67" event={"ID":"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e","Type":"ContainerDied","Data":"6239a05fa4ac03b5735516273b64032f0f75f92301963ca78523f66b1340070e"} Jun 11 21:16:22.882899 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:22.882866 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:22.945479 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:22.945449 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:23.169506 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:23.169415 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:23.382585 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:23.382550 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rld67" event={"ID":"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e","Type":"ContainerStarted","Data":"11a088678e95afa7f70f20836d8d787bbc625379ba14d7eac424c9848c253eb6"} Jun 11 21:16:23.382887 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:23.382611 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rld67" event={"ID":"e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e","Type":"ContainerStarted","Data":"efa11148f22520ce800b9070a5c1e69076cf81aa8c885d791eeb4dd07fa04cc0"} Jun 11 21:16:23.401332 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:23.401293 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rld67" podStartSLOduration=3.408307749 podStartE2EDuration="4.401280486s" totalImagesPullingTime="932.882345ms" totalInitContainerRuntime="60.090392ms" isStatefulPod=true podCreationTimestamp="2026-06-11 21:16:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:16:23.399744044 +0000 UTC m=+260.471803027" watchObservedRunningTime="2026-06-11 21:16:23.401280486 +0000 UTC m=+260.473339468" Jun 11 21:16:23.403926 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:23.403887 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:24.743866 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:24.743835 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:24.796418 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:24.796393 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:24.871711 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:24.871681 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:24.966121 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:24.966092 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:25.017620 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:25.017561 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:25.154214 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:25.154191 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:25.336909 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:25.336847 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:25.529344 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:25.529321 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:25.585218 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:25.585167 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:25.937841 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:25.937810 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:26.033398 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:26.033374 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:26.134330 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:26.134305 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:26.215619 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:26.215558 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:26.331261 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:26.331233 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:26.431016 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:26.430992 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:26.580855 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:26.580830 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:26.741602 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:26.741578 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:27.203093 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:27.203065 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:27.303438 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:27.303401 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:27.348231 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:27.348199 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:27.958890 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:27.958857 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:28.061603 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:28.061569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:33.566240 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:33.566206 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:33.613189 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:33.613151 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:35.761543 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:35.761504 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:39.358338 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:39.358290 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:39.406920 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:39.406869 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:43.163413 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:43.163373 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:43.211547 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:43.211516 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:47.049814 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:16:47.049770 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-flfvn" podUID="e8445994-0fd5-4dd8-8971-5103c5431127" Jun 11 21:16:47.049814 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:16:47.049796 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" podUID="32f7838f-4008-44ee-a983-f802235cc073" Jun 11 21:16:47.456918 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:47.456849 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:16:47.457067 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:47.456854 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-flfvn" Jun 11 21:16:49.465083 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:49.465021 2573 generic.go:356] "Generic (PLEG): container finished" podID="57c6a03e-75f5-4fb8-a604-763c110f886d" containerID="85058b5d2fe1aef7d1dcc7e76c0db4a259f0e4b06e84a95bee7833e4ec7d9590" exitCode=255 Jun 11 21:16:49.465433 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:49.465095 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" event={"ID":"57c6a03e-75f5-4fb8-a604-763c110f886d","Type":"ContainerDied","Data":"85058b5d2fe1aef7d1dcc7e76c0db4a259f0e4b06e84a95bee7833e4ec7d9590"} Jun 11 21:16:49.465433 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:49.465139 2573 scope.go:117] "RemoveContainer" containerID="c16057eb31ccd681764ab61c9480ee5065225b5a0be5c72ba1b2be2fe07403ea" Jun 11 21:16:49.465433 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:49.465426 2573 scope.go:117] "RemoveContainer" containerID="85058b5d2fe1aef7d1dcc7e76c0db4a259f0e4b06e84a95bee7833e4ec7d9590" Jun 11 21:16:49.465623 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:16:49.465600 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg_open-cluster-management-agent-addon(57c6a03e-75f5-4fb8-a604-763c110f886d)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" podUID="57c6a03e-75f5-4fb8-a604-763c110f886d" Jun 11 21:16:49.467109 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:49.467088 2573 generic.go:356] "Generic (PLEG): container finished" podID="86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62" containerID="a018b0cb1ab8c0ed8d7faeea20cd4272874647769a35bce80f0471534135474f" exitCode=1 Jun 11 21:16:49.467185 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:49.467117 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" event={"ID":"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62","Type":"ContainerDied","Data":"a018b0cb1ab8c0ed8d7faeea20cd4272874647769a35bce80f0471534135474f"} Jun 11 21:16:49.467364 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:49.467350 2573 scope.go:117] "RemoveContainer" containerID="a018b0cb1ab8c0ed8d7faeea20cd4272874647769a35bce80f0471534135474f" Jun 11 21:16:49.467837 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:16:49.467799 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6576b7fc45-8rpl5_open-cluster-management-agent-addon(86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" podUID="86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62" Jun 11 21:16:49.477980 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:49.477959 2573 scope.go:117] "RemoveContainer" containerID="f57fb0b69a7d14766f865cd6b973ccc57d03ea554e00d7f496452f8a7fdae1d7" Jun 11 21:16:50.079047 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.079022 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:16:50.258781 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.258755 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:16:50.258912 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.258810 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:16:50.261226 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.261194 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"image-registry-7869b7bb9c-qxgz5\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:16:50.261347 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.261194 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e8445994-0fd5-4dd8-8971-5103c5431127-metrics-tls\") pod \"dns-default-flfvn\" (UID: \"e8445994-0fd5-4dd8-8971-5103c5431127\") " pod="openshift-dns/dns-default-flfvn" Jun 11 21:16:50.373862 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.373793 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:50.425787 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.425757 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:50.459995 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.459975 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-82hkw\"" Jun 11 21:16:50.460874 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.460860 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-mkdsh\"" Jun 11 21:16:50.467843 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.467826 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:16:50.468139 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.467843 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-flfvn" Jun 11 21:16:50.471782 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.471765 2573 scope.go:117] "RemoveContainer" containerID="a018b0cb1ab8c0ed8d7faeea20cd4272874647769a35bce80f0471534135474f" Jun 11 21:16:50.472226 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:16:50.471895 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6576b7fc45-8rpl5_open-cluster-management-agent-addon(86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" podUID="86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62" Jun 11 21:16:50.604329 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.604293 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-flfvn"] Jun 11 21:16:50.609545 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:16:50.608739 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8445994_0fd5_4dd8_8971_5103c5431127.slice/crio-c6b96511be550a7fe03451f983f054966677908e6d2b0f6a1b0ed46160a03403 WatchSource:0}: Error finding container c6b96511be550a7fe03451f983f054966677908e6d2b0f6a1b0ed46160a03403: Status 404 returned error can't find the container with id c6b96511be550a7fe03451f983f054966677908e6d2b0f6a1b0ed46160a03403 Jun 11 21:16:50.616064 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.616047 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" Jun 11 21:16:50.616379 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.616365 2573 scope.go:117] "RemoveContainer" containerID="85058b5d2fe1aef7d1dcc7e76c0db4a259f0e4b06e84a95bee7833e4ec7d9590" Jun 11 21:16:50.616558 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:16:50.616539 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg_open-cluster-management-agent-addon(57c6a03e-75f5-4fb8-a604-763c110f886d)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" podUID="57c6a03e-75f5-4fb8-a604-763c110f886d" Jun 11 21:16:50.623954 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.623890 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7869b7bb9c-qxgz5"] Jun 11 21:16:50.626349 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:16:50.626317 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f7838f_4008_44ee_a983_f802235cc073.slice/crio-8613173ba323258f3e9bb2202ba67f3a4267222f4832234b48b865ae547d2839 WatchSource:0}: Error finding container 8613173ba323258f3e9bb2202ba67f3a4267222f4832234b48b865ae547d2839: Status 404 returned error can't find the container with id 8613173ba323258f3e9bb2202ba67f3a4267222f4832234b48b865ae547d2839 Jun 11 21:16:50.631844 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.631828 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:16:50.638790 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.638764 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" podUID="7181fec5-7a0b-4a7f-bc42-da3b72096ba4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 21:16:50.722551 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.722523 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:50.773523 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:50.773455 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:51.477864 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:51.477830 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-flfvn" event={"ID":"e8445994-0fd5-4dd8-8971-5103c5431127","Type":"ContainerStarted","Data":"c6b96511be550a7fe03451f983f054966677908e6d2b0f6a1b0ed46160a03403"} Jun 11 21:16:51.479443 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:51.479415 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" event={"ID":"32f7838f-4008-44ee-a983-f802235cc073","Type":"ContainerStarted","Data":"072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e"} Jun 11 21:16:51.479602 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:51.479465 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" event={"ID":"32f7838f-4008-44ee-a983-f802235cc073","Type":"ContainerStarted","Data":"8613173ba323258f3e9bb2202ba67f3a4267222f4832234b48b865ae547d2839"} Jun 11 21:16:51.479697 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:51.479680 2573 scope.go:117] "RemoveContainer" containerID="a018b0cb1ab8c0ed8d7faeea20cd4272874647769a35bce80f0471534135474f" Jun 11 21:16:51.479870 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:16:51.479848 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6576b7fc45-8rpl5_open-cluster-management-agent-addon(86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" podUID="86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62" Jun 11 21:16:51.499908 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:51.499861 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" podStartSLOduration=287.499842913 podStartE2EDuration="4m47.499842913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:12:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:16:51.498471998 +0000 UTC m=+288.570531016" watchObservedRunningTime="2026-06-11 21:16:51.499842913 +0000 UTC m=+288.571901896" Jun 11 21:16:52.483663 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:52.483634 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:16:53.487927 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:53.487893 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-flfvn" event={"ID":"e8445994-0fd5-4dd8-8971-5103c5431127","Type":"ContainerStarted","Data":"df9ecc40bde0733c47f8c39a925de01e470296caafdcc44b26e7ae693c9c9fdb"} Jun 11 21:16:53.488314 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:53.487946 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-flfvn" event={"ID":"e8445994-0fd5-4dd8-8971-5103c5431127","Type":"ContainerStarted","Data":"7c84a5af252473ad720e5c28ecd25c97e9fc06cb6e0bcbed50ae8e89d03a9f6f"} Jun 11 21:16:53.488314 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:53.488102 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-flfvn" Jun 11 21:16:53.504514 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:53.504454 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-flfvn" podStartSLOduration=251.25500421 podStartE2EDuration="4m13.504442687s" totalImagesPullingTime="2.249438477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:16:53.503443489 +0000 UTC m=+290.575502473" watchObservedRunningTime="2026-06-11 21:16:53.504442687 +0000 UTC m=+290.576501669" Jun 11 21:16:55.660365 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:55.660312 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:55.710896 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:55.710862 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:56.300280 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:56.300246 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:16:56.348678 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:16:56.348646 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:00.638572 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:00.638529 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" podUID="7181fec5-7a0b-4a7f-bc42-da3b72096ba4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 21:17:03.344007 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:03.343976 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/0.log" Jun 11 21:17:03.346880 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:03.346855 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/0.log" Jun 11 21:17:03.347428 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:03.347409 2573 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 21:17:03.493500 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:03.493470 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-flfvn" Jun 11 21:17:05.391569 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:05.391540 2573 scope.go:117] "RemoveContainer" containerID="a018b0cb1ab8c0ed8d7faeea20cd4272874647769a35bce80f0471534135474f" Jun 11 21:17:05.391995 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:05.391701 2573 scope.go:117] "RemoveContainer" containerID="85058b5d2fe1aef7d1dcc7e76c0db4a259f0e4b06e84a95bee7833e4ec7d9590" Jun 11 21:17:05.529373 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:05.529342 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-764ddcbdf8-rkpxg" event={"ID":"57c6a03e-75f5-4fb8-a604-763c110f886d","Type":"ContainerStarted","Data":"cdc3e0cb3385d9636e9ceda5d67b9ca746d7427909a9c473684f92de6ca476b5"} Jun 11 21:17:05.531146 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:05.531121 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" event={"ID":"86e23d9e-1bdc-4f6a-bc92-fcadc42a0a62","Type":"ContainerStarted","Data":"7b36a111d1ce2bd7f06e5306027afd39138725e86b04e0c15e22e8eb2afe1058"} Jun 11 21:17:05.531401 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:05.531383 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:17:05.532587 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:05.532571 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6576b7fc45-8rpl5" Jun 11 21:17:05.926579 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:05.926549 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:05.978513 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:05.978444 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:10.472805 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:10.472773 2573 patch_prober.go:28] interesting pod/image-registry-7869b7bb9c-qxgz5 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 21:17:10.473167 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:10.472820 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" podUID="32f7838f-4008-44ee-a983-f802235cc073" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 21:17:10.638273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:10.638240 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" podUID="7181fec5-7a0b-4a7f-bc42-da3b72096ba4" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 21:17:10.638408 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:10.638297 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" Jun 11 21:17:10.638794 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:10.638763 2573 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"fe2ee9148a584a81209aca154fa4ab35003804fa3c35c169709b7a743c0cbd4a"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 21:17:10.638842 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:10.638815 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" podUID="7181fec5-7a0b-4a7f-bc42-da3b72096ba4" containerName="service-proxy" containerID="cri-o://fe2ee9148a584a81209aca154fa4ab35003804fa3c35c169709b7a743c0cbd4a" gracePeriod=30 Jun 11 21:17:11.552570 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:11.552539 2573 generic.go:356] "Generic (PLEG): container finished" podID="7181fec5-7a0b-4a7f-bc42-da3b72096ba4" containerID="fe2ee9148a584a81209aca154fa4ab35003804fa3c35c169709b7a743c0cbd4a" exitCode=2 Jun 11 21:17:11.552951 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:11.552595 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" event={"ID":"7181fec5-7a0b-4a7f-bc42-da3b72096ba4","Type":"ContainerDied","Data":"fe2ee9148a584a81209aca154fa4ab35003804fa3c35c169709b7a743c0cbd4a"} Jun 11 21:17:11.552951 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:11.552626 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6856569648-f8hg8" event={"ID":"7181fec5-7a0b-4a7f-bc42-da3b72096ba4","Type":"ContainerStarted","Data":"5a89a2bb469e825ad8a4cef2d71c9605d83e00a6115d454961b3156ffc58508f"} Jun 11 21:17:12.440648 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:12.440616 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:12.590773 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:12.590746 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:12.636445 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:12.636423 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:13.492036 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:13.492010 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:17:13.612072 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:13.612025 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-flfvn_e8445994-0fd5-4dd8-8971-5103c5431127/dns/0.log" Jun 11 21:17:13.790708 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:13.790617 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:13.811141 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:13.811118 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-flfvn_e8445994-0fd5-4dd8-8971-5103c5431127/kube-rbac-proxy/0.log" Jun 11 21:17:13.837958 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:13.837925 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:15.211871 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:15.211844 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjxnx_9323e683-7099-43c9-a8d3-23a369dd8280/dns-node-resolver/0.log" Jun 11 21:17:15.812516 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:15.812451 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7869b7bb9c-qxgz5_32f7838f-4008-44ee-a983-f802235cc073/registry/0.log" Jun 11 21:17:16.212212 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:16.212138 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bvwbr_4d7dcf20-a0b1-412b-9f87-f920735902c5/node-ca/0.log" Jun 11 21:17:17.011551 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:17.011520 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bnkjs_00dc8383-d3ff-4f95-88ab-bc09c5e5f001/serve-healthcheck-canary/0.log" Jun 11 21:17:19.360173 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:19.360137 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:19.460088 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:19.460054 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:20.868200 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:20.868167 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:20.969879 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:20.969849 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:28.462302 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:28.462257 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:28.512972 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:28.512945 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:30.469019 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:30.468983 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:32.786582 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:32.786547 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7869b7bb9c-qxgz5"] Jun 11 21:17:32.875443 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:32.875378 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:32.973275 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:32.973238 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:36.025611 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:36.025572 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:36.124133 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:36.124102 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:39.649065 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:39.649024 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:39.698271 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:39.698241 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:39.796181 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:39.796140 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:39.896237 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:39.896214 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:39.996712 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:39.996687 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:40.450789 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:40.450705 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:40.503651 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:40.503623 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:40.660683 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:40.660661 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:40.707934 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:40.707872 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:41.144876 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:41.144846 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:41.199982 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:41.199941 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:41.656337 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:41.656307 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:41.756784 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:41.756757 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:41.801662 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:41.801635 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:51.060652 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:51.060569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:51.107269 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:51.107238 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:51.160891 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:51.160864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:51.261918 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:51.261886 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:55.664401 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:55.664348 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:55.768338 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:55.768311 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:17:57.805430 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:57.805385 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" podUID="32f7838f-4008-44ee-a983-f802235cc073" containerName="registry" containerID="cri-o://072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e" gracePeriod=30 Jun 11 21:17:58.044024 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.044001 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:17:58.195762 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.195692 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kntx6\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-kube-api-access-kntx6\") pod \"32f7838f-4008-44ee-a983-f802235cc073\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " Jun 11 21:17:58.195762 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.195734 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-image-registry-private-configuration\") pod \"32f7838f-4008-44ee-a983-f802235cc073\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " Jun 11 21:17:58.195762 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.195755 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-registry-certificates\") pod \"32f7838f-4008-44ee-a983-f802235cc073\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " Jun 11 21:17:58.195973 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.195895 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") pod \"32f7838f-4008-44ee-a983-f802235cc073\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " Jun 11 21:17:58.195973 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.195940 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-installation-pull-secrets\") pod \"32f7838f-4008-44ee-a983-f802235cc073\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " Jun 11 21:17:58.196075 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.195972 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-bound-sa-token\") pod \"32f7838f-4008-44ee-a983-f802235cc073\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " Jun 11 21:17:58.196075 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.196010 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32f7838f-4008-44ee-a983-f802235cc073-ca-trust-extracted\") pod \"32f7838f-4008-44ee-a983-f802235cc073\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " Jun 11 21:17:58.196075 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.196072 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-trusted-ca\") pod \"32f7838f-4008-44ee-a983-f802235cc073\" (UID: \"32f7838f-4008-44ee-a983-f802235cc073\") " Jun 11 21:17:58.196235 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.196159 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "32f7838f-4008-44ee-a983-f802235cc073" (UID: "32f7838f-4008-44ee-a983-f802235cc073"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:17:58.196305 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.196284 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-registry-certificates\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:17:58.196693 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.196654 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "32f7838f-4008-44ee-a983-f802235cc073" (UID: "32f7838f-4008-44ee-a983-f802235cc073"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 21:17:58.198264 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.198237 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "32f7838f-4008-44ee-a983-f802235cc073" (UID: "32f7838f-4008-44ee-a983-f802235cc073"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:17:58.198387 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.198279 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-kube-api-access-kntx6" (OuterVolumeSpecName: "kube-api-access-kntx6") pod "32f7838f-4008-44ee-a983-f802235cc073" (UID: "32f7838f-4008-44ee-a983-f802235cc073"). InnerVolumeSpecName "kube-api-access-kntx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:17:58.198387 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.198293 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "32f7838f-4008-44ee-a983-f802235cc073" (UID: "32f7838f-4008-44ee-a983-f802235cc073"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:17:58.198512 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.198379 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "32f7838f-4008-44ee-a983-f802235cc073" (UID: "32f7838f-4008-44ee-a983-f802235cc073"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 21:17:58.198512 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.198430 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "32f7838f-4008-44ee-a983-f802235cc073" (UID: "32f7838f-4008-44ee-a983-f802235cc073"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:17:58.206432 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.206407 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32f7838f-4008-44ee-a983-f802235cc073-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "32f7838f-4008-44ee-a983-f802235cc073" (UID: "32f7838f-4008-44ee-a983-f802235cc073"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:17:58.297430 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.297410 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/32f7838f-4008-44ee-a983-f802235cc073-trusted-ca\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:17:58.297522 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.297428 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kntx6\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-kube-api-access-kntx6\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:17:58.297522 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.297448 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-image-registry-private-configuration\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:17:58.297522 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.297457 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-registry-tls\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:17:58.297522 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.297465 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/32f7838f-4008-44ee-a983-f802235cc073-installation-pull-secrets\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:17:58.297522 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.297473 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/32f7838f-4008-44ee-a983-f802235cc073-bound-sa-token\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:17:58.297522 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.297494 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/32f7838f-4008-44ee-a983-f802235cc073-ca-trust-extracted\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:17:58.713839 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.713815 2573 generic.go:356] "Generic (PLEG): container finished" podID="32f7838f-4008-44ee-a983-f802235cc073" containerID="072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e" exitCode=0 Jun 11 21:17:58.713964 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.713858 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" Jun 11 21:17:58.713964 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.713877 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" event={"ID":"32f7838f-4008-44ee-a983-f802235cc073","Type":"ContainerDied","Data":"072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e"} Jun 11 21:17:58.713964 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.713916 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7869b7bb9c-qxgz5" event={"ID":"32f7838f-4008-44ee-a983-f802235cc073","Type":"ContainerDied","Data":"8613173ba323258f3e9bb2202ba67f3a4267222f4832234b48b865ae547d2839"} Jun 11 21:17:58.713964 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.713934 2573 scope.go:117] "RemoveContainer" containerID="072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e" Jun 11 21:17:58.722512 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.722474 2573 scope.go:117] "RemoveContainer" containerID="072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e" Jun 11 21:17:58.722775 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:17:58.722753 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e\": container with ID starting with 072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e not found: ID does not exist" containerID="072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e" Jun 11 21:17:58.722820 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.722783 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e"} err="failed to get container status \"072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e\": rpc error: code = NotFound desc = could not find container \"072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e\": container with ID starting with 072527674a9dd0cfe0f8bc95e24e2f4a35709e13dcda82d7759d59db0ea4ee2e not found: ID does not exist" Jun 11 21:17:58.734089 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.734068 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7869b7bb9c-qxgz5"] Jun 11 21:17:58.737864 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:58.737844 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7869b7bb9c-qxgz5"] Jun 11 21:17:59.395621 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:17:59.395591 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32f7838f-4008-44ee-a983-f802235cc073" path="/var/lib/kubelet/pods/32f7838f-4008-44ee-a983-f802235cc073/volumes" Jun 11 21:18:43.154506 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:18:43.154445 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:20:35.820573 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:20:35.820534 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:23.677904 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:21:23.677874 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:25.044609 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:21:25.044573 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:40.669255 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:21:40.669216 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:40.769177 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:21:40.769144 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:48.172643 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:21:48.172614 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:21:48.222222 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:21:48.222198 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:03.363982 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:03.363956 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/0.log" Jun 11 21:22:03.365225 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:03.365201 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/0.log" Jun 11 21:22:04.699973 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:04.699933 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:04.793500 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:04.793458 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:25.454285 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:25.454253 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:33.103405 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:33.103355 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:33.903960 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:33.903918 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:36.237609 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:36.237569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:36.339891 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:36.339868 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:36.440069 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:36.440044 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:36.721411 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:36.721390 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:36.768550 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:36.768527 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:37.451553 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:37.451516 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:37.554281 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:37.554234 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:37.668251 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:37.668223 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:41.070399 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:41.070368 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:41.454841 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:41.454768 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:43.515545 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:43.515507 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:43.582272 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:43.582217 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:46.784003 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:46.783969 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:46.883401 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:46.883376 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:48.257610 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:48.257581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:48.528296 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:48.528223 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:48.631932 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:48.631899 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:51.338609 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.338572 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm"] Jun 11 21:22:51.338990 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.338813 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32f7838f-4008-44ee-a983-f802235cc073" containerName="registry" Jun 11 21:22:51.338990 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.338826 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="32f7838f-4008-44ee-a983-f802235cc073" containerName="registry" Jun 11 21:22:51.338990 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.338872 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="32f7838f-4008-44ee-a983-f802235cc073" containerName="registry" Jun 11 21:22:51.341605 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.341585 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm" Jun 11 21:22:51.344161 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.344133 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 21:22:51.344271 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.344131 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-p7bjd\"" Jun 11 21:22:51.345384 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.345363 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 21:22:51.349216 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.349194 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm"] Jun 11 21:22:51.424580 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.424556 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfcnv\" (UniqueName: \"kubernetes.io/projected/3a065914-76bd-4d84-a964-529aeb4b98f7-kube-api-access-dfcnv\") pod \"openshift-lws-operator-fd8ccff4c-9ckxm\" (UID: \"3a065914-76bd-4d84-a964-529aeb4b98f7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm" Jun 11 21:22:51.424670 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.424588 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a065914-76bd-4d84-a964-529aeb4b98f7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9ckxm\" (UID: \"3a065914-76bd-4d84-a964-529aeb4b98f7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm" Jun 11 21:22:51.525583 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.525555 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfcnv\" (UniqueName: \"kubernetes.io/projected/3a065914-76bd-4d84-a964-529aeb4b98f7-kube-api-access-dfcnv\") pod \"openshift-lws-operator-fd8ccff4c-9ckxm\" (UID: \"3a065914-76bd-4d84-a964-529aeb4b98f7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm" Jun 11 21:22:51.525676 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.525592 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a065914-76bd-4d84-a964-529aeb4b98f7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9ckxm\" (UID: \"3a065914-76bd-4d84-a964-529aeb4b98f7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm" Jun 11 21:22:51.525945 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.525927 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a065914-76bd-4d84-a964-529aeb4b98f7-tmp\") pod \"openshift-lws-operator-fd8ccff4c-9ckxm\" (UID: \"3a065914-76bd-4d84-a964-529aeb4b98f7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm" Jun 11 21:22:51.533497 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.533466 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfcnv\" (UniqueName: \"kubernetes.io/projected/3a065914-76bd-4d84-a964-529aeb4b98f7-kube-api-access-dfcnv\") pod \"openshift-lws-operator-fd8ccff4c-9ckxm\" (UID: \"3a065914-76bd-4d84-a964-529aeb4b98f7\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm" Jun 11 21:22:51.651571 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.651517 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm" Jun 11 21:22:51.772295 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.772271 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm"] Jun 11 21:22:51.774692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:22:51.774668 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a065914_76bd_4d84_a964_529aeb4b98f7.slice/crio-649c6e807498c1396b4fc929b387e95068e484598778f360c496732d2ba93db0 WatchSource:0}: Error finding container 649c6e807498c1396b4fc929b387e95068e484598778f360c496732d2ba93db0: Status 404 returned error can't find the container with id 649c6e807498c1396b4fc929b387e95068e484598778f360c496732d2ba93db0 Jun 11 21:22:51.776159 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:51.776143 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 21:22:52.669262 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:52.669226 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm" event={"ID":"3a065914-76bd-4d84-a964-529aeb4b98f7","Type":"ContainerStarted","Data":"649c6e807498c1396b4fc929b387e95068e484598778f360c496732d2ba93db0"} Jun 11 21:22:54.678234 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:54.678206 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm" event={"ID":"3a065914-76bd-4d84-a964-529aeb4b98f7","Type":"ContainerStarted","Data":"9db01b587d6bf9e9796e2571f196c312a9c2a458c89011bec834e88033cf615a"} Jun 11 21:22:54.692922 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:54.692871 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-9ckxm" podStartSLOduration=1.266520911 podStartE2EDuration="3.692853695s" totalImagesPullingTime="2.426332784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:22:54.692562802 +0000 UTC m=+651.764621785" watchObservedRunningTime="2026-06-11 21:22:54.692853695 +0000 UTC m=+651.764912679" Jun 11 21:22:55.449522 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:55.449468 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:55.549819 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:55.549786 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:22:57.564526 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:22:57.564494 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:05.775578 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:05.775543 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:05.859694 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:05.859664 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:09.727282 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:09.727246 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:09.827452 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:09.827419 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:10.372863 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.372834 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:10.549766 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.549737 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:10.647256 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.647191 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:10.674665 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.674642 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh"] Jun 11 21:23:10.679313 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.679298 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.682347 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.682328 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 21:23:10.682559 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.682533 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 21:23:10.682692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.682634 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-22xw8\"" Jun 11 21:23:10.682692 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.682672 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 21:23:10.682809 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.682653 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 21:23:10.690800 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.690781 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh"] Jun 11 21:23:10.789682 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.789657 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:10.842542 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.842521 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzg9h\" (UniqueName: \"kubernetes.io/projected/2ee14f9f-5795-4969-bbed-3c85db32f1d9-kube-api-access-qzg9h\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.842654 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.842553 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ee14f9f-5795-4969-bbed-3c85db32f1d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.842654 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.842586 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee14f9f-5795-4969-bbed-3c85db32f1d9-tmp\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.842654 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.842642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ee14f9f-5795-4969-bbed-3c85db32f1d9-manifests\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.842798 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.842691 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ee14f9f-5795-4969-bbed-3c85db32f1d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.892373 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.892354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:10.943647 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.943601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ee14f9f-5795-4969-bbed-3c85db32f1d9-manifests\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.943647 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.943627 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ee14f9f-5795-4969-bbed-3c85db32f1d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.943780 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.943650 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzg9h\" (UniqueName: \"kubernetes.io/projected/2ee14f9f-5795-4969-bbed-3c85db32f1d9-kube-api-access-qzg9h\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.943780 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.943669 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ee14f9f-5795-4969-bbed-3c85db32f1d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.943780 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.943719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee14f9f-5795-4969-bbed-3c85db32f1d9-tmp\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.944035 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.944012 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2ee14f9f-5795-4969-bbed-3c85db32f1d9-manifests\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.946034 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.946010 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2ee14f9f-5795-4969-bbed-3c85db32f1d9-tmp\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.946123 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.946063 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2ee14f9f-5795-4969-bbed-3c85db32f1d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.946181 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.946167 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2ee14f9f-5795-4969-bbed-3c85db32f1d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.953411 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.953393 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzg9h\" (UniqueName: \"kubernetes.io/projected/2ee14f9f-5795-4969-bbed-3c85db32f1d9-kube-api-access-qzg9h\") pod \"opendatahub-operator-controller-manager-56f86df7d5-wbdmh\" (UID: \"2ee14f9f-5795-4969-bbed-3c85db32f1d9\") " pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.989021 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.989002 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:10.989766 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:10.989749 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:11.101666 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:11.101639 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:11.118516 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:11.118425 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh"] Jun 11 21:23:11.121692 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:23:11.121668 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee14f9f_5795_4969_bbed_3c85db32f1d9.slice/crio-eda0a6aace1b7cbe3534c4c9434f396f392f60a414f214deed426e719a006724 WatchSource:0}: Error finding container eda0a6aace1b7cbe3534c4c9434f396f392f60a414f214deed426e719a006724: Status 404 returned error can't find the container with id eda0a6aace1b7cbe3534c4c9434f396f392f60a414f214deed426e719a006724 Jun 11 21:23:11.191301 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:11.191257 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:11.291825 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:11.291806 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:11.391658 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:11.391632 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:11.737921 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:11.737841 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" event={"ID":"2ee14f9f-5795-4969-bbed-3c85db32f1d9","Type":"ContainerStarted","Data":"eda0a6aace1b7cbe3534c4c9434f396f392f60a414f214deed426e719a006724"} Jun 11 21:23:14.750754 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:14.750722 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" event={"ID":"2ee14f9f-5795-4969-bbed-3c85db32f1d9","Type":"ContainerStarted","Data":"8cb4e3a33c0f229324886bb1a428036b5f587a35ef3a0c752219e52e1bc6e53d"} Jun 11 21:23:15.756928 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:15.756889 2573 generic.go:356] "Generic (PLEG): container finished" podID="2ee14f9f-5795-4969-bbed-3c85db32f1d9" containerID="8cb4e3a33c0f229324886bb1a428036b5f587a35ef3a0c752219e52e1bc6e53d" exitCode=0 Jun 11 21:23:15.757320 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:15.756979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" event={"ID":"2ee14f9f-5795-4969-bbed-3c85db32f1d9","Type":"ContainerDied","Data":"8cb4e3a33c0f229324886bb1a428036b5f587a35ef3a0c752219e52e1bc6e53d"} Jun 11 21:23:16.762064 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:16.762034 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" event={"ID":"2ee14f9f-5795-4969-bbed-3c85db32f1d9","Type":"ContainerStarted","Data":"2a7ef03c97216cb4ae19cca88770308ced6565847d69996f131a69833a3370dc"} Jun 11 21:23:16.762427 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:16.762166 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:16.783550 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:16.783505 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" podStartSLOduration=2.498827259 podStartE2EDuration="6.783477393s" totalImagesPullingTime="3.325659546s" totalInitContainerRuntime="958.990588ms" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:16.782643178 +0000 UTC m=+673.854702195" watchObservedRunningTime="2026-06-11 21:23:16.783477393 +0000 UTC m=+673.855536375" Jun 11 21:23:21.289601 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:21.289569 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:21.389870 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:21.389839 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:27.768219 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:27.768182 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56f86df7d5-wbdmh" Jun 11 21:23:29.462795 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:29.462760 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:29.562283 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:29.562244 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:30.424025 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.423993 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:30.523534 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.523503 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:30.664185 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.664157 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb"] Jun 11 21:23:30.667186 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.667166 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" Jun 11 21:23:30.669710 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.669686 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 11 21:23:30.669710 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.669694 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 11 21:23:30.669886 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.669741 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sd8hc\"" Jun 11 21:23:30.669886 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.669829 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 21:23:30.670859 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.670843 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 21:23:30.678991 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.678931 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb"] Jun 11 21:23:30.759727 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.759704 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dr4bn"] Jun 11 21:23:30.762465 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.762451 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" Jun 11 21:23:30.764768 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.764746 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 11 21:23:30.764882 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.764789 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-w2jbw\"" Jun 11 21:23:30.773332 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.773308 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9a805c5-d361-4a71-a53c-f22750c09c45-tls-certs\") pod \"kube-auth-proxy-6dfb4c6bbc-lwsmb\" (UID: \"c9a805c5-d361-4a71-a53c-f22750c09c45\") " pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" Jun 11 21:23:30.773454 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.773343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9a805c5-d361-4a71-a53c-f22750c09c45-tmp\") pod \"kube-auth-proxy-6dfb4c6bbc-lwsmb\" (UID: \"c9a805c5-d361-4a71-a53c-f22750c09c45\") " pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" Jun 11 21:23:30.773454 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.773418 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqlpn\" (UniqueName: \"kubernetes.io/projected/c9a805c5-d361-4a71-a53c-f22750c09c45-kube-api-access-rqlpn\") pod \"kube-auth-proxy-6dfb4c6bbc-lwsmb\" (UID: \"c9a805c5-d361-4a71-a53c-f22750c09c45\") " pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" Jun 11 21:23:30.774129 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.774099 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:30.774392 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.774373 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dr4bn"] Jun 11 21:23:30.830068 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.830045 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:30.874184 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.874160 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9a805c5-d361-4a71-a53c-f22750c09c45-tmp\") pod \"kube-auth-proxy-6dfb4c6bbc-lwsmb\" (UID: \"c9a805c5-d361-4a71-a53c-f22750c09c45\") " pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" Jun 11 21:23:30.874284 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.874196 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tmf6\" (UniqueName: \"kubernetes.io/projected/cae859c0-ce0d-4675-8bc9-a80df612dc68-kube-api-access-7tmf6\") pod \"odh-model-controller-6dc94f689f-dr4bn\" (UID: \"cae859c0-ce0d-4675-8bc9-a80df612dc68\") " pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" Jun 11 21:23:30.874284 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.874220 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cae859c0-ce0d-4675-8bc9-a80df612dc68-cert\") pod \"odh-model-controller-6dc94f689f-dr4bn\" (UID: \"cae859c0-ce0d-4675-8bc9-a80df612dc68\") " pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" Jun 11 21:23:30.874284 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.874245 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqlpn\" (UniqueName: \"kubernetes.io/projected/c9a805c5-d361-4a71-a53c-f22750c09c45-kube-api-access-rqlpn\") pod \"kube-auth-proxy-6dfb4c6bbc-lwsmb\" (UID: \"c9a805c5-d361-4a71-a53c-f22750c09c45\") " pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" Jun 11 21:23:30.874441 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.874313 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9a805c5-d361-4a71-a53c-f22750c09c45-tls-certs\") pod \"kube-auth-proxy-6dfb4c6bbc-lwsmb\" (UID: \"c9a805c5-d361-4a71-a53c-f22750c09c45\") " pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" Jun 11 21:23:30.876302 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.876277 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9a805c5-d361-4a71-a53c-f22750c09c45-tmp\") pod \"kube-auth-proxy-6dfb4c6bbc-lwsmb\" (UID: \"c9a805c5-d361-4a71-a53c-f22750c09c45\") " pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" Jun 11 21:23:30.876505 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.876473 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c9a805c5-d361-4a71-a53c-f22750c09c45-tls-certs\") pod \"kube-auth-proxy-6dfb4c6bbc-lwsmb\" (UID: \"c9a805c5-d361-4a71-a53c-f22750c09c45\") " pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" Jun 11 21:23:30.881765 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.881742 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqlpn\" (UniqueName: \"kubernetes.io/projected/c9a805c5-d361-4a71-a53c-f22750c09c45-kube-api-access-rqlpn\") pod \"kube-auth-proxy-6dfb4c6bbc-lwsmb\" (UID: \"c9a805c5-d361-4a71-a53c-f22750c09c45\") " pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" Jun 11 21:23:30.934045 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.933995 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:30.975048 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.975023 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tmf6\" (UniqueName: \"kubernetes.io/projected/cae859c0-ce0d-4675-8bc9-a80df612dc68-kube-api-access-7tmf6\") pod \"odh-model-controller-6dc94f689f-dr4bn\" (UID: \"cae859c0-ce0d-4675-8bc9-a80df612dc68\") " pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" Jun 11 21:23:30.975151 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.975059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cae859c0-ce0d-4675-8bc9-a80df612dc68-cert\") pod \"odh-model-controller-6dc94f689f-dr4bn\" (UID: \"cae859c0-ce0d-4675-8bc9-a80df612dc68\") " pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" Jun 11 21:23:30.975151 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:23:30.975135 2573 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 11 21:23:30.975258 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:23:30.975193 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cae859c0-ce0d-4675-8bc9-a80df612dc68-cert podName:cae859c0-ce0d-4675-8bc9-a80df612dc68 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:31.475176503 +0000 UTC m=+688.547235463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/cae859c0-ce0d-4675-8bc9-a80df612dc68-cert") pod "odh-model-controller-6dc94f689f-dr4bn" (UID: "cae859c0-ce0d-4675-8bc9-a80df612dc68") : secret "odh-model-controller-webhook-cert" not found Jun 11 21:23:30.976982 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.976966 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" Jun 11 21:23:30.983271 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:30.983248 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tmf6\" (UniqueName: \"kubernetes.io/projected/cae859c0-ce0d-4675-8bc9-a80df612dc68-kube-api-access-7tmf6\") pod \"odh-model-controller-6dc94f689f-dr4bn\" (UID: \"cae859c0-ce0d-4675-8bc9-a80df612dc68\") " pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" Jun 11 21:23:31.061126 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.061100 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sqw9f"] Jun 11 21:23:31.064597 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.064577 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" Jun 11 21:23:31.067074 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.067053 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 11 21:23:31.079063 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.079039 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sqw9f"] Jun 11 21:23:31.079329 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.079311 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:31.103606 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.103587 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb"] Jun 11 21:23:31.106561 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:23:31.106534 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a805c5_d361_4a71_a53c_f22750c09c45.slice/crio-fe01044e538e230b25fbbe0546f898e098a97de116441d3373213d00a97c9fec WatchSource:0}: Error finding container fe01044e538e230b25fbbe0546f898e098a97de116441d3373213d00a97c9fec: Status 404 returned error can't find the container with id fe01044e538e230b25fbbe0546f898e098a97de116441d3373213d00a97c9fec Jun 11 21:23:31.170056 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.170035 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:31.176199 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.176175 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgsw5\" (UniqueName: \"kubernetes.io/projected/9c2ba0d7-e430-4614-9922-50feb1787c9a-kube-api-access-bgsw5\") pod \"model-serving-api-5dd488fc48-sqw9f\" (UID: \"9c2ba0d7-e430-4614-9922-50feb1787c9a\") " pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" Jun 11 21:23:31.176283 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.176207 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ba0d7-e430-4614-9922-50feb1787c9a-tls-certs\") pod \"model-serving-api-5dd488fc48-sqw9f\" (UID: \"9c2ba0d7-e430-4614-9922-50feb1787c9a\") " pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" Jun 11 21:23:31.277183 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.277156 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgsw5\" (UniqueName: \"kubernetes.io/projected/9c2ba0d7-e430-4614-9922-50feb1787c9a-kube-api-access-bgsw5\") pod \"model-serving-api-5dd488fc48-sqw9f\" (UID: \"9c2ba0d7-e430-4614-9922-50feb1787c9a\") " pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" Jun 11 21:23:31.277306 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.277191 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ba0d7-e430-4614-9922-50feb1787c9a-tls-certs\") pod \"model-serving-api-5dd488fc48-sqw9f\" (UID: \"9c2ba0d7-e430-4614-9922-50feb1787c9a\") " pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" Jun 11 21:23:31.277306 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:23:31.277292 2573 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 11 21:23:31.277415 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:23:31.277351 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c2ba0d7-e430-4614-9922-50feb1787c9a-tls-certs podName:9c2ba0d7-e430-4614-9922-50feb1787c9a nodeName:}" failed. No retries permitted until 2026-06-11 21:23:31.77733606 +0000 UTC m=+688.849395020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9c2ba0d7-e430-4614-9922-50feb1787c9a-tls-certs") pod "model-serving-api-5dd488fc48-sqw9f" (UID: "9c2ba0d7-e430-4614-9922-50feb1787c9a") : secret "model-serving-api-tls" not found Jun 11 21:23:31.288505 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.288460 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgsw5\" (UniqueName: \"kubernetes.io/projected/9c2ba0d7-e430-4614-9922-50feb1787c9a-kube-api-access-bgsw5\") pod \"model-serving-api-5dd488fc48-sqw9f\" (UID: \"9c2ba0d7-e430-4614-9922-50feb1787c9a\") " pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" Jun 11 21:23:31.457893 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.457866 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:31.479051 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.479029 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cae859c0-ce0d-4675-8bc9-a80df612dc68-cert\") pod \"odh-model-controller-6dc94f689f-dr4bn\" (UID: \"cae859c0-ce0d-4675-8bc9-a80df612dc68\") " pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" Jun 11 21:23:31.481225 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.481209 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cae859c0-ce0d-4675-8bc9-a80df612dc68-cert\") pod \"odh-model-controller-6dc94f689f-dr4bn\" (UID: \"cae859c0-ce0d-4675-8bc9-a80df612dc68\") " pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" Jun 11 21:23:31.672599 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.672548 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" Jun 11 21:23:31.781046 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.781014 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ba0d7-e430-4614-9922-50feb1787c9a-tls-certs\") pod \"model-serving-api-5dd488fc48-sqw9f\" (UID: \"9c2ba0d7-e430-4614-9922-50feb1787c9a\") " pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" Jun 11 21:23:31.784688 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.784518 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c2ba0d7-e430-4614-9922-50feb1787c9a-tls-certs\") pod \"model-serving-api-5dd488fc48-sqw9f\" (UID: \"9c2ba0d7-e430-4614-9922-50feb1787c9a\") " pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" Jun 11 21:23:31.815500 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.815254 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dr4bn"] Jun 11 21:23:31.815500 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.815313 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" event={"ID":"c9a805c5-d361-4a71-a53c-f22750c09c45","Type":"ContainerStarted","Data":"fe01044e538e230b25fbbe0546f898e098a97de116441d3373213d00a97c9fec"} Jun 11 21:23:31.818334 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:23:31.818305 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae859c0_ce0d_4675_8bc9_a80df612dc68.slice/crio-7e6b126e5d988416b0f98f99eb4cb14b49917a755c773c1e5592a84b197c1a79 WatchSource:0}: Error finding container 7e6b126e5d988416b0f98f99eb4cb14b49917a755c773c1e5592a84b197c1a79: Status 404 returned error can't find the container with id 7e6b126e5d988416b0f98f99eb4cb14b49917a755c773c1e5592a84b197c1a79 Jun 11 21:23:31.976330 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:31.976299 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" Jun 11 21:23:32.124064 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:32.124034 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sqw9f"] Jun 11 21:23:32.129063 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:23:32.128610 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c2ba0d7_e430_4614_9922_50feb1787c9a.slice/crio-149978cfaff16fb870d897c15ad3784d0bf7226d211d952e9cf1a3b48f92d8ea WatchSource:0}: Error finding container 149978cfaff16fb870d897c15ad3784d0bf7226d211d952e9cf1a3b48f92d8ea: Status 404 returned error can't find the container with id 149978cfaff16fb870d897c15ad3784d0bf7226d211d952e9cf1a3b48f92d8ea Jun 11 21:23:32.821737 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:32.821702 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" event={"ID":"9c2ba0d7-e430-4614-9922-50feb1787c9a","Type":"ContainerStarted","Data":"149978cfaff16fb870d897c15ad3784d0bf7226d211d952e9cf1a3b48f92d8ea"} Jun 11 21:23:32.823544 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:32.823516 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" event={"ID":"cae859c0-ce0d-4675-8bc9-a80df612dc68","Type":"ContainerStarted","Data":"7e6b126e5d988416b0f98f99eb4cb14b49917a755c773c1e5592a84b197c1a79"} Jun 11 21:23:34.900857 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:34.900825 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:35.836948 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:35.836904 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" event={"ID":"cae859c0-ce0d-4675-8bc9-a80df612dc68","Type":"ContainerStarted","Data":"fc166aef726496f4c6cc08857e760c9e3909a221f0893a78caef7b37aaa524df"} Jun 11 21:23:35.837166 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:35.837004 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" Jun 11 21:23:35.838389 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:35.838367 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" event={"ID":"c9a805c5-d361-4a71-a53c-f22750c09c45","Type":"ContainerStarted","Data":"691c92c46246ea739a302671052b61cf7ef8639083800ca8221e553b574f7f51"} Jun 11 21:23:35.839948 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:35.839918 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" event={"ID":"9c2ba0d7-e430-4614-9922-50feb1787c9a","Type":"ContainerStarted","Data":"9dacede20f3b92bb9a25906b98fb7a2aa06cc9e59d779fd8bb3933f49a95592e"} Jun 11 21:23:35.840051 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:35.839985 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" Jun 11 21:23:35.852380 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:35.852319 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" podStartSLOduration=2.007950517 podStartE2EDuration="5.852304287s" totalImagesPullingTime="3.84435377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:35.851453448 +0000 UTC m=+692.923512431" watchObservedRunningTime="2026-06-11 21:23:35.852304287 +0000 UTC m=+692.924363270" Jun 11 21:23:35.865925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:35.865875 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6dfb4c6bbc-lwsmb" podStartSLOduration=1.31377629 podStartE2EDuration="5.86586032s" totalImagesPullingTime="4.55208403s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:35.865430605 +0000 UTC m=+692.937489608" watchObservedRunningTime="2026-06-11 21:23:35.86586032 +0000 UTC m=+692.937919383" Jun 11 21:23:35.879272 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:35.879236 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" podStartSLOduration=1.347974441 podStartE2EDuration="4.879223673s" totalImagesPullingTime="3.531249232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:35.879008488 +0000 UTC m=+692.951067465" watchObservedRunningTime="2026-06-11 21:23:35.879223673 +0000 UTC m=+692.951282657" Jun 11 21:23:40.218682 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.218651 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:40.265302 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.265273 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-crdbx"] Jun 11 21:23:40.268565 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.268545 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" Jun 11 21:23:40.270945 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.270922 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jrzmj\"" Jun 11 21:23:40.271127 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.271115 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 11 21:23:40.282757 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.282716 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-crdbx"] Jun 11 21:23:40.284084 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.284060 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn"] Jun 11 21:23:40.286968 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.286954 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" Jun 11 21:23:40.289279 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.289260 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 11 21:23:40.289420 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.289405 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-5hjml\"" Jun 11 21:23:40.296155 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.296130 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:40.296426 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.296408 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn"] Jun 11 21:23:40.441357 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.441337 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4mrb\" (UniqueName: \"kubernetes.io/projected/48b7db37-def3-494a-9c3c-9460cc11c1df-kube-api-access-t4mrb\") pod \"kserve-controller-manager-69fc866d76-crdbx\" (UID: \"48b7db37-def3-494a-9c3c-9460cc11c1df\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" Jun 11 21:23:40.441558 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.441379 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7db37-def3-494a-9c3c-9460cc11c1df-cert\") pod \"kserve-controller-manager-69fc866d76-crdbx\" (UID: \"48b7db37-def3-494a-9c3c-9460cc11c1df\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" Jun 11 21:23:40.441558 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.441437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wksg4\" (UniqueName: \"kubernetes.io/projected/b4d340e9-c943-4432-9fd0-1276b6e7a0a4-kube-api-access-wksg4\") pod \"llmisvc-controller-manager-864bfd7bc9-5txvn\" (UID: \"b4d340e9-c943-4432-9fd0-1276b6e7a0a4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" Jun 11 21:23:40.441558 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.441474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4d340e9-c943-4432-9fd0-1276b6e7a0a4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5txvn\" (UID: \"b4d340e9-c943-4432-9fd0-1276b6e7a0a4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" Jun 11 21:23:40.542428 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.542404 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7db37-def3-494a-9c3c-9460cc11c1df-cert\") pod \"kserve-controller-manager-69fc866d76-crdbx\" (UID: \"48b7db37-def3-494a-9c3c-9460cc11c1df\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" Jun 11 21:23:40.542540 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.542442 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wksg4\" (UniqueName: \"kubernetes.io/projected/b4d340e9-c943-4432-9fd0-1276b6e7a0a4-kube-api-access-wksg4\") pod \"llmisvc-controller-manager-864bfd7bc9-5txvn\" (UID: \"b4d340e9-c943-4432-9fd0-1276b6e7a0a4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" Jun 11 21:23:40.542540 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.542461 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4d340e9-c943-4432-9fd0-1276b6e7a0a4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5txvn\" (UID: \"b4d340e9-c943-4432-9fd0-1276b6e7a0a4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" Jun 11 21:23:40.542540 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.542493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4mrb\" (UniqueName: \"kubernetes.io/projected/48b7db37-def3-494a-9c3c-9460cc11c1df-kube-api-access-t4mrb\") pod \"kserve-controller-manager-69fc866d76-crdbx\" (UID: \"48b7db37-def3-494a-9c3c-9460cc11c1df\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" Jun 11 21:23:40.542643 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:23:40.542572 2573 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 11 21:23:40.542643 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:23:40.542637 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d340e9-c943-4432-9fd0-1276b6e7a0a4-cert podName:b4d340e9-c943-4432-9fd0-1276b6e7a0a4 nodeName:}" failed. No retries permitted until 2026-06-11 21:23:41.042619205 +0000 UTC m=+698.114678165 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b4d340e9-c943-4432-9fd0-1276b6e7a0a4-cert") pod "llmisvc-controller-manager-864bfd7bc9-5txvn" (UID: "b4d340e9-c943-4432-9fd0-1276b6e7a0a4") : secret "llmisvc-webhook-server-cert" not found Jun 11 21:23:40.544971 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.544944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48b7db37-def3-494a-9c3c-9460cc11c1df-cert\") pod \"kserve-controller-manager-69fc866d76-crdbx\" (UID: \"48b7db37-def3-494a-9c3c-9460cc11c1df\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" Jun 11 21:23:40.560778 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.560641 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4mrb\" (UniqueName: \"kubernetes.io/projected/48b7db37-def3-494a-9c3c-9460cc11c1df-kube-api-access-t4mrb\") pod \"kserve-controller-manager-69fc866d76-crdbx\" (UID: \"48b7db37-def3-494a-9c3c-9460cc11c1df\") " pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" Jun 11 21:23:40.564703 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.564683 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wksg4\" (UniqueName: \"kubernetes.io/projected/b4d340e9-c943-4432-9fd0-1276b6e7a0a4-kube-api-access-wksg4\") pod \"llmisvc-controller-manager-864bfd7bc9-5txvn\" (UID: \"b4d340e9-c943-4432-9fd0-1276b6e7a0a4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" Jun 11 21:23:40.576720 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.576700 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:40.579625 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.579609 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" Jun 11 21:23:40.677598 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.677546 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:40.705284 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.705262 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-crdbx"] Jun 11 21:23:40.707471 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:23:40.707448 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48b7db37_def3_494a_9c3c_9460cc11c1df.slice/crio-1e8afdbb137eff0fe4b69292ee599a946db33c141013568308faff2abc554a6c WatchSource:0}: Error finding container 1e8afdbb137eff0fe4b69292ee599a946db33c141013568308faff2abc554a6c: Status 404 returned error can't find the container with id 1e8afdbb137eff0fe4b69292ee599a946db33c141013568308faff2abc554a6c Jun 11 21:23:40.857244 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:40.857178 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" event={"ID":"48b7db37-def3-494a-9c3c-9460cc11c1df","Type":"ContainerStarted","Data":"1e8afdbb137eff0fe4b69292ee599a946db33c141013568308faff2abc554a6c"} Jun 11 21:23:41.044761 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:41.044737 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4d340e9-c943-4432-9fd0-1276b6e7a0a4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5txvn\" (UID: \"b4d340e9-c943-4432-9fd0-1276b6e7a0a4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" Jun 11 21:23:41.046958 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:41.046938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b4d340e9-c943-4432-9fd0-1276b6e7a0a4-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-5txvn\" (UID: \"b4d340e9-c943-4432-9fd0-1276b6e7a0a4\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" Jun 11 21:23:41.197889 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:41.197826 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" Jun 11 21:23:41.350712 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:41.350685 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn"] Jun 11 21:23:41.352264 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:23:41.352236 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb4d340e9_c943_4432_9fd0_1276b6e7a0a4.slice/crio-11f68c2a94587140459f569f3a22b54371816b90959b72f2d5e18a5bb5a80325 WatchSource:0}: Error finding container 11f68c2a94587140459f569f3a22b54371816b90959b72f2d5e18a5bb5a80325: Status 404 returned error can't find the container with id 11f68c2a94587140459f569f3a22b54371816b90959b72f2d5e18a5bb5a80325 Jun 11 21:23:41.472731 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:41.472699 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:41.571520 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:41.571476 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:41.671455 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:41.671431 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:41.862477 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:41.862409 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" event={"ID":"b4d340e9-c943-4432-9fd0-1276b6e7a0a4","Type":"ContainerStarted","Data":"11f68c2a94587140459f569f3a22b54371816b90959b72f2d5e18a5bb5a80325"} Jun 11 21:23:43.873882 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:43.873849 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" event={"ID":"48b7db37-def3-494a-9c3c-9460cc11c1df","Type":"ContainerStarted","Data":"7031dd21059ab0e205085ff3b1b831295342420ddc4e578d88fb5bf0ea7766d9"} Jun 11 21:23:43.874290 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:43.873952 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" Jun 11 21:23:43.888820 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:43.888762 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" podStartSLOduration=1.135198977 podStartE2EDuration="3.888749307s" totalImagesPullingTime="2.75355033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:43.888306297 +0000 UTC m=+700.960365312" watchObservedRunningTime="2026-06-11 21:23:43.888749307 +0000 UTC m=+700.960808288" Jun 11 21:23:44.538424 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:44.538392 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:44.662804 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:44.662772 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:44.879394 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:44.879322 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" event={"ID":"b4d340e9-c943-4432-9fd0-1276b6e7a0a4","Type":"ContainerStarted","Data":"12886887e65000ea09c572dbcf6749e5644096280faf4c7bf97afe5f155f668b"} Jun 11 21:23:44.879394 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:44.879385 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" Jun 11 21:23:44.902089 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:44.902045 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" podStartSLOduration=1.585156002 podStartE2EDuration="4.902030563s" totalImagesPullingTime="3.316874561s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:44.899954576 +0000 UTC m=+701.972013584" watchObservedRunningTime="2026-06-11 21:23:44.902030563 +0000 UTC m=+701.974089544" Jun 11 21:23:45.615471 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:45.615437 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:45.745414 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:45.745378 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:46.295837 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:46.295804 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:46.597570 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:46.597460 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:46.846044 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:46.845977 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-dr4bn" Jun 11 21:23:46.848085 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:46.848027 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-sqw9f" Jun 11 21:23:47.407333 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.407300 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6b79dc76b5-btgnp"] Jun 11 21:23:47.410642 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.410623 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6b79dc76b5-btgnp" Jun 11 21:23:47.413299 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.413279 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-kbvc7\"" Jun 11 21:23:47.413394 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.413279 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 21:23:47.421617 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.421599 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6b79dc76b5-btgnp"] Jun 11 21:23:47.439630 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.439600 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:47.521235 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.521211 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:47.596277 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.596256 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kntl2\" (UniqueName: \"kubernetes.io/projected/b71f4a29-e23e-484a-9ae0-8ea23a35392a-kube-api-access-kntl2\") pod \"dashboard-redirect-6b79dc76b5-btgnp\" (UID: \"b71f4a29-e23e-484a-9ae0-8ea23a35392a\") " pod="opendatahub/dashboard-redirect-6b79dc76b5-btgnp" Jun 11 21:23:47.596367 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.596283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b71f4a29-e23e-484a-9ae0-8ea23a35392a-redirect-config\") pod \"dashboard-redirect-6b79dc76b5-btgnp\" (UID: \"b71f4a29-e23e-484a-9ae0-8ea23a35392a\") " pod="opendatahub/dashboard-redirect-6b79dc76b5-btgnp" Jun 11 21:23:47.679126 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.679064 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx"] Jun 11 21:23:47.681905 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.681890 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" Jun 11 21:23:47.684343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.684320 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 11 21:23:47.684343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.684331 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 11 21:23:47.684478 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.684352 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-nc8xj\"" Jun 11 21:23:47.695235 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.695217 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx"] Jun 11 21:23:47.697084 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.697067 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kntl2\" (UniqueName: \"kubernetes.io/projected/b71f4a29-e23e-484a-9ae0-8ea23a35392a-kube-api-access-kntl2\") pod \"dashboard-redirect-6b79dc76b5-btgnp\" (UID: \"b71f4a29-e23e-484a-9ae0-8ea23a35392a\") " pod="opendatahub/dashboard-redirect-6b79dc76b5-btgnp" Jun 11 21:23:47.697152 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.697092 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b71f4a29-e23e-484a-9ae0-8ea23a35392a-redirect-config\") pod \"dashboard-redirect-6b79dc76b5-btgnp\" (UID: \"b71f4a29-e23e-484a-9ae0-8ea23a35392a\") " pod="opendatahub/dashboard-redirect-6b79dc76b5-btgnp" Jun 11 21:23:47.697827 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.697804 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/b71f4a29-e23e-484a-9ae0-8ea23a35392a-redirect-config\") pod \"dashboard-redirect-6b79dc76b5-btgnp\" (UID: \"b71f4a29-e23e-484a-9ae0-8ea23a35392a\") " pod="opendatahub/dashboard-redirect-6b79dc76b5-btgnp" Jun 11 21:23:47.708925 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.708905 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kntl2\" (UniqueName: \"kubernetes.io/projected/b71f4a29-e23e-484a-9ae0-8ea23a35392a-kube-api-access-kntl2\") pod \"dashboard-redirect-6b79dc76b5-btgnp\" (UID: \"b71f4a29-e23e-484a-9ae0-8ea23a35392a\") " pod="opendatahub/dashboard-redirect-6b79dc76b5-btgnp" Jun 11 21:23:47.720118 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.720101 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6b79dc76b5-btgnp" Jun 11 21:23:47.798370 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.798341 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxknh\" (UniqueName: \"kubernetes.io/projected/0d6b8ebc-692d-40b1-b2e9-7eef30d34873-kube-api-access-qxknh\") pod \"servicemesh-operator3-57f65f65fb-bqfhx\" (UID: \"0d6b8ebc-692d-40b1-b2e9-7eef30d34873\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" Jun 11 21:23:47.798515 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.798410 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0d6b8ebc-692d-40b1-b2e9-7eef30d34873-operator-config\") pod \"servicemesh-operator3-57f65f65fb-bqfhx\" (UID: \"0d6b8ebc-692d-40b1-b2e9-7eef30d34873\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" Jun 11 21:23:47.858656 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.858541 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6b79dc76b5-btgnp"] Jun 11 21:23:47.861881 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:23:47.861849 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71f4a29_e23e_484a_9ae0_8ea23a35392a.slice/crio-2dfd75d94d87a06c7079b213f8f226d6eeef02cf23e985ae8796ea590ebcf22e WatchSource:0}: Error finding container 2dfd75d94d87a06c7079b213f8f226d6eeef02cf23e985ae8796ea590ebcf22e: Status 404 returned error can't find the container with id 2dfd75d94d87a06c7079b213f8f226d6eeef02cf23e985ae8796ea590ebcf22e Jun 11 21:23:47.892511 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.892467 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6b79dc76b5-btgnp" event={"ID":"b71f4a29-e23e-484a-9ae0-8ea23a35392a","Type":"ContainerStarted","Data":"2dfd75d94d87a06c7079b213f8f226d6eeef02cf23e985ae8796ea590ebcf22e"} Jun 11 21:23:47.898857 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.898832 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0d6b8ebc-692d-40b1-b2e9-7eef30d34873-operator-config\") pod \"servicemesh-operator3-57f65f65fb-bqfhx\" (UID: \"0d6b8ebc-692d-40b1-b2e9-7eef30d34873\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" Jun 11 21:23:47.898923 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.898866 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxknh\" (UniqueName: \"kubernetes.io/projected/0d6b8ebc-692d-40b1-b2e9-7eef30d34873-kube-api-access-qxknh\") pod \"servicemesh-operator3-57f65f65fb-bqfhx\" (UID: \"0d6b8ebc-692d-40b1-b2e9-7eef30d34873\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" Jun 11 21:23:47.901269 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.901240 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0d6b8ebc-692d-40b1-b2e9-7eef30d34873-operator-config\") pod \"servicemesh-operator3-57f65f65fb-bqfhx\" (UID: \"0d6b8ebc-692d-40b1-b2e9-7eef30d34873\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" Jun 11 21:23:47.910209 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.910186 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxknh\" (UniqueName: \"kubernetes.io/projected/0d6b8ebc-692d-40b1-b2e9-7eef30d34873-kube-api-access-qxknh\") pod \"servicemesh-operator3-57f65f65fb-bqfhx\" (UID: \"0d6b8ebc-692d-40b1-b2e9-7eef30d34873\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" Jun 11 21:23:47.990035 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:47.990016 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" Jun 11 21:23:48.130024 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:48.129959 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx"] Jun 11 21:23:48.132936 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:23:48.132909 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d6b8ebc_692d_40b1_b2e9_7eef30d34873.slice/crio-b6e623bcb593b71ff986651a22115771d87115d9fdfa442064f527a39f957041 WatchSource:0}: Error finding container b6e623bcb593b71ff986651a22115771d87115d9fdfa442064f527a39f957041: Status 404 returned error can't find the container with id b6e623bcb593b71ff986651a22115771d87115d9fdfa442064f527a39f957041 Jun 11 21:23:48.899275 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:48.899231 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" event={"ID":"0d6b8ebc-692d-40b1-b2e9-7eef30d34873","Type":"ContainerStarted","Data":"b6e623bcb593b71ff986651a22115771d87115d9fdfa442064f527a39f957041"} Jun 11 21:23:49.907140 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:49.907107 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6b79dc76b5-btgnp" event={"ID":"b71f4a29-e23e-484a-9ae0-8ea23a35392a","Type":"ContainerStarted","Data":"3e98f3686ff396241d42bc5d21aac4f88b472535a4fa086bc859f127250e0e8d"} Jun 11 21:23:49.936148 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:49.935943 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6b79dc76b5-btgnp" podStartSLOduration=1.058224216 podStartE2EDuration="2.935925253s" totalImagesPullingTime="1.877701037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:49.934372672 +0000 UTC m=+707.006431687" watchObservedRunningTime="2026-06-11 21:23:49.935925253 +0000 UTC m=+707.007984236" Jun 11 21:23:51.918640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:51.918601 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" event={"ID":"0d6b8ebc-692d-40b1-b2e9-7eef30d34873","Type":"ContainerStarted","Data":"419d664d7523630601c5017eedfffe90204e4b1330d863047a235e46fc347348"} Jun 11 21:23:51.919054 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:51.918743 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" Jun 11 21:23:51.941336 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:51.941282 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" podStartSLOduration=1.345814312 podStartE2EDuration="4.941262837s" totalImagesPullingTime="3.595448525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:23:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:23:51.939861989 +0000 UTC m=+709.011920993" watchObservedRunningTime="2026-06-11 21:23:51.941262837 +0000 UTC m=+709.013321821" Jun 11 21:23:57.726016 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:57.725978 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:23:57.825754 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:23:57.825726 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:02.405455 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.405412 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:02.405963 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.405944 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r"] Jun 11 21:24:02.409294 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.409279 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.411752 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.411668 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 11 21:24:02.411752 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.411692 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 11 21:24:02.411752 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.411695 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 11 21:24:02.411752 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.411737 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xw2l8\"" Jun 11 21:24:02.412040 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.411717 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 21:24:02.418473 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.418452 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r"] Jun 11 21:24:02.497938 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.497915 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.498040 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.497951 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.498040 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.497967 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbqvd\" (UniqueName: \"kubernetes.io/projected/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-kube-api-access-hbqvd\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.498040 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.498000 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.498145 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.498070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.498145 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.498108 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.498145 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.498134 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.499406 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.499386 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:02.598756 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.598724 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.598870 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.598774 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.598932 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.598887 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.598932 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.598916 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.599017 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.598949 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.599017 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.598995 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.599121 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.599021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbqvd\" (UniqueName: \"kubernetes.io/projected/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-kube-api-access-hbqvd\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.599574 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.599528 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.601247 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.601193 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.601247 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.601226 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.601399 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.601340 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.601463 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.601439 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.606212 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.606185 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.606430 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.606413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbqvd\" (UniqueName: \"kubernetes.io/projected/6018e123-b1f0-4f4d-bbb0-e294c68cd79b-kube-api-access-hbqvd\") pod \"istiod-openshift-gateway-75c67f8887-87b4r\" (UID: \"6018e123-b1f0-4f4d-bbb0-e294c68cd79b\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.719652 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.719629 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:02.850898 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.850870 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r"] Jun 11 21:24:02.853344 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:24:02.853318 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6018e123_b1f0_4f4d_bbb0_e294c68cd79b.slice/crio-ce1a8479af22cda88ed653d69f2652b49813dee4a3855a96003ca3b248672511 WatchSource:0}: Error finding container ce1a8479af22cda88ed653d69f2652b49813dee4a3855a96003ca3b248672511: Status 404 returned error can't find the container with id ce1a8479af22cda88ed653d69f2652b49813dee4a3855a96003ca3b248672511 Jun 11 21:24:02.924796 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.924770 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-bqfhx" Jun 11 21:24:02.952915 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.952884 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:02.974322 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:02.974258 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" event={"ID":"6018e123-b1f0-4f4d-bbb0-e294c68cd79b","Type":"ContainerStarted","Data":"ce1a8479af22cda88ed653d69f2652b49813dee4a3855a96003ca3b248672511"} Jun 11 21:24:07.011203 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:07.011163 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 21:24:07.011462 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:07.011232 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 11 21:24:07.999304 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:07.999268 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" event={"ID":"6018e123-b1f0-4f4d-bbb0-e294c68cd79b","Type":"ContainerStarted","Data":"88af99e1541250cf407ff2a200a371c56cd99f92140de73b4af85616cdcb512a"} Jun 11 21:24:07.999479 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:07.999372 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:08.017273 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:08.017224 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" podStartSLOduration=1.8622160380000001 podStartE2EDuration="6.017207283s" totalImagesPullingTime="4.154991245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:24:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:24:08.016103116 +0000 UTC m=+725.088162131" watchObservedRunningTime="2026-06-11 21:24:08.017207283 +0000 UTC m=+725.089266268" Jun 11 21:24:08.167819 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:08.167767 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:08.219229 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:08.219191 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:08.461610 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:08.461535 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:08.586671 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:08.586640 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:08.692811 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:08.692783 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:09.005153 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:09.005121 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-87b4r" Jun 11 21:24:09.197363 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:09.197331 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:14.884756 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:14.884728 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-crdbx" Jun 11 21:24:15.885755 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:15.885719 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-5txvn" Jun 11 21:24:30.932552 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:30.932519 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:31.031042 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:31.031015 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:31.107388 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:31.107352 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:36.745612 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:36.745583 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:36.796602 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:36.796581 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:53.495599 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:53.495566 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:56.249029 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:56.248998 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:24:57.047242 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:24:57.047215 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:00.649942 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:00.649900 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:01.304939 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:01.304880 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:03.698696 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:03.698663 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:04.695359 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.695323 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns"] Jun 11 21:25:04.698600 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.698580 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:04.701071 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.701052 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 21:25:04.701434 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.701100 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 21:25:04.701434 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.701111 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5qgnm\"" Jun 11 21:25:04.712282 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.712255 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns"] Jun 11 21:25:04.826739 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.826707 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/851c5978-82b0-44b8-a54f-c1a45927ed0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" (UID: \"851c5978-82b0-44b8-a54f-c1a45927ed0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:04.826859 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.826768 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgdgm\" (UniqueName: \"kubernetes.io/projected/851c5978-82b0-44b8-a54f-c1a45927ed0e-kube-api-access-cgdgm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" (UID: \"851c5978-82b0-44b8-a54f-c1a45927ed0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:04.928025 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.927991 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgdgm\" (UniqueName: \"kubernetes.io/projected/851c5978-82b0-44b8-a54f-c1a45927ed0e-kube-api-access-cgdgm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" (UID: \"851c5978-82b0-44b8-a54f-c1a45927ed0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:04.928123 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.928040 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/851c5978-82b0-44b8-a54f-c1a45927ed0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" (UID: \"851c5978-82b0-44b8-a54f-c1a45927ed0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:04.928328 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.928314 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/851c5978-82b0-44b8-a54f-c1a45927ed0e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" (UID: \"851c5978-82b0-44b8-a54f-c1a45927ed0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:04.937713 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:04.937693 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgdgm\" (UniqueName: \"kubernetes.io/projected/851c5978-82b0-44b8-a54f-c1a45927ed0e-kube-api-access-cgdgm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" (UID: \"851c5978-82b0-44b8-a54f-c1a45927ed0e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:05.008187 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:05.008167 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:05.132495 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:05.132461 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns"] Jun 11 21:25:05.135426 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:25:05.135397 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod851c5978_82b0_44b8_a54f_c1a45927ed0e.slice/crio-b9e4a4f087f19c524fc2362fc083b610d163697a9fa2f813258c47266aed82ff WatchSource:0}: Error finding container b9e4a4f087f19c524fc2362fc083b610d163697a9fa2f813258c47266aed82ff: Status 404 returned error can't find the container with id b9e4a4f087f19c524fc2362fc083b610d163697a9fa2f813258c47266aed82ff Jun 11 21:25:05.237382 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:05.237345 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" event={"ID":"851c5978-82b0-44b8-a54f-c1a45927ed0e","Type":"ContainerStarted","Data":"b9e4a4f087f19c524fc2362fc083b610d163697a9fa2f813258c47266aed82ff"} Jun 11 21:25:05.901730 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:05.901663 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:08.693190 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:08.693086 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:11.265748 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:11.265712 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" event={"ID":"851c5978-82b0-44b8-a54f-c1a45927ed0e","Type":"ContainerStarted","Data":"e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5"} Jun 11 21:25:11.266095 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:11.265798 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:11.286262 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:11.286235 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:11.286387 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:11.286247 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" podStartSLOduration=1.511928196 podStartE2EDuration="7.286233255s" totalImagesPullingTime="5.774305059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:25:11.284920939 +0000 UTC m=+788.356979941" watchObservedRunningTime="2026-06-11 21:25:11.286233255 +0000 UTC m=+788.358292237" Jun 11 21:25:13.577964 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:13.577932 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:13.684260 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:13.684233 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:15.248054 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:15.247998 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:15.295544 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:15.295522 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:15.642162 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:15.642095 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:15.706733 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:15.706708 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:19.261913 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:19.261879 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:19.315712 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:19.315675 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:20.942219 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:20.942189 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:21.000255 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:21.000229 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:22.271847 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:22.271816 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:23.454430 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.454396 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf"] Jun 11 21:25:23.457528 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.457512 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:23.471789 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.471766 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf"] Jun 11 21:25:23.573961 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.573931 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dsdn\" (UniqueName: \"kubernetes.io/projected/d892a59d-6eea-44de-8edc-b254aeed7802-kube-api-access-6dsdn\") pod \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" (UID: \"d892a59d-6eea-44de-8edc-b254aeed7802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:23.574141 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.573988 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d892a59d-6eea-44de-8edc-b254aeed7802-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" (UID: \"d892a59d-6eea-44de-8edc-b254aeed7802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:23.674549 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.674514 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d892a59d-6eea-44de-8edc-b254aeed7802-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" (UID: \"d892a59d-6eea-44de-8edc-b254aeed7802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:23.674673 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.674584 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dsdn\" (UniqueName: \"kubernetes.io/projected/d892a59d-6eea-44de-8edc-b254aeed7802-kube-api-access-6dsdn\") pod \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" (UID: \"d892a59d-6eea-44de-8edc-b254aeed7802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:23.674985 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.674967 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d892a59d-6eea-44de-8edc-b254aeed7802-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" (UID: \"d892a59d-6eea-44de-8edc-b254aeed7802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:23.684560 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.684537 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dsdn\" (UniqueName: \"kubernetes.io/projected/d892a59d-6eea-44de-8edc-b254aeed7802-kube-api-access-6dsdn\") pod \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" (UID: \"d892a59d-6eea-44de-8edc-b254aeed7802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:23.767395 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.767371 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:23.870412 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.870378 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf"] Jun 11 21:25:23.875784 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.875756 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf"] Jun 11 21:25:23.882512 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:25:23.882467 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd892a59d_6eea_44de_8edc_b254aeed7802.slice/crio-c2fa580726c7da36b9bd865e332046aef050ae082a50dff7296623f72ea2f7b0 WatchSource:0}: Error finding container c2fa580726c7da36b9bd865e332046aef050ae082a50dff7296623f72ea2f7b0: Status 404 returned error can't find the container with id c2fa580726c7da36b9bd865e332046aef050ae082a50dff7296623f72ea2f7b0 Jun 11 21:25:23.897408 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.897387 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7"] Jun 11 21:25:23.900548 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.900532 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:23.905170 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.905102 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns"] Jun 11 21:25:23.905304 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.905283 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" containerName="manager" containerID="cri-o://e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5" gracePeriod=2 Jun 11 21:25:23.916356 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.915876 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7"] Jun 11 21:25:23.919370 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:23.919347 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns"] Jun 11 21:25:23.932005 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:23.931962 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:24.078214 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.078177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d6865e0-1257-4fe4-8c0d-d43adefb817d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4vtv7\" (UID: \"5d6865e0-1257-4fe4-8c0d-d43adefb817d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:24.078214 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.078225 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rc6s\" (UniqueName: \"kubernetes.io/projected/5d6865e0-1257-4fe4-8c0d-d43adefb817d-kube-api-access-8rc6s\") pod \"kuadrant-operator-controller-manager-55467d9f7-4vtv7\" (UID: \"5d6865e0-1257-4fe4-8c0d-d43adefb817d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:24.140611 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.140585 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:24.142854 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:24.142820 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:24.179239 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.179214 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d6865e0-1257-4fe4-8c0d-d43adefb817d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4vtv7\" (UID: \"5d6865e0-1257-4fe4-8c0d-d43adefb817d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:24.179361 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.179245 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rc6s\" (UniqueName: \"kubernetes.io/projected/5d6865e0-1257-4fe4-8c0d-d43adefb817d-kube-api-access-8rc6s\") pod \"kuadrant-operator-controller-manager-55467d9f7-4vtv7\" (UID: \"5d6865e0-1257-4fe4-8c0d-d43adefb817d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:24.179643 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.179623 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d6865e0-1257-4fe4-8c0d-d43adefb817d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-4vtv7\" (UID: \"5d6865e0-1257-4fe4-8c0d-d43adefb817d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:24.186917 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.186899 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rc6s\" (UniqueName: \"kubernetes.io/projected/5d6865e0-1257-4fe4-8c0d-d43adefb817d-kube-api-access-8rc6s\") pod \"kuadrant-operator-controller-manager-55467d9f7-4vtv7\" (UID: \"5d6865e0-1257-4fe4-8c0d-d43adefb817d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:24.279576 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.279520 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cgdgm\" (UniqueName: \"kubernetes.io/projected/851c5978-82b0-44b8-a54f-c1a45927ed0e-kube-api-access-cgdgm\") pod \"851c5978-82b0-44b8-a54f-c1a45927ed0e\" (UID: \"851c5978-82b0-44b8-a54f-c1a45927ed0e\") " Jun 11 21:25:24.279679 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.279590 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/851c5978-82b0-44b8-a54f-c1a45927ed0e-extensions-socket-volume\") pod \"851c5978-82b0-44b8-a54f-c1a45927ed0e\" (UID: \"851c5978-82b0-44b8-a54f-c1a45927ed0e\") " Jun 11 21:25:24.280053 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.280031 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/851c5978-82b0-44b8-a54f-c1a45927ed0e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "851c5978-82b0-44b8-a54f-c1a45927ed0e" (UID: "851c5978-82b0-44b8-a54f-c1a45927ed0e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:25:24.281646 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.281625 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/851c5978-82b0-44b8-a54f-c1a45927ed0e-kube-api-access-cgdgm" (OuterVolumeSpecName: "kube-api-access-cgdgm") pod "851c5978-82b0-44b8-a54f-c1a45927ed0e" (UID: "851c5978-82b0-44b8-a54f-c1a45927ed0e"). InnerVolumeSpecName "kube-api-access-cgdgm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:25:24.298870 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.298849 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:24.322726 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.322695 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" podUID="d892a59d-6eea-44de-8edc-b254aeed7802" containerName="manager" containerID="cri-o://d1126a86e09b3b59af58308ff360df4094a2726c10802fd242a74ed6cb3e18ad" gracePeriod=2 Jun 11 21:25:24.324032 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.324008 2573 generic.go:356] "Generic (PLEG): container finished" podID="851c5978-82b0-44b8-a54f-c1a45927ed0e" containerID="e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5" exitCode=0 Jun 11 21:25:24.324130 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.324064 2573 scope.go:117] "RemoveContainer" containerID="e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5" Jun 11 21:25:24.324186 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.324062 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:24.324846 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:24.324817 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:24.327185 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:24.326793 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="d892a59d-6eea-44de-8edc-b254aeed7802" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:24.328650 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:24.328616 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="d892a59d-6eea-44de-8edc-b254aeed7802" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:24.330476 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:24.330452 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:24.332565 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.332550 2573 scope.go:117] "RemoveContainer" containerID="e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5" Jun 11 21:25:24.332811 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:24.332795 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5\": container with ID starting with e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5 not found: ID does not exist" containerID="e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5" Jun 11 21:25:24.332869 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.332820 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5"} err="failed to get container status \"e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5\": rpc error: code = NotFound desc = could not find container \"e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5\": container with ID starting with e84bbff66ec0691089e9f5b871ec00c9b6062acda80cd33edc098b28956982f5 not found: ID does not exist" Jun 11 21:25:24.380356 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.380332 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cgdgm\" (UniqueName: \"kubernetes.io/projected/851c5978-82b0-44b8-a54f-c1a45927ed0e-kube-api-access-cgdgm\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:25:24.380356 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.380361 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/851c5978-82b0-44b8-a54f-c1a45927ed0e-extensions-socket-volume\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:25:24.384117 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:24.384083 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:24.385867 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:24.385843 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="d892a59d-6eea-44de-8edc-b254aeed7802" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:24.433321 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.433294 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7"] Jun 11 21:25:24.435601 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:25:24.435577 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d6865e0_1257_4fe4_8c0d_d43adefb817d.slice/crio-57c69b3b803f2dae2d698878da5128c4bd1c3c74d2cbd341e86d5bf3fa4c0344 WatchSource:0}: Error finding container 57c69b3b803f2dae2d698878da5128c4bd1c3c74d2cbd341e86d5bf3fa4c0344: Status 404 returned error can't find the container with id 57c69b3b803f2dae2d698878da5128c4bd1c3c74d2cbd341e86d5bf3fa4c0344 Jun 11 21:25:24.558776 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.558753 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:24.560904 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:24.560881 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:24.562807 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:24.562788 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="d892a59d-6eea-44de-8edc-b254aeed7802" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:24.681831 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.681810 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d892a59d-6eea-44de-8edc-b254aeed7802-extensions-socket-volume\") pod \"d892a59d-6eea-44de-8edc-b254aeed7802\" (UID: \"d892a59d-6eea-44de-8edc-b254aeed7802\") " Jun 11 21:25:24.681954 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.681854 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dsdn\" (UniqueName: \"kubernetes.io/projected/d892a59d-6eea-44de-8edc-b254aeed7802-kube-api-access-6dsdn\") pod \"d892a59d-6eea-44de-8edc-b254aeed7802\" (UID: \"d892a59d-6eea-44de-8edc-b254aeed7802\") " Jun 11 21:25:24.682097 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.682069 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d892a59d-6eea-44de-8edc-b254aeed7802-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d892a59d-6eea-44de-8edc-b254aeed7802" (UID: "d892a59d-6eea-44de-8edc-b254aeed7802"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:25:24.683743 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.683725 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d892a59d-6eea-44de-8edc-b254aeed7802-kube-api-access-6dsdn" (OuterVolumeSpecName: "kube-api-access-6dsdn") pod "d892a59d-6eea-44de-8edc-b254aeed7802" (UID: "d892a59d-6eea-44de-8edc-b254aeed7802"). InnerVolumeSpecName "kube-api-access-6dsdn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:25:24.782403 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.782378 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d892a59d-6eea-44de-8edc-b254aeed7802-extensions-socket-volume\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:25:24.782403 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.782401 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dsdn\" (UniqueName: \"kubernetes.io/projected/d892a59d-6eea-44de-8edc-b254aeed7802-kube-api-access-6dsdn\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:25:24.870142 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:24.870059 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:25.331047 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.331013 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" event={"ID":"5d6865e0-1257-4fe4-8c0d-d43adefb817d","Type":"ContainerStarted","Data":"05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6"} Jun 11 21:25:25.331214 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.331069 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" event={"ID":"5d6865e0-1257-4fe4-8c0d-d43adefb817d","Type":"ContainerStarted","Data":"57c69b3b803f2dae2d698878da5128c4bd1c3c74d2cbd341e86d5bf3fa4c0344"} Jun 11 21:25:25.331214 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.331101 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:25.332229 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.332206 2573 generic.go:356] "Generic (PLEG): container finished" podID="d892a59d-6eea-44de-8edc-b254aeed7802" containerID="d1126a86e09b3b59af58308ff360df4094a2726c10802fd242a74ed6cb3e18ad" exitCode=2 Jun 11 21:25:25.332336 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.332239 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:25.332336 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.332249 2573 scope.go:117] "RemoveContainer" containerID="d1126a86e09b3b59af58308ff360df4094a2726c10802fd242a74ed6cb3e18ad" Jun 11 21:25:25.339378 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.339354 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:25.341217 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.341201 2573 scope.go:117] "RemoveContainer" containerID="d1126a86e09b3b59af58308ff360df4094a2726c10802fd242a74ed6cb3e18ad" Jun 11 21:25:25.341468 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:25.341452 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1126a86e09b3b59af58308ff360df4094a2726c10802fd242a74ed6cb3e18ad\": container with ID starting with d1126a86e09b3b59af58308ff360df4094a2726c10802fd242a74ed6cb3e18ad not found: ID does not exist" containerID="d1126a86e09b3b59af58308ff360df4094a2726c10802fd242a74ed6cb3e18ad" Jun 11 21:25:25.341538 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.341477 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1126a86e09b3b59af58308ff360df4094a2726c10802fd242a74ed6cb3e18ad"} err="failed to get container status \"d1126a86e09b3b59af58308ff360df4094a2726c10802fd242a74ed6cb3e18ad\": rpc error: code = NotFound desc = could not find container \"d1126a86e09b3b59af58308ff360df4094a2726c10802fd242a74ed6cb3e18ad\": container with ID starting with d1126a86e09b3b59af58308ff360df4094a2726c10802fd242a74ed6cb3e18ad not found: ID does not exist" Jun 11 21:25:25.351625 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.351587 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" podStartSLOduration=2.351575374 podStartE2EDuration="2.351575374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:25:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:25:25.350310439 +0000 UTC m=+802.422369421" watchObservedRunningTime="2026-06-11 21:25:25.351575374 +0000 UTC m=+802.423634356" Jun 11 21:25:25.352205 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:25.352171 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:25.354005 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:25.353982 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="d892a59d-6eea-44de-8edc-b254aeed7802" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:25.355846 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:25.355824 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-7klvf\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="d892a59d-6eea-44de-8edc-b254aeed7802" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-7klvf" Jun 11 21:25:25.357601 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:25.357578 2573 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-5kqns\" is forbidden: User \"system:node:ip-10-0-129-28.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-129-28.ec2.internal' and this object" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-5kqns" Jun 11 21:25:25.396475 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.396444 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" path="/var/lib/kubelet/pods/851c5978-82b0-44b8-a54f-c1a45927ed0e/volumes" Jun 11 21:25:25.396862 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.396842 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d892a59d-6eea-44de-8edc-b254aeed7802" path="/var/lib/kubelet/pods/d892a59d-6eea-44de-8edc-b254aeed7802/volumes" Jun 11 21:25:25.436967 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:25.436948 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:29.598566 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:29.598530 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:29.698982 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:29.698952 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:31.569338 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:31.569309 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:31.669631 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:31.669600 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:33.071345 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:33.071309 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:33.172086 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:33.172054 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:36.340533 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.340476 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:36.590993 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.590924 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb"] Jun 11 21:25:36.591205 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.591194 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" containerName="manager" Jun 11 21:25:36.591252 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.591207 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" containerName="manager" Jun 11 21:25:36.591252 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.591221 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d892a59d-6eea-44de-8edc-b254aeed7802" containerName="manager" Jun 11 21:25:36.591252 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.591227 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d892a59d-6eea-44de-8edc-b254aeed7802" containerName="manager" Jun 11 21:25:36.591338 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.591279 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="851c5978-82b0-44b8-a54f-c1a45927ed0e" containerName="manager" Jun 11 21:25:36.591338 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.591286 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d892a59d-6eea-44de-8edc-b254aeed7802" containerName="manager" Jun 11 21:25:36.596797 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.596770 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" Jun 11 21:25:36.608233 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.608212 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb"] Jun 11 21:25:36.634248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.634225 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:36.659085 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.659060 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4vz7\" (UniqueName: \"kubernetes.io/projected/507a5100-2aae-43b5-98da-012ac3170d50-kube-api-access-k4vz7\") pod \"kuadrant-operator-controller-manager-86878c769f-tpjnb\" (UID: \"507a5100-2aae-43b5-98da-012ac3170d50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" Jun 11 21:25:36.659182 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.659109 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/507a5100-2aae-43b5-98da-012ac3170d50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tpjnb\" (UID: \"507a5100-2aae-43b5-98da-012ac3170d50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" Jun 11 21:25:36.723013 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.722993 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:36.759723 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.759698 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4vz7\" (UniqueName: \"kubernetes.io/projected/507a5100-2aae-43b5-98da-012ac3170d50-kube-api-access-k4vz7\") pod \"kuadrant-operator-controller-manager-86878c769f-tpjnb\" (UID: \"507a5100-2aae-43b5-98da-012ac3170d50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" Jun 11 21:25:36.759807 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.759746 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/507a5100-2aae-43b5-98da-012ac3170d50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tpjnb\" (UID: \"507a5100-2aae-43b5-98da-012ac3170d50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" Jun 11 21:25:36.760168 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.760149 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/507a5100-2aae-43b5-98da-012ac3170d50-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-tpjnb\" (UID: \"507a5100-2aae-43b5-98da-012ac3170d50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" Jun 11 21:25:36.768391 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.768369 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4vz7\" (UniqueName: \"kubernetes.io/projected/507a5100-2aae-43b5-98da-012ac3170d50-kube-api-access-k4vz7\") pod \"kuadrant-operator-controller-manager-86878c769f-tpjnb\" (UID: \"507a5100-2aae-43b5-98da-012ac3170d50\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" Jun 11 21:25:36.906388 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:36.906319 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" Jun 11 21:25:37.039157 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:37.039127 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb"] Jun 11 21:25:37.042478 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:25:37.042445 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod507a5100_2aae_43b5_98da_012ac3170d50.slice/crio-baa270c51630ac8db33f7b8e8f913173f896484d909c9c28c30339093d66cdee WatchSource:0}: Error finding container baa270c51630ac8db33f7b8e8f913173f896484d909c9c28c30339093d66cdee: Status 404 returned error can't find the container with id baa270c51630ac8db33f7b8e8f913173f896484d909c9c28c30339093d66cdee Jun 11 21:25:37.388443 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:37.388409 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" event={"ID":"507a5100-2aae-43b5-98da-012ac3170d50","Type":"ContainerStarted","Data":"dbcb6357f9fc0a4a0b463a265648c1dc7b8b67baa9f31ccc71b6a766914ebaa3"} Jun 11 21:25:37.388880 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:37.388515 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" event={"ID":"507a5100-2aae-43b5-98da-012ac3170d50","Type":"ContainerStarted","Data":"baa270c51630ac8db33f7b8e8f913173f896484d909c9c28c30339093d66cdee"} Jun 11 21:25:37.388880 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:37.388552 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" Jun 11 21:25:37.408199 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:37.408150 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" podStartSLOduration=1.408135509 podStartE2EDuration="1.408135509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:25:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:25:37.407373731 +0000 UTC m=+814.479432714" watchObservedRunningTime="2026-06-11 21:25:37.408135509 +0000 UTC m=+814.480194518" Jun 11 21:25:43.083967 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:43.083920 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:43.178628 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:43.178598 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:47.440099 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:47.440070 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:47.542772 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:47.542744 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:48.395694 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:48.395667 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-tpjnb" Jun 11 21:25:48.444590 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:48.444555 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7"] Jun 11 21:25:48.445363 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:48.445306 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" podUID="5d6865e0-1257-4fe4-8c0d-d43adefb817d" containerName="manager" containerID="cri-o://05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6" gracePeriod=10 Jun 11 21:25:48.689140 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:48.689119 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:48.742682 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:48.742657 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8rc6s\" (UniqueName: \"kubernetes.io/projected/5d6865e0-1257-4fe4-8c0d-d43adefb817d-kube-api-access-8rc6s\") pod \"5d6865e0-1257-4fe4-8c0d-d43adefb817d\" (UID: \"5d6865e0-1257-4fe4-8c0d-d43adefb817d\") " Jun 11 21:25:48.742796 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:48.742725 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d6865e0-1257-4fe4-8c0d-d43adefb817d-extensions-socket-volume\") pod \"5d6865e0-1257-4fe4-8c0d-d43adefb817d\" (UID: \"5d6865e0-1257-4fe4-8c0d-d43adefb817d\") " Jun 11 21:25:48.743062 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:48.743035 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d6865e0-1257-4fe4-8c0d-d43adefb817d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5d6865e0-1257-4fe4-8c0d-d43adefb817d" (UID: "5d6865e0-1257-4fe4-8c0d-d43adefb817d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 21:25:48.744518 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:48.744477 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d6865e0-1257-4fe4-8c0d-d43adefb817d-kube-api-access-8rc6s" (OuterVolumeSpecName: "kube-api-access-8rc6s") pod "5d6865e0-1257-4fe4-8c0d-d43adefb817d" (UID: "5d6865e0-1257-4fe4-8c0d-d43adefb817d"). InnerVolumeSpecName "kube-api-access-8rc6s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 21:25:48.844119 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:48.844088 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8rc6s\" (UniqueName: \"kubernetes.io/projected/5d6865e0-1257-4fe4-8c0d-d43adefb817d-kube-api-access-8rc6s\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:25:48.844119 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:48.844111 2573 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5d6865e0-1257-4fe4-8c0d-d43adefb817d-extensions-socket-volume\") on node \"ip-10-0-129-28.ec2.internal\" DevicePath \"\"" Jun 11 21:25:49.441913 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:49.441885 2573 generic.go:356] "Generic (PLEG): container finished" podID="5d6865e0-1257-4fe4-8c0d-d43adefb817d" containerID="05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6" exitCode=0 Jun 11 21:25:49.442041 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:49.441936 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" event={"ID":"5d6865e0-1257-4fe4-8c0d-d43adefb817d","Type":"ContainerDied","Data":"05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6"} Jun 11 21:25:49.442041 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:49.441938 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" Jun 11 21:25:49.442041 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:49.441974 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7" event={"ID":"5d6865e0-1257-4fe4-8c0d-d43adefb817d","Type":"ContainerDied","Data":"57c69b3b803f2dae2d698878da5128c4bd1c3c74d2cbd341e86d5bf3fa4c0344"} Jun 11 21:25:49.442041 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:49.441996 2573 scope.go:117] "RemoveContainer" containerID="05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6" Jun 11 21:25:49.450669 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:49.450439 2573 scope.go:117] "RemoveContainer" containerID="05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6" Jun 11 21:25:49.450876 ip-10-0-129-28 kubenswrapper[2573]: E0611 21:25:49.450696 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6\": container with ID starting with 05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6 not found: ID does not exist" containerID="05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6" Jun 11 21:25:49.450876 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:49.450717 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6"} err="failed to get container status \"05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6\": rpc error: code = NotFound desc = could not find container \"05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6\": container with ID starting with 05b0b0d27dbefc9ad6d8ea7dfbf134f8f4a1891889a3a0c26c4ad51dd11a0ed6 not found: ID does not exist" Jun 11 21:25:49.459662 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:49.459637 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7"] Jun 11 21:25:49.465172 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:49.465149 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-4vtv7"] Jun 11 21:25:51.396821 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:51.396788 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d6865e0-1257-4fe4-8c0d-d43adefb817d" path="/var/lib/kubelet/pods/5d6865e0-1257-4fe4-8c0d-d43adefb817d/volumes" Jun 11 21:25:52.694104 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:52.694075 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:52.813342 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:52.813313 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:52.913389 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:52.913343 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:53.436668 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:53.436633 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:53.486220 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:53.486194 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:57.246683 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:57.246652 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:25:57.308699 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:25:57.308675 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:04.436464 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:04.436430 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:04.487125 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:04.487096 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:05.996080 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:05.996050 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:06.103982 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.103951 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:06.203876 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.203849 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:06.399649 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.399574 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wx5gd"] Jun 11 21:26:06.399902 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.399888 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d6865e0-1257-4fe4-8c0d-d43adefb817d" containerName="manager" Jun 11 21:26:06.399948 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.399904 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d6865e0-1257-4fe4-8c0d-d43adefb817d" containerName="manager" Jun 11 21:26:06.399986 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.399949 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d6865e0-1257-4fe4-8c0d-d43adefb817d" containerName="manager" Jun 11 21:26:06.404195 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.404176 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" Jun 11 21:26:06.406610 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.406582 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 11 21:26:06.406712 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.406643 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lszq9\"" Jun 11 21:26:06.416995 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.416969 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wx5gd"] Jun 11 21:26:06.441030 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.441007 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wx5gd"] Jun 11 21:26:06.468174 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.468148 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svsnl\" (UniqueName: \"kubernetes.io/projected/651af887-1c4f-47af-b448-3ad545dc2f3a-kube-api-access-svsnl\") pod \"limitador-limitador-54d6d988d5-wx5gd\" (UID: \"651af887-1c4f-47af-b448-3ad545dc2f3a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" Jun 11 21:26:06.468267 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.468190 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/651af887-1c4f-47af-b448-3ad545dc2f3a-config-file\") pod \"limitador-limitador-54d6d988d5-wx5gd\" (UID: \"651af887-1c4f-47af-b448-3ad545dc2f3a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" Jun 11 21:26:06.569248 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.569229 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svsnl\" (UniqueName: \"kubernetes.io/projected/651af887-1c4f-47af-b448-3ad545dc2f3a-kube-api-access-svsnl\") pod \"limitador-limitador-54d6d988d5-wx5gd\" (UID: \"651af887-1c4f-47af-b448-3ad545dc2f3a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" Jun 11 21:26:06.569343 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.569266 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/651af887-1c4f-47af-b448-3ad545dc2f3a-config-file\") pod \"limitador-limitador-54d6d988d5-wx5gd\" (UID: \"651af887-1c4f-47af-b448-3ad545dc2f3a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" Jun 11 21:26:06.569849 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.569831 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/651af887-1c4f-47af-b448-3ad545dc2f3a-config-file\") pod \"limitador-limitador-54d6d988d5-wx5gd\" (UID: \"651af887-1c4f-47af-b448-3ad545dc2f3a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" Jun 11 21:26:06.577556 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.577529 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-svsnl\" (UniqueName: \"kubernetes.io/projected/651af887-1c4f-47af-b448-3ad545dc2f3a-kube-api-access-svsnl\") pod \"limitador-limitador-54d6d988d5-wx5gd\" (UID: \"651af887-1c4f-47af-b448-3ad545dc2f3a\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" Jun 11 21:26:06.719871 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.719852 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" Jun 11 21:26:06.841786 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.841742 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:06.847640 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.847615 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-wx5gd"] Jun 11 21:26:06.850610 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:26:06.850585 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod651af887_1c4f_47af_b448_3ad545dc2f3a.slice/crio-bd06d001c59ec8582c4fba86abc660b2dd58087b90c5cc8e5bfe1638e2b1b45d WatchSource:0}: Error finding container bd06d001c59ec8582c4fba86abc660b2dd58087b90c5cc8e5bfe1638e2b1b45d: Status 404 returned error can't find the container with id bd06d001c59ec8582c4fba86abc660b2dd58087b90c5cc8e5bfe1638e2b1b45d Jun 11 21:26:06.941454 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:06.941424 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:07.528298 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:07.528256 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" event={"ID":"651af887-1c4f-47af-b448-3ad545dc2f3a","Type":"ContainerStarted","Data":"bd06d001c59ec8582c4fba86abc660b2dd58087b90c5cc8e5bfe1638e2b1b45d"} Jun 11 21:26:09.538271 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:09.538192 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" event={"ID":"651af887-1c4f-47af-b448-3ad545dc2f3a","Type":"ContainerStarted","Data":"caf29e4a99f29acdc67f238887dd157bb85b78e983bea51384733c91e7294524"} Jun 11 21:26:09.538680 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:09.538300 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" Jun 11 21:26:09.554287 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:09.554238 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" podStartSLOduration=1.165715143 podStartE2EDuration="3.554225616s" totalImagesPullingTime="2.388510473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 21:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:26:09.553697661 +0000 UTC m=+846.625756663" watchObservedRunningTime="2026-06-11 21:26:09.554225616 +0000 UTC m=+846.626284597" Jun 11 21:26:20.544405 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:20.544375 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-wx5gd" Jun 11 21:26:26.003435 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:26.003401 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:29.357606 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:29.357577 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6b79dc76b5-btgnp_b71f4a29-e23e-484a-9ae0-8ea23a35392a/nginx/0.log" Jun 11 21:26:29.578589 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:29.578563 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-crdbx_48b7db37-def3-494a-9c3c-9460cc11c1df/manager/0.log" Jun 11 21:26:29.686535 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:29.686455 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5txvn_b4d340e9-c943-4432-9fd0-1276b6e7a0a4/manager/0.log" Jun 11 21:26:29.790262 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:29.790243 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sqw9f_9c2ba0d7-e430-4614-9922-50feb1787c9a/server/0.log" Jun 11 21:26:29.904546 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:29.904522 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-dr4bn_cae859c0-ce0d-4675-8bc9-a80df612dc68/manager/0.log" Jun 11 21:26:30.145347 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:30.145328 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f86df7d5-wbdmh_2ee14f9f-5795-4969-bbed-3c85db32f1d9/copy-manifests/0.log" Jun 11 21:26:30.150948 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:30.150926 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f86df7d5-wbdmh_2ee14f9f-5795-4969-bbed-3c85db32f1d9/manager/0.log" Jun 11 21:26:32.055241 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:32.055209 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tpjnb_507a5100-2aae-43b5-98da-012ac3170d50/manager/0.log" Jun 11 21:26:32.164236 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:32.164211 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wx5gd_651af887-1c4f-47af-b448-3ad545dc2f3a/limitador/0.log" Jun 11 21:26:32.713409 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:32.713376 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-87b4r_6018e123-b1f0-4f4d-bbb0-e294c68cd79b/discovery/0.log" Jun 11 21:26:32.929310 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:32.929286 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dfb4c6bbc-lwsmb_c9a805c5-d361-4a71-a53c-f22750c09c45/kube-auth-proxy/0.log" Jun 11 21:26:37.448994 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:37.448924 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:37.548957 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:37.548934 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" limit=1024 Jun 11 21:26:40.077477 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:40.077446 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qxjsz_0a107736-77c3-4fda-b030-f5adee9d83c3/global-pull-secret-syncer/0.log" Jun 11 21:26:40.144875 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:40.144852 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kkngg_178d8e7c-8abe-4c2d-8d8c-70617d65e4a9/konnectivity-agent/0.log" Jun 11 21:26:40.200318 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:40.200296 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-28.ec2.internal_df1df9ac03d74b94621cc8c32b56e28e/haproxy/0.log" Jun 11 21:26:43.407351 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:43.407272 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-bqfhx_0d6b8ebc-692d-40b1-b2e9-7eef30d34873/sail-operator/0.log" Jun 11 21:26:45.308904 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:45.308869 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-tpjnb_507a5100-2aae-43b5-98da-012ac3170d50/manager/0.log" Jun 11 21:26:45.328690 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:45.328662 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-wx5gd_651af887-1c4f-47af-b448-3ad545dc2f3a/limitador/0.log" Jun 11 21:26:47.754402 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:47.754339 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rld67_e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e/node-exporter/0.log" Jun 11 21:26:47.769808 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:47.769789 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rld67_e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e/kube-rbac-proxy/0.log" Jun 11 21:26:47.797133 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:47.797113 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rld67_e5ca5d6d-a3a1-4b9a-aa98-018d593cb05e/init-textfile/0.log" Jun 11 21:26:51.296886 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.296845 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz"] Jun 11 21:26:51.300280 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.300257 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.302622 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.302578 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ksdk5\"/\"openshift-service-ca.crt\"" Jun 11 21:26:51.303663 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.303641 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ksdk5\"/\"default-dockercfg-st46l\"" Jun 11 21:26:51.303772 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.303682 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ksdk5\"/\"kube-root-ca.crt\"" Jun 11 21:26:51.308479 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.308458 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz"] Jun 11 21:26:51.381365 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.381341 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-proc\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.381463 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.381368 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-lib-modules\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.381463 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.381391 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-sys\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.381577 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.381476 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf55l\" (UniqueName: \"kubernetes.io/projected/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-kube-api-access-rf55l\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.381577 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.381554 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-podres\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.481817 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.481790 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-lib-modules\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.481905 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.481828 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-sys\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.481905 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.481861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf55l\" (UniqueName: \"kubernetes.io/projected/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-kube-api-access-rf55l\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.481905 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.481899 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-podres\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.482013 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.481912 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-sys\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.482013 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.481919 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-proc\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.482013 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.481959 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-proc\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.482013 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.481963 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-lib-modules\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.482013 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.482004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-podres\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.489350 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.489327 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf55l\" (UniqueName: \"kubernetes.io/projected/0e3eae9a-6aa2-4787-82aa-67e41ee078aa-kube-api-access-rf55l\") pod \"perf-node-gather-daemonset-k4mjz\" (UID: \"0e3eae9a-6aa2-4787-82aa-67e41ee078aa\") " pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.611172 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.611123 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:51.740584 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:51.740554 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz"] Jun 11 21:26:51.743034 ip-10-0-129-28 kubenswrapper[2573]: W0611 21:26:51.743009 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0e3eae9a_6aa2_4787_82aa_67e41ee078aa.slice/crio-13371f02eed3457953fc9b239061db156d7e477b9f74addf23ee6fc3668e26a8 WatchSource:0}: Error finding container 13371f02eed3457953fc9b239061db156d7e477b9f74addf23ee6fc3668e26a8: Status 404 returned error can't find the container with id 13371f02eed3457953fc9b239061db156d7e477b9f74addf23ee6fc3668e26a8 Jun 11 21:26:52.468696 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:52.468666 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-flfvn_e8445994-0fd5-4dd8-8971-5103c5431127/dns/0.log" Jun 11 21:26:52.484271 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:52.484253 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-flfvn_e8445994-0fd5-4dd8-8971-5103c5431127/kube-rbac-proxy/0.log" Jun 11 21:26:52.615042 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:52.615022 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjxnx_9323e683-7099-43c9-a8d3-23a369dd8280/dns-node-resolver/0.log" Jun 11 21:26:52.732005 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:52.731979 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" event={"ID":"0e3eae9a-6aa2-4787-82aa-67e41ee078aa","Type":"ContainerStarted","Data":"cf5fe1230d033425358c502d78cb137811e7465dc4af2e71ed066c6ee2b95e63"} Jun 11 21:26:52.732137 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:52.732022 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" event={"ID":"0e3eae9a-6aa2-4787-82aa-67e41ee078aa","Type":"ContainerStarted","Data":"13371f02eed3457953fc9b239061db156d7e477b9f74addf23ee6fc3668e26a8"} Jun 11 21:26:52.732137 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:52.732093 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:52.748455 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:52.748412 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" podStartSLOduration=1.7483998600000001 podStartE2EDuration="1.74839986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 21:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 21:26:52.746913546 +0000 UTC m=+889.818972548" watchObservedRunningTime="2026-06-11 21:26:52.74839986 +0000 UTC m=+889.820458841" Jun 11 21:26:53.143233 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:53.143173 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bvwbr_4d7dcf20-a0b1-412b-9f87-f920735902c5/node-ca/0.log" Jun 11 21:26:54.090288 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:54.090250 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-87b4r_6018e123-b1f0-4f4d-bbb0-e294c68cd79b/discovery/0.log" Jun 11 21:26:54.126455 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:54.126434 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dfb4c6bbc-lwsmb_c9a805c5-d361-4a71-a53c-f22750c09c45/kube-auth-proxy/0.log" Jun 11 21:26:54.730781 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:54.730749 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-bnkjs_00dc8383-d3ff-4f95-88ab-bc09c5e5f001/serve-healthcheck-canary/0.log" Jun 11 21:26:55.301007 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:55.300981 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qp8vh_bb4106be-a30c-4b92-8c05-c770f92b9794/kube-rbac-proxy/0.log" Jun 11 21:26:55.315883 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:55.315862 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qp8vh_bb4106be-a30c-4b92-8c05-c770f92b9794/exporter/0.log" Jun 11 21:26:55.332086 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:55.332058 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-qp8vh_bb4106be-a30c-4b92-8c05-c770f92b9794/extractor/0.log" Jun 11 21:26:57.496191 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:57.496153 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6b79dc76b5-btgnp_b71f4a29-e23e-484a-9ae0-8ea23a35392a/nginx/0.log" Jun 11 21:26:57.532306 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:57.532280 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-crdbx_48b7db37-def3-494a-9c3c-9460cc11c1df/manager/0.log" Jun 11 21:26:57.551937 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:57.551912 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-5txvn_b4d340e9-c943-4432-9fd0-1276b6e7a0a4/manager/0.log" Jun 11 21:26:57.568546 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:57.568529 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sqw9f_9c2ba0d7-e430-4614-9922-50feb1787c9a/server/0.log" Jun 11 21:26:57.603849 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:57.603826 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-dr4bn_cae859c0-ce0d-4675-8bc9-a80df612dc68/manager/0.log" Jun 11 21:26:57.671272 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:57.671250 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f86df7d5-wbdmh_2ee14f9f-5795-4969-bbed-3c85db32f1d9/manager/0.log" Jun 11 21:26:57.686351 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:57.686333 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56f86df7d5-wbdmh_2ee14f9f-5795-4969-bbed-3c85db32f1d9/copy-manifests/0.log" Jun 11 21:26:58.745928 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:58.745903 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ksdk5/perf-node-gather-daemonset-k4mjz" Jun 11 21:26:59.022818 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:26:59.022749 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-9ckxm_3a065914-76bd-4d84-a964-529aeb4b98f7/openshift-lws-operator/0.log" Jun 11 21:27:03.388328 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:03.388300 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/0.log" Jun 11 21:27:03.388806 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:03.388520 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/0.log" Jun 11 21:27:05.237672 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:05.237639 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-87b4r_6018e123-b1f0-4f4d-bbb0-e294c68cd79b/discovery/0.log" Jun 11 21:27:05.257246 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:05.257209 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dfb4c6bbc-lwsmb_c9a805c5-d361-4a71-a53c-f22750c09c45/kube-auth-proxy/0.log" Jun 11 21:27:06.187503 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.187459 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sshd7_6e2338eb-2497-454a-92d9-672ce03db7df/kube-multus-additional-cni-plugins/0.log" Jun 11 21:27:06.209521 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.209476 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sshd7_6e2338eb-2497-454a-92d9-672ce03db7df/egress-router-binary-copy/0.log" Jun 11 21:27:06.232588 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.232567 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sshd7_6e2338eb-2497-454a-92d9-672ce03db7df/cni-plugins/0.log" Jun 11 21:27:06.255180 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.255162 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sshd7_6e2338eb-2497-454a-92d9-672ce03db7df/bond-cni-plugin/0.log" Jun 11 21:27:06.271872 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.271853 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-87b4r_6018e123-b1f0-4f4d-bbb0-e294c68cd79b/discovery/0.log" Jun 11 21:27:06.275291 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.275274 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sshd7_6e2338eb-2497-454a-92d9-672ce03db7df/routeoverride-cni/0.log" Jun 11 21:27:06.294625 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.294594 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dfb4c6bbc-lwsmb_c9a805c5-d361-4a71-a53c-f22750c09c45/kube-auth-proxy/0.log" Jun 11 21:27:06.297968 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.297954 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sshd7_6e2338eb-2497-454a-92d9-672ce03db7df/whereabouts-cni-bincopy/0.log" Jun 11 21:27:06.317207 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.317179 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sshd7_6e2338eb-2497-454a-92d9-672ce03db7df/whereabouts-cni/0.log" Jun 11 21:27:06.346083 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.346061 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-djn25_e4884252-8b16-4975-a50b-4de635e9a60a/kube-multus/0.log" Jun 11 21:27:06.420421 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.420398 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fvn2h_d80e86ad-3e9e-4ae9-9666-8f639b3d84fc/network-metrics-daemon/0.log" Jun 11 21:27:06.441256 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:06.441185 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fvn2h_d80e86ad-3e9e-4ae9-9666-8f639b3d84fc/kube-rbac-proxy/0.log" Jun 11 21:27:07.610805 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:07.610773 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-controller/0.log" Jun 11 21:27:07.627121 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:07.627098 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/0.log" Jun 11 21:27:07.627121 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:07.627104 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovn-acl-logging/1.log" Jun 11 21:27:07.645829 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:07.645811 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/kube-rbac-proxy-node/0.log" Jun 11 21:27:07.661833 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:07.661815 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/kube-rbac-proxy-ovn-metrics/0.log" Jun 11 21:27:07.674104 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:07.674088 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/northd/0.log" Jun 11 21:27:07.691138 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:07.691122 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/nbdb/0.log" Jun 11 21:27:07.708574 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:07.708552 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/sbdb/0.log" Jun 11 21:27:07.742523 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:07.742507 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-x2kcd_19eb4850-5b28-4a9f-a0c0-cc30e5808f42/ovnkube-controller/0.log" Jun 11 21:27:07.937046 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:07.936993 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-87b4r_6018e123-b1f0-4f4d-bbb0-e294c68cd79b/discovery/0.log" Jun 11 21:27:07.965255 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:07.965238 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dfb4c6bbc-lwsmb_c9a805c5-d361-4a71-a53c-f22750c09c45/kube-auth-proxy/0.log" Jun 11 21:27:09.195933 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:09.195898 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-nz67n_b5e1fcec-cd44-4d3e-aa8c-32e09be2440d/network-check-target-container/0.log" Jun 11 21:27:10.066832 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:10.066798 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-87b4r_6018e123-b1f0-4f4d-bbb0-e294c68cd79b/discovery/0.log" Jun 11 21:27:10.088560 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:10.088540 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6dfb4c6bbc-lwsmb_c9a805c5-d361-4a71-a53c-f22750c09c45/kube-auth-proxy/0.log" Jun 11 21:27:10.316183 ip-10-0-129-28 kubenswrapper[2573]: I0611 21:27:10.316156 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-ct8rh_501998d6-4e79-4da0-bbdd-5feb942d5c0a/iptables-alerter/0.log"