Jun 09 14:09:03.454345 ip-10-0-138-120 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 14:09:03.454358 ip-10-0-138-120 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 14:09:03.454365 ip-10-0-138-120 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 14:09:03.454512 ip-10-0-138-120 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 14:09:13.705547 ip-10-0-138-120 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 14:09:13.705565 ip-10-0-138-120 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 16c611bc7e7f427d99e659b8ded1aa7e -- Jun 09 14:12:03.428520 ip-10-0-138-120 systemd[1]: Starting Kubernetes Kubelet... Jun 09 14:12:03.859763 ip-10-0-138-120 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:12:03.859763 ip-10-0-138-120 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 14:12:03.859763 ip-10-0-138-120 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:12:03.859763 ip-10-0-138-120 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 14:12:03.859763 ip-10-0-138-120 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 14:12:03.861455 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.861362 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867022 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867048 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867054 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867059 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867065 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867070 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867074 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867079 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867083 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867096 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867103 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867132 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867138 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867143 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867148 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867152 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867158 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867162 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:12:03.867707 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867167 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867174 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867183 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867188 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867192 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867196 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867201 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867205 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867209 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867220 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867224 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867228 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867233 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867237 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867241 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867251 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867256 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867261 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867265 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:12:03.868284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867269 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867278 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867282 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867287 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867291 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867295 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867299 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867304 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867313 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867318 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867322 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867327 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867331 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867336 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867341 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867345 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867349 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867354 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867358 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867362 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:12:03.868742 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867367 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867378 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867384 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867389 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867394 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867401 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867407 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867412 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867417 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867422 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867427 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867432 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867442 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867446 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867450 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867455 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867459 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867463 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867468 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:12:03.869353 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867472 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867476 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867480 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867484 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867489 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867493 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867502 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867507 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867511 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867516 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867521 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867526 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867530 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867535 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867539 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867543 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867547 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867552 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867556 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867565 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:12:03.869818 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867569 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867574 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.867579 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869799 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869811 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869815 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869818 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869821 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869825 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869830 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869834 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869837 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869839 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869842 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869845 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869847 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869850 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869852 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869855 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869858 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:12:03.870314 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869860 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869863 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869865 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869874 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869876 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869879 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869882 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869884 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869887 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869890 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869893 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869895 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869898 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869900 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869903 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869907 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869911 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869914 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869917 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:12:03.870805 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869920 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869923 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869926 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869929 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869931 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869934 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869936 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869939 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869942 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869944 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869947 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869949 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869952 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869955 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869958 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869961 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869963 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869966 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869968 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869971 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:12:03.871319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869973 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869976 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869980 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869983 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869986 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869990 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869992 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869995 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.869998 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870005 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870008 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870011 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870014 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870017 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870020 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870023 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870025 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870028 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870031 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870033 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:12:03.871814 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870036 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870038 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870041 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870045 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870047 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870050 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870052 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870055 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870058 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870061 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870063 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870066 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870069 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870071 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870074 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870076 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870079 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870082 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870085 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870087 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:12:03.872347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870090 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870094 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870096 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870493 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870498 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870501 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870503 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870506 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870509 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870512 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870514 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870517 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870519 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870522 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870524 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870527 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870530 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870532 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870534 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870538 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:12:03.872824 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870540 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870543 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870546 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870548 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870551 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870553 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870556 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870559 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870561 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870564 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870566 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870569 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870571 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870575 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870577 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870580 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870583 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870585 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870590 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870593 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:12:03.873331 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870597 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870601 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870605 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870608 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870612 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870616 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870621 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870623 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870626 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870628 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870632 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870636 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870640 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870643 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870646 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870649 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870652 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870655 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870658 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:12:03.873845 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870662 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870666 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870669 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870671 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870674 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870677 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870681 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870683 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870686 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870688 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870691 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870693 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870696 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870699 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870701 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870704 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870706 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870709 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870711 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870714 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:12:03.874332 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870716 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870719 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870721 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870725 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870727 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870730 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870733 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870737 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870740 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870744 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870746 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870749 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870751 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870754 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870756 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870759 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870761 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870764 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870766 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870769 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:12:03.874817 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870771 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870774 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.870776 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870854 2572 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870869 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870878 2572 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870883 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870887 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870890 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870894 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870898 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870902 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870905 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870909 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870912 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870916 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870919 2572 flags.go:64] FLAG: --cgroup-root="" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870922 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870925 2572 flags.go:64] FLAG: --client-ca-file="" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870928 2572 flags.go:64] FLAG: --cloud-provider="external" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870931 2572 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870936 2572 flags.go:64] FLAG: --cluster-domain="" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870939 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870942 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 14:12:03.875319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870945 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870948 2572 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870959 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870961 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870965 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870968 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870971 2572 flags.go:64] FLAG: --contention-profiling="false" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870974 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870977 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870980 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870983 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870987 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870990 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870993 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870996 2572 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.870998 2572 flags.go:64] FLAG: --enable-server="true" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871002 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871006 2572 flags.go:64] FLAG: --event-burst="100" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871009 2572 flags.go:64] FLAG: --event-qps="50" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871012 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871015 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871018 2572 flags.go:64] FLAG: --eviction-hard="" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871021 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871024 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871027 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 14:12:03.875901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871030 2572 flags.go:64] FLAG: --eviction-soft="" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871036 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871039 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871042 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871045 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871048 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871051 2572 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871054 2572 flags.go:64] FLAG: --feature-gates="" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871057 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871060 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871063 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871066 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871069 2572 flags.go:64] FLAG: --healthz-port="10248" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871072 2572 flags.go:64] FLAG: --help="false" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871075 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-138-120.ec2.internal" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871078 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871081 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871085 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871088 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871092 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871094 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871097 2572 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871100 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 14:12:03.876555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871103 2572 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871121 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871125 2572 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871128 2572 flags.go:64] FLAG: --kube-reserved="" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871131 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871134 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871137 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871139 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871142 2572 flags.go:64] FLAG: --lock-file="" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871145 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871150 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871153 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871158 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871162 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871165 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871168 2572 flags.go:64] FLAG: --logging-format="text" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871171 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871174 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871177 2572 flags.go:64] FLAG: --manifest-url="" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871180 2572 flags.go:64] FLAG: --manifest-url-header="" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871184 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871188 2572 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871192 2572 flags.go:64] FLAG: --max-pods="110" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871195 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871198 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 14:12:03.877188 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871201 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871204 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871207 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871210 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871223 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871231 2572 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871235 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871238 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871241 2572 flags.go:64] FLAG: --pod-cidr="" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871243 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871249 2572 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871252 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871255 2572 flags.go:64] FLAG: --pods-per-core="0" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871258 2572 flags.go:64] FLAG: --port="10250" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871261 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871265 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0896f7c1dd85a9122" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871268 2572 flags.go:64] FLAG: --qos-reserved="" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871271 2572 flags.go:64] FLAG: --read-only-port="10255" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871275 2572 flags.go:64] FLAG: --register-node="true" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871278 2572 flags.go:64] FLAG: --register-with-taints="" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871281 2572 flags.go:64] FLAG: --registry-burst="10" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871285 2572 flags.go:64] FLAG: --registry-qps="5" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871288 2572 flags.go:64] FLAG: --reserved-cpus="" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871290 2572 flags.go:64] FLAG: --reserved-memory="" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871294 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 14:12:03.877847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871297 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871300 2572 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871303 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871306 2572 flags.go:64] FLAG: --runonce="false" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871309 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871312 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871315 2572 flags.go:64] FLAG: --seccomp-default="false" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871318 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871320 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871323 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871327 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871330 2572 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871333 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871336 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871339 2572 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871341 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871345 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871348 2572 flags.go:64] FLAG: --system-cgroups="" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871351 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871355 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871358 2572 flags.go:64] FLAG: --tls-cert-file="" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871361 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871366 2572 flags.go:64] FLAG: --tls-min-version="" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871369 2572 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871372 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 14:12:03.878470 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871376 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871379 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871382 2572 flags.go:64] FLAG: --v="2" Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871386 2572 flags.go:64] FLAG: --version="false" Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871391 2572 flags.go:64] FLAG: --vmodule="" Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871397 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.871401 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871519 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871524 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871528 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871531 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871534 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871537 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871540 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871544 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871546 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871549 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871552 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871555 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871558 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:12:03.879094 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871561 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871563 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871566 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871569 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871571 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871574 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871576 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871579 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871582 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871584 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871587 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871589 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871593 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871596 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871599 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871602 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871604 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871608 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871610 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871614 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:12:03.879640 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871618 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871620 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871623 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871626 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871628 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871631 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871634 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871637 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871639 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871642 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871645 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871647 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871650 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871653 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871655 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871658 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871660 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871663 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871665 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:12:03.880157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871668 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871671 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871674 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871676 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871679 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871682 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871685 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871688 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871690 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871693 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871696 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871700 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871704 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871707 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871709 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871712 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871715 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871717 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871720 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:12:03.880621 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871722 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871725 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871727 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871730 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871733 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871736 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871738 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871741 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871744 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871747 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871749 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871752 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871754 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871758 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871761 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871763 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871766 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871768 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871772 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871775 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:12:03.881091 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871778 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871780 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871783 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871785 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871788 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871791 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871794 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.871796 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.873047 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.880095 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.880224 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.881066 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.881074 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881150 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881157 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:12:03.881602 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881160 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881164 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881167 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881171 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881176 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881179 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881182 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881185 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881188 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881191 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881194 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881198 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881201 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881204 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881208 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881211 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881214 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881217 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881220 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:12:03.881973 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881223 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881225 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881228 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881231 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881234 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881237 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881239 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881242 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881246 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881249 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881252 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881255 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881258 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881260 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881263 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881266 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881268 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881271 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881273 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:12:03.882563 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881276 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881279 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881281 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881284 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881286 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881289 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881291 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881294 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881296 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881299 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881302 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881304 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881307 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881310 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881312 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881315 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881317 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881320 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881323 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881326 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:12:03.883024 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881329 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881332 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881336 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881339 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881341 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881344 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881347 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881349 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881352 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881354 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881357 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881360 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881362 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881365 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881367 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881370 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881373 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881375 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881378 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881381 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:12:03.883539 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881383 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881386 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881389 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881391 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881394 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881396 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881399 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881401 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881404 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881407 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881410 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881413 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881415 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881418 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881421 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881426 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881429 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881432 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:12:03.884027 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881435 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.881440 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881556 2572 feature_gate.go:328] unrecognized feature gate: Example Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881561 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881564 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881567 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881570 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881573 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881576 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881581 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881583 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881586 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881589 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881591 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881594 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 14:12:03.884514 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881596 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881599 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881602 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881604 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881607 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881610 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881612 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881615 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881618 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881621 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881623 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881626 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881628 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881631 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881634 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881637 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881640 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881643 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881645 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881648 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 14:12:03.884894 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881651 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881653 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881656 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881659 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881661 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881664 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881666 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881669 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881671 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881674 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881676 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881679 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881681 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881684 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881686 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881689 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881691 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881693 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881696 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881699 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 14:12:03.885437 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881702 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881704 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881707 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881710 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881712 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881715 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881718 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881720 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881723 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881726 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881729 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881731 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881734 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881736 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881739 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881741 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881744 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881747 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881749 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881751 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 14:12:03.885917 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881754 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881756 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881775 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881779 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881782 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881787 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881791 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881794 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881797 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881800 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881803 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881806 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881809 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881812 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881814 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881817 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881820 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881823 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 14:12:03.886518 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881826 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881828 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881831 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881834 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881836 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881839 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881841 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:03.881844 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.881848 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.881942 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.884249 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.885813 2572 server.go:1019] "Starting client certificate rotation" Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.885913 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 14:12:03.886948 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.885953 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 14:12:03.888411 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.888398 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 14:12:03.889583 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.889557 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 14:12:03.902992 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.902972 2572 log.go:25] "Validated CRI v1 runtime API" Jun 09 14:12:03.907567 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.907544 2572 log.go:25] "Validated CRI v1 image API" Jun 09 14:12:03.908370 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.908350 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 14:12:03.910901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.910875 2572 fs.go:135] Filesystem UUIDs: map[0dd85b5a-6ffc-404f-8407-08201b7e1170:/dev/nvme0n1p4 5e6c3d0d-853f-4ee2-8869-24abbf2e6e6f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 09 14:12:03.910979 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.910902 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 14:12:03.914905 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.914877 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 14:12:03.916303 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.916194 2572 manager.go:216] Machine: {Timestamp:2026-06-09 14:12:03.914754758 +0000 UTC m=+0.356953949 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097701 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25ac056866941564216732947903f0 SystemUUID:ec25ac05-6866-9415-6421-6732947903f0 BootID:16c611bc-7e7f-427d-99e6-59b8ded1aa7e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:41:19:11:f9:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:41:19:11:f9:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:86:e4:38:3f:ef:dd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 14:12:03.916303 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.916298 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 14:12:03.916417 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.916405 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 14:12:03.917671 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.917650 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 14:12:03.917804 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.917674 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-120.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 14:12:03.919166 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.919156 2572 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 14:12:03.919200 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.919168 2572 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 14:12:03.919200 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.919176 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 14:12:03.919987 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.919977 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 14:12:03.921258 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.921248 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 14:12:03.925034 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.925022 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 09 14:12:03.925169 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.925160 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 14:12:03.925208 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.925193 2572 kubelet.go:486] "Attempting to sync node with API server" Jun 09 14:12:03.925236 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.925211 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 14:12:03.925236 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.925223 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 14:12:03.925236 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.925234 2572 kubelet.go:398] "Adding apiserver pod source" Jun 09 14:12:03.925357 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.925242 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 14:12:03.925607 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.925594 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 14:12:03.925676 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.925614 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 14:12:03.927866 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.927830 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 14:12:03.930992 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.930975 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 14:12:03.931074 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.931015 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 14:12:03.932004 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.931980 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 14:12:03.932004 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.932007 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 14:12:03.932177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.932017 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 14:12:03.932177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.932033 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 14:12:03.932177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.932049 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 14:12:03.932177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.932059 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 14:12:03.932177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.932071 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 14:12:03.932177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.932080 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 14:12:03.932177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.932092 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 14:12:03.932177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.932100 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 14:12:03.932177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.932139 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 14:12:03.932177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.932148 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 14:12:03.933019 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.933003 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 14:12:03.933075 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.933030 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 14:12:03.935492 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.935471 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hhppw" Jun 09 14:12:03.936613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.936599 2572 server.go:1268] "Started kubelet" Jun 09 14:12:03.936690 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.936666 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 14:12:03.936740 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.936688 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 14:12:03.936799 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.936763 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 14:12:03.937355 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.937333 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-120.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 14:12:03.937446 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:03.937331 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 14:12:03.937529 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:03.937508 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 14:12:03.937629 ip-10-0-138-120 systemd[1]: Started Kubernetes Kubelet. Jun 09 14:12:03.939059 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.939046 2572 server.go:310] "Adding debug handlers to kubelet server" Jun 09 14:12:03.939140 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.939082 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 14:12:03.941031 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.941010 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hhppw" Jun 09 14:12:03.944507 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:03.944480 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 14:12:03.947220 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:03.945206 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-120.ec2.internal.18b76f17661f22f7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-120.ec2.internal,UID:ip-10-0-138-120.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-120.ec2.internal,},FirstTimestamp:2026-06-09 14:12:03.936568055 +0000 UTC m=+0.378767241,LastTimestamp:2026-06-09 14:12:03.936568055 +0000 UTC m=+0.378767241,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-120.ec2.internal,}" Jun 09 14:12:03.949558 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.949542 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 14:12:03.950226 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.950209 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 14:12:03.950347 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:03.950331 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:03.950991 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.950974 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 14:12:03.951068 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.950996 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 14:12:03.951068 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.950977 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 14:12:03.951196 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.951175 2572 reconstruct.go:97] "Volume reconstruction finished" Jun 09 14:12:03.951196 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.951185 2572 reconciler.go:29] "Reconciler: start to sync state" Jun 09 14:12:03.951463 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.951354 2572 factory.go:153] Registering CRI-O factory Jun 09 14:12:03.951463 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.951370 2572 factory.go:223] Registration of the crio container factory successfully Jun 09 14:12:03.951463 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.951418 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 14:12:03.951463 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.951427 2572 factory.go:55] Registering systemd factory Jun 09 14:12:03.951463 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.951435 2572 factory.go:223] Registration of the systemd container factory successfully Jun 09 14:12:03.951463 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.951456 2572 factory.go:103] Registering Raw factory Jun 09 14:12:03.951738 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.951469 2572 manager.go:1196] Started watching for new ooms in manager Jun 09 14:12:03.951945 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.951911 2572 manager.go:349] Starting recovery of all containers Jun 09 14:12:03.952328 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:03.952250 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-120.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 14:12:03.952403 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:03.952332 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 14:12:03.964218 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.964103 2572 manager.go:354] Recovery completed Jun 09 14:12:03.968278 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.968269 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:12:03.970744 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.970727 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:12:03.970811 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.970755 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:12:03.970811 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.970766 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:12:03.971272 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.971258 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 14:12:03.971272 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.971272 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 14:12:03.971369 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.971285 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:12:03.971369 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.971290 2572 state_mem.go:36] "Initialized new in-memory state store" Jun 09 14:12:03.972436 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.972419 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:12:03.972499 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.972446 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:12:03.972499 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.972456 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:12:03.972562 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.972555 2572 policy_none.go:49] "None policy: Start" Jun 09 14:12:03.972591 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.972568 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 14:12:03.972591 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.972582 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 14:12:03.973973 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:03.973960 2572 policy_none.go:47] "Start" Jun 09 14:12:04.009701 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.009683 2572 manager.go:337] "Starting Device Plugin manager" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.009754 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.009772 2572 server.go:87] "Starting device plugin registration server" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.010017 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.010028 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.010133 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.010204 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.010213 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.011036 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.011078 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.024855 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.025985 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.026032 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.026059 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 14:12:04.027568 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.026164 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 14:12:04.028231 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.027889 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:12:04.111088 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.110995 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:12:04.112007 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.111978 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:12:04.112133 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.112020 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:12:04.112133 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.112031 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:12:04.112133 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.112056 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.119920 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.119898 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.120042 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.119930 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-120.ec2.internal\": node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:04.126945 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.126922 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-120.ec2.internal"] Jun 09 14:12:04.127041 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.126988 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:12:04.128609 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.128592 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:12:04.128708 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.128626 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:12:04.128708 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.128640 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:12:04.130076 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.130060 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:12:04.130185 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.130172 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.130232 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.130208 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:12:04.130886 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.130869 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:12:04.130957 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.130872 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:12:04.130957 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.130933 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:12:04.130957 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.130949 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:12:04.131080 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.130904 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:12:04.131080 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.130980 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:12:04.132483 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.132468 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.132545 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.132493 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 14:12:04.133281 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.133262 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientMemory" Jun 09 14:12:04.133331 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.133292 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 14:12:04.133331 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.133309 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeHasSufficientPID" Jun 09 14:12:04.134777 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.134764 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:04.147762 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.147739 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-120.ec2.internal\" not found" node="ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.151759 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.151738 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-120.ec2.internal\" not found" node="ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.152786 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.152765 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60e4a7bf1af317e32f763d4b27e8d9df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal\" (UID: \"60e4a7bf1af317e32f763d4b27e8d9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.152882 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.152796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60e4a7bf1af317e32f763d4b27e8d9df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal\" (UID: \"60e4a7bf1af317e32f763d4b27e8d9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.152882 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.152822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16b6c839f3f5f672e5e6038ba9c6104d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-120.ec2.internal\" (UID: \"16b6c839f3f5f672e5e6038ba9c6104d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.235253 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.235217 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:04.253736 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.253711 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16b6c839f3f5f672e5e6038ba9c6104d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-120.ec2.internal\" (UID: \"16b6c839f3f5f672e5e6038ba9c6104d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.253799 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.253755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60e4a7bf1af317e32f763d4b27e8d9df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal\" (UID: \"60e4a7bf1af317e32f763d4b27e8d9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.253799 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.253773 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60e4a7bf1af317e32f763d4b27e8d9df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal\" (UID: \"60e4a7bf1af317e32f763d4b27e8d9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.253866 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.253801 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/60e4a7bf1af317e32f763d4b27e8d9df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal\" (UID: \"60e4a7bf1af317e32f763d4b27e8d9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.253866 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.253825 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/60e4a7bf1af317e32f763d4b27e8d9df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal\" (UID: \"60e4a7bf1af317e32f763d4b27e8d9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.253866 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.253805 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/16b6c839f3f5f672e5e6038ba9c6104d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-120.ec2.internal\" (UID: \"16b6c839f3f5f672e5e6038ba9c6104d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.336224 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.336185 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:04.436955 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.436931 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:04.455281 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.455258 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.457053 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.457036 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-120.ec2.internal" Jun 09 14:12:04.537220 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.537168 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:04.637740 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.637704 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:04.738381 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.738296 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:04.838914 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.838876 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:04.885473 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.885432 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 14:12:04.886196 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.885620 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 14:12:04.939782 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:04.939747 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:04.949463 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.949400 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 14:07:03 +0000 UTC" deadline="2028-02-25 18:26:22.423159162 +0000 UTC" Jun 09 14:12:04.949463 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:04.949455 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15028h14m17.473707451s" Jun 09 14:12:05.026180 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:05.025969 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60e4a7bf1af317e32f763d4b27e8d9df.slice/crio-fbc26bcbebe3c95b0ae290ed9a02dd48f0afa5ad52670e980b5e7eb59adc307d WatchSource:0}: Error finding container fbc26bcbebe3c95b0ae290ed9a02dd48f0afa5ad52670e980b5e7eb59adc307d: Status 404 returned error can't find the container with id fbc26bcbebe3c95b0ae290ed9a02dd48f0afa5ad52670e980b5e7eb59adc307d Jun 09 14:12:05.026591 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:05.026563 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16b6c839f3f5f672e5e6038ba9c6104d.slice/crio-fdcca571d45fbe24bf465a43f787c2e97f55b83ae42ac3c0047e725c4cab84c4 WatchSource:0}: Error finding container fdcca571d45fbe24bf465a43f787c2e97f55b83ae42ac3c0047e725c4cab84c4: Status 404 returned error can't find the container with id fdcca571d45fbe24bf465a43f787c2e97f55b83ae42ac3c0047e725c4cab84c4 Jun 09 14:12:05.033294 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.033276 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:12:05.040128 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:05.040095 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:05.140256 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:05.140197 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:05.196440 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.196410 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:12:05.240514 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:05.240479 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:05.275750 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.275683 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:12:05.340609 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:05.340561 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-120.ec2.internal\" not found" Jun 09 14:12:05.379484 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.379458 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:12:05.451065 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.451036 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" Jun 09 14:12:05.465155 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.465067 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 14:12:05.466415 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.466294 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-120.ec2.internal" Jun 09 14:12:05.473742 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.473715 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 14:12:05.926056 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.926022 2572 apiserver.go:52] "Watching apiserver" Jun 09 14:12:05.933852 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.933818 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 14:12:05.935193 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.935157 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-54w7b","openshift-dns/node-resolver-6qlj7","openshift-image-registry/node-ca-xqjzs","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal","openshift-multus/network-metrics-daemon-nhcwv","openshift-network-operator/iptables-alerter-c8hgs","kube-system/konnectivity-agent-dddlm","kube-system/kube-apiserver-proxy-ip-10-0-138-120.ec2.internal","openshift-multus/multus-49t44","openshift-multus/multus-additional-cni-plugins-2x4xx","openshift-network-diagnostics/network-check-target-26vrm","openshift-ovn-kubernetes/ovnkube-node-fc7n9","kube-system/global-pull-secret-syncer-vzbm9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9"] Jun 09 14:12:05.936788 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.936766 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:05.938202 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.938179 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:05.938317 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:05.938260 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:05.939226 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.939204 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 14:12:05.939323 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.939233 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 14:12:05.939323 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.939265 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 14:12:05.939505 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.939486 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 14:12:05.939585 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.939566 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 14:12:05.939644 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.939489 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-t4hr2\"" Jun 09 14:12:05.940753 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.940734 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqjzs" Jun 09 14:12:05.942460 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.942441 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:05.942767 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.942747 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 14:12:05.942859 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.942849 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2h9d7\"" Jun 09 14:12:05.942917 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.942898 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 14:12:05.942971 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.942911 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 14:12:05.943817 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.943794 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:05.943915 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:05.943856 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:05.944421 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.944401 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lstl9\"" Jun 09 14:12:05.944535 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.944509 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 14:12:05.945202 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.945182 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 14:12:05.945291 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.945252 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 14:12:05.948174 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.948149 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8hgs" Jun 09 14:12:05.950030 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.950009 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-49t44" Jun 09 14:12:05.950221 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.950200 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-9rdsg\"" Jun 09 14:12:05.950321 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.950205 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:12:05.950380 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.950335 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 14:12:05.950431 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.950385 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 14:12:05.950481 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.950468 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 14:12:05.951287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.951268 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:05.951927 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.951910 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-b5fvh\"" Jun 09 14:12:05.952089 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.952069 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 14:12:05.952927 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.952911 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6qlj7" Jun 09 14:12:05.953246 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.953228 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 14:12:05.953387 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.953362 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dq4nj\"" Jun 09 14:12:05.953475 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.953393 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 14:12:05.954367 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.954344 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:05.954890 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.954871 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2nwvm\"" Jun 09 14:12:05.954977 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.954871 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 14:12:05.955269 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.955252 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 14:12:05.955914 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.955896 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:05.955996 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:05.955967 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:05.956364 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.956342 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:12:05.956468 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.956449 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 14:12:05.956545 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.956478 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m4rmr\"" Jun 09 14:12:05.957715 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.957699 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:05.959602 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.959582 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 14:12:05.959930 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.959903 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 14:12:05.960019 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.959951 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 14:12:05.960019 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.959968 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 14:12:05.960209 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.960191 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5dslj\"" Jun 09 14:12:05.960361 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.960343 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 14:12:05.960957 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.960939 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 14:12:05.961818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.961774 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:05.961818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.961807 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2a937b25-9644-43ec-8712-bda95709a011-konnectivity-ca\") pod \"konnectivity-agent-dddlm\" (UID: \"2a937b25-9644-43ec-8712-bda95709a011\") " pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:05.961955 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.961834 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-cni-dir\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.961955 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.961878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-run-netns\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.961955 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.961903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-daemon-config\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.961955 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.961926 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0fe143e-02b1-4866-a4bd-a271ef19ec97-tmp-dir\") pod \"node-resolver-6qlj7\" (UID: \"c0fe143e-02b1-4866-a4bd-a271ef19ec97\") " pod="openshift-dns/node-resolver-6qlj7" Jun 09 14:12:05.961955 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.961951 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:05.962207 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.961970 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-sys-fs\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:05.962207 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.961985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wgr4\" (UniqueName: \"kubernetes.io/projected/e8a6a503-3148-4901-8489-7ef746f890bf-kube-api-access-5wgr4\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:05.962207 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962006 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2a937b25-9644-43ec-8712-bda95709a011-agent-certs\") pod \"konnectivity-agent-dddlm\" (UID: \"2a937b25-9644-43ec-8712-bda95709a011\") " pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:05.962207 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962029 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-var-lib-cni-bin\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.962207 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962071 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z8qt\" (UniqueName: \"kubernetes.io/projected/10f9c799-543d-4af0-81b4-3457e301f3bb-kube-api-access-8z8qt\") pod \"node-ca-xqjzs\" (UID: \"10f9c799-543d-4af0-81b4-3457e301f3bb\") " pod="openshift-image-registry/node-ca-xqjzs" Jun 09 14:12:05.962207 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962100 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/effafd9f-d087-4170-85ee-00b4b7be09df-host-slash\") pod \"iptables-alerter-c8hgs\" (UID: \"effafd9f-d087-4170-85ee-00b4b7be09df\") " pod="openshift-network-operator/iptables-alerter-c8hgs" Jun 09 14:12:05.962207 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962161 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-system-cni-dir\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.962207 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962195 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-hostroot\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962222 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-conf-dir\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-run-k8s-cni-cncf-io\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962290 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-etc-kubernetes\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962328 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0fe143e-02b1-4866-a4bd-a271ef19ec97-hosts-file\") pod \"node-resolver-6qlj7\" (UID: \"c0fe143e-02b1-4866-a4bd-a271ef19ec97\") " pod="openshift-dns/node-resolver-6qlj7" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962367 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-socket-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962393 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10f9c799-543d-4af0-81b4-3457e301f3bb-host\") pod \"node-ca-xqjzs\" (UID: \"10f9c799-543d-4af0-81b4-3457e301f3bb\") " pod="openshift-image-registry/node-ca-xqjzs" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962415 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10f9c799-543d-4af0-81b4-3457e301f3bb-serviceca\") pod \"node-ca-xqjzs\" (UID: \"10f9c799-543d-4af0-81b4-3457e301f3bb\") " pod="openshift-image-registry/node-ca-xqjzs" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962436 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962458 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50bde0a0-6d0a-41eb-a773-c5f817a072e2-cni-binary-copy\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962486 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-run-multus-certs\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962512 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:05.962599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962568 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-registration-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962604 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-os-release\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962654 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cca38f39-2d09-446e-95b3-4cf9acdd3fba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962681 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-cnibin\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962708 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9a106a4-e64e-494f-8759-ae6dfe56384f-dbus\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962745 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-device-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962785 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-cnibin\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962813 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cca38f39-2d09-446e-95b3-4cf9acdd3fba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/effafd9f-d087-4170-85ee-00b4b7be09df-iptables-alerter-script\") pod \"iptables-alerter-c8hgs\" (UID: \"effafd9f-d087-4170-85ee-00b4b7be09df\") " pod="openshift-network-operator/iptables-alerter-c8hgs" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-os-release\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgkbj\" (UniqueName: \"kubernetes.io/projected/50bde0a0-6d0a-41eb-a773-c5f817a072e2-kube-api-access-wgkbj\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962902 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9a106a4-e64e-494f-8759-ae6dfe56384f-kubelet-config\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962919 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-system-cni-dir\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cca38f39-2d09-446e-95b3-4cf9acdd3fba-cni-binary-copy\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c5sk\" (UniqueName: \"kubernetes.io/projected/cca38f39-2d09-446e-95b3-4cf9acdd3fba-kube-api-access-7c5sk\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.962988 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5j4vw\" (UniqueName: \"kubernetes.io/projected/02bc8053-f2b2-4d78-b65d-573a14482c57-kube-api-access-5j4vw\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:05.963181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.963012 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rkfx\" (UniqueName: \"kubernetes.io/projected/effafd9f-d087-4170-85ee-00b4b7be09df-kube-api-access-4rkfx\") pod \"iptables-alerter-c8hgs\" (UID: \"effafd9f-d087-4170-85ee-00b4b7be09df\") " pod="openshift-network-operator/iptables-alerter-c8hgs" Jun 09 14:12:05.963767 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.963044 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-socket-dir-parent\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.963767 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.963068 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-var-lib-kubelet\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.963767 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.963085 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79nqn\" (UniqueName: \"kubernetes.io/projected/c0fe143e-02b1-4866-a4bd-a271ef19ec97-kube-api-access-79nqn\") pod \"node-resolver-6qlj7\" (UID: \"c0fe143e-02b1-4866-a4bd-a271ef19ec97\") " pod="openshift-dns/node-resolver-6qlj7" Jun 09 14:12:05.963767 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.963125 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-var-lib-cni-multus\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:05.965241 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.965218 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 14:12:05.986530 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.986506 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-89l5g" Jun 09 14:12:05.991817 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:05.991790 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-89l5g" Jun 09 14:12:06.033015 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.032931 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-120.ec2.internal" event={"ID":"16b6c839f3f5f672e5e6038ba9c6104d","Type":"ContainerStarted","Data":"fdcca571d45fbe24bf465a43f787c2e97f55b83ae42ac3c0047e725c4cab84c4"} Jun 09 14:12:06.034065 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.034036 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" event={"ID":"60e4a7bf1af317e32f763d4b27e8d9df","Type":"ContainerStarted","Data":"fbc26bcbebe3c95b0ae290ed9a02dd48f0afa5ad52670e980b5e7eb59adc307d"} Jun 09 14:12:06.052461 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.052428 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 14:12:06.063903 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.063860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-var-lib-cni-bin\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.064084 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.063911 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-system-cni-dir\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.064084 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.063940 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-host\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.064084 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.063953 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-var-lib-cni-bin\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.064084 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.063968 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-etc-openvswitch\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.064084 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064049 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-run-k8s-cni-cncf-io\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.064084 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064053 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-system-cni-dir\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.064084 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064078 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0fe143e-02b1-4866-a4bd-a271ef19ec97-hosts-file\") pod \"node-resolver-6qlj7\" (UID: \"c0fe143e-02b1-4866-a4bd-a271ef19ec97\") " pod="openshift-dns/node-resolver-6qlj7" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064103 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-socket-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064152 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-systemd\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064165 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-run-k8s-cni-cncf-io\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064187 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-run-ovn\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064214 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc27edc3-d7be-4a36-beca-e2792a6f436d-ovn-node-metrics-cert\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064240 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10f9c799-543d-4af0-81b4-3457e301f3bb-host\") pod \"node-ca-xqjzs\" (UID: \"10f9c799-543d-4af0-81b4-3457e301f3bb\") " pod="openshift-image-registry/node-ca-xqjzs" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064265 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064298 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-run-multus-certs\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064322 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-socket-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064327 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-registration-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064364 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-lib-modules\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064379 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-run-multus-certs\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064390 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-systemd-units\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064406 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10f9c799-543d-4af0-81b4-3457e301f3bb-host\") pod \"node-ca-xqjzs\" (UID: \"10f9c799-543d-4af0-81b4-3457e301f3bb\") " pod="openshift-image-registry/node-ca-xqjzs" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064417 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6l6f\" (UniqueName: \"kubernetes.io/projected/dc27edc3-d7be-4a36-beca-e2792a6f436d-kube-api-access-c6l6f\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.064443 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.064436 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064463 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-registration-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064442 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-sysctl-d\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064439 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0fe143e-02b1-4866-a4bd-a271ef19ec97-hosts-file\") pod \"node-resolver-6qlj7\" (UID: \"c0fe143e-02b1-4866-a4bd-a271ef19ec97\") " pod="openshift-dns/node-resolver-6qlj7" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.064537 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs podName:02bc8053-f2b2-4d78-b65d-573a14482c57 nodeName:}" failed. No retries permitted until 2026-06-09 14:12:06.564501251 +0000 UTC m=+3.006700429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs") pod "network-metrics-daemon-nhcwv" (UID: "02bc8053-f2b2-4d78-b65d-573a14482c57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064560 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-var-lib-kubelet\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064590 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc27edc3-d7be-4a36-beca-e2792a6f436d-ovnkube-script-lib\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064619 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-os-release\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064639 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgkbj\" (UniqueName: \"kubernetes.io/projected/50bde0a0-6d0a-41eb-a773-c5f817a072e2-kube-api-access-wgkbj\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-sys-fs\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064671 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2a937b25-9644-43ec-8712-bda95709a011-agent-certs\") pod \"konnectivity-agent-dddlm\" (UID: \"2a937b25-9644-43ec-8712-bda95709a011\") " pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064752 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-sys-fs\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064783 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cca38f39-2d09-446e-95b3-4cf9acdd3fba-cni-binary-copy\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064819 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c5sk\" (UniqueName: \"kubernetes.io/projected/cca38f39-2d09-446e-95b3-4cf9acdd3fba-kube-api-access-7c5sk\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5j4vw\" (UniqueName: \"kubernetes.io/projected/02bc8053-f2b2-4d78-b65d-573a14482c57-kube-api-access-5j4vw\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-sys\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.065195 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064901 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-run-systemd\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064852 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-os-release\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064925 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc27edc3-d7be-4a36-beca-e2792a6f436d-env-overrides\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064961 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-kubernetes\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.064986 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065076 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/386d098e-006f-43ef-8d69-f005af17d916-tmp\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065097 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfx28\" (UniqueName: \"kubernetes.io/projected/386d098e-006f-43ef-8d69-f005af17d916-kube-api-access-xfx28\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065152 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-cni-bin\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065184 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-run-netns\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065211 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-daemon-config\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065235 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065259 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z8qt\" (UniqueName: \"kubernetes.io/projected/10f9c799-543d-4af0-81b4-3457e301f3bb-kube-api-access-8z8qt\") pod \"node-ca-xqjzs\" (UID: \"10f9c799-543d-4af0-81b4-3457e301f3bb\") " pod="openshift-image-registry/node-ca-xqjzs" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065264 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-run-netns\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065286 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/effafd9f-d087-4170-85ee-00b4b7be09df-host-slash\") pod \"iptables-alerter-c8hgs\" (UID: \"effafd9f-d087-4170-85ee-00b4b7be09df\") " pod="openshift-network-operator/iptables-alerter-c8hgs" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065309 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-hostroot\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065331 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-conf-dir\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-sysctl-conf\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065376 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-var-lib-openvswitch\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.065969 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065423 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-etc-kubernetes\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065430 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cca38f39-2d09-446e-95b3-4cf9acdd3fba-cni-binary-copy\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065437 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-run\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065506 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-log-socket\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065533 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-run-ovn-kubernetes\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065562 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065584 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/effafd9f-d087-4170-85ee-00b4b7be09df-host-slash\") pod \"iptables-alerter-c8hgs\" (UID: \"effafd9f-d087-4170-85ee-00b4b7be09df\") " pod="openshift-network-operator/iptables-alerter-c8hgs" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065594 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-device-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065643 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065674 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-hostroot\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065709 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-conf-dir\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065821 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-daemon-config\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065830 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10f9c799-543d-4af0-81b4-3457e301f3bb-serviceca\") pod \"node-ca-xqjzs\" (UID: \"10f9c799-543d-4af0-81b4-3457e301f3bb\") " pod="openshift-image-registry/node-ca-xqjzs" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065853 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065887 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50bde0a0-6d0a-41eb-a773-c5f817a072e2-cni-binary-copy\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065892 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-etc-kubernetes\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.066818 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.065922 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066054 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-os-release\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066081 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cca38f39-2d09-446e-95b3-4cf9acdd3fba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-cnibin\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066154 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9a106a4-e64e-494f-8759-ae6dfe56384f-dbus\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc27edc3-d7be-4a36-beca-e2792a6f436d-ovnkube-config\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066245 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-cnibin\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066271 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cca38f39-2d09-446e-95b3-4cf9acdd3fba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066285 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/10f9c799-543d-4af0-81b4-3457e301f3bb-serviceca\") pod \"node-ca-xqjzs\" (UID: \"10f9c799-543d-4af0-81b4-3457e301f3bb\") " pod="openshift-image-registry/node-ca-xqjzs" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066298 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/effafd9f-d087-4170-85ee-00b4b7be09df-iptables-alerter-script\") pod \"iptables-alerter-c8hgs\" (UID: \"effafd9f-d087-4170-85ee-00b4b7be09df\") " pod="openshift-network-operator/iptables-alerter-c8hgs" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066300 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-device-dir\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9a106a4-e64e-494f-8759-ae6dfe56384f-kubelet-config\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066350 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wgr4\" (UniqueName: \"kubernetes.io/projected/e8a6a503-3148-4901-8489-7ef746f890bf-kube-api-access-5wgr4\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066353 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/50bde0a0-6d0a-41eb-a773-c5f817a072e2-cni-binary-copy\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066369 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/b9a106a4-e64e-494f-8759-ae6dfe56384f-dbus\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066378 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-slash\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.066385 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:06.067613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066405 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-system-cni-dir\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066409 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-cnibin\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066477 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-os-release\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.066553 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret podName:b9a106a4-e64e-494f-8759-ae6dfe56384f nodeName:}" failed. No retries permitted until 2026-06-09 14:12:06.566537123 +0000 UTC m=+3.008736305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret") pod "global-pull-secret-syncer-vzbm9" (UID: "b9a106a4-e64e-494f-8759-ae6dfe56384f") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066599 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/b9a106a4-e64e-494f-8759-ae6dfe56384f-kubelet-config\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066778 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rkfx\" (UniqueName: \"kubernetes.io/projected/effafd9f-d087-4170-85ee-00b4b7be09df-kube-api-access-4rkfx\") pod \"iptables-alerter-c8hgs\" (UID: \"effafd9f-d087-4170-85ee-00b4b7be09df\") " pod="openshift-network-operator/iptables-alerter-c8hgs" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-socket-dir-parent\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066831 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-var-lib-kubelet\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066858 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79nqn\" (UniqueName: \"kubernetes.io/projected/c0fe143e-02b1-4866-a4bd-a271ef19ec97-kube-api-access-79nqn\") pod \"node-resolver-6qlj7\" (UID: \"c0fe143e-02b1-4866-a4bd-a271ef19ec97\") " pod="openshift-dns/node-resolver-6qlj7" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066867 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/cca38f39-2d09-446e-95b3-4cf9acdd3fba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066884 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-modprobe-d\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066961 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-socket-dir-parent\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.066980 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/effafd9f-d087-4170-85ee-00b4b7be09df-iptables-alerter-script\") pod \"iptables-alerter-c8hgs\" (UID: \"effafd9f-d087-4170-85ee-00b4b7be09df\") " pod="openshift-network-operator/iptables-alerter-c8hgs" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067077 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-kubelet\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067133 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-node-log\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067162 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-var-lib-cni-multus\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.068287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067210 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-var-lib-kubelet\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067237 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-host-var-lib-cni-multus\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067279 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cca38f39-2d09-446e-95b3-4cf9acdd3fba-system-cni-dir\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067306 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2a937b25-9644-43ec-8712-bda95709a011-konnectivity-ca\") pod \"konnectivity-agent-dddlm\" (UID: \"2a937b25-9644-43ec-8712-bda95709a011\") " pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067324 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-cnibin\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067356 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-sysconfig\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067370 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e8a6a503-3148-4901-8489-7ef746f890bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067383 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/386d098e-006f-43ef-8d69-f005af17d916-etc-tuned\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067424 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzpx7\" (UniqueName: \"kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7\") pod \"network-check-target-26vrm\" (UID: \"6b4404c8-360b-4043-9d51-9505f09b90ee\") " pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067453 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/cca38f39-2d09-446e-95b3-4cf9acdd3fba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067516 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-run-openvswitch\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067569 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-cni-netd\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067612 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-cni-dir\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067669 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/50bde0a0-6d0a-41eb-a773-c5f817a072e2-multus-cni-dir\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067701 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0fe143e-02b1-4866-a4bd-a271ef19ec97-tmp-dir\") pod \"node-resolver-6qlj7\" (UID: \"c0fe143e-02b1-4866-a4bd-a271ef19ec97\") " pod="openshift-dns/node-resolver-6qlj7" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067733 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-run-netns\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.069042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067864 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2a937b25-9644-43ec-8712-bda95709a011-konnectivity-ca\") pod \"konnectivity-agent-dddlm\" (UID: \"2a937b25-9644-43ec-8712-bda95709a011\") " pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:06.069899 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.067945 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0fe143e-02b1-4866-a4bd-a271ef19ec97-tmp-dir\") pod \"node-resolver-6qlj7\" (UID: \"c0fe143e-02b1-4866-a4bd-a271ef19ec97\") " pod="openshift-dns/node-resolver-6qlj7" Jun 09 14:12:06.069899 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.068737 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2a937b25-9644-43ec-8712-bda95709a011-agent-certs\") pod \"konnectivity-agent-dddlm\" (UID: \"2a937b25-9644-43ec-8712-bda95709a011\") " pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:06.077703 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.077529 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgkbj\" (UniqueName: \"kubernetes.io/projected/50bde0a0-6d0a-41eb-a773-c5f817a072e2-kube-api-access-wgkbj\") pod \"multus-49t44\" (UID: \"50bde0a0-6d0a-41eb-a773-c5f817a072e2\") " pod="openshift-multus/multus-49t44" Jun 09 14:12:06.077703 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.077633 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5j4vw\" (UniqueName: \"kubernetes.io/projected/02bc8053-f2b2-4d78-b65d-573a14482c57-kube-api-access-5j4vw\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:06.077958 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.077823 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c5sk\" (UniqueName: \"kubernetes.io/projected/cca38f39-2d09-446e-95b3-4cf9acdd3fba-kube-api-access-7c5sk\") pod \"multus-additional-cni-plugins-2x4xx\" (UID: \"cca38f39-2d09-446e-95b3-4cf9acdd3fba\") " pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.078275 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.078255 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wgr4\" (UniqueName: \"kubernetes.io/projected/e8a6a503-3148-4901-8489-7ef746f890bf-kube-api-access-5wgr4\") pod \"aws-ebs-csi-driver-node-jbfz9\" (UID: \"e8a6a503-3148-4901-8489-7ef746f890bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.078390 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.078351 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rkfx\" (UniqueName: \"kubernetes.io/projected/effafd9f-d087-4170-85ee-00b4b7be09df-kube-api-access-4rkfx\") pod \"iptables-alerter-c8hgs\" (UID: \"effafd9f-d087-4170-85ee-00b4b7be09df\") " pod="openshift-network-operator/iptables-alerter-c8hgs" Jun 09 14:12:06.078567 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.078545 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z8qt\" (UniqueName: \"kubernetes.io/projected/10f9c799-543d-4af0-81b4-3457e301f3bb-kube-api-access-8z8qt\") pod \"node-ca-xqjzs\" (UID: \"10f9c799-543d-4af0-81b4-3457e301f3bb\") " pod="openshift-image-registry/node-ca-xqjzs" Jun 09 14:12:06.078885 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.078867 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-79nqn\" (UniqueName: \"kubernetes.io/projected/c0fe143e-02b1-4866-a4bd-a271ef19ec97-kube-api-access-79nqn\") pod \"node-resolver-6qlj7\" (UID: \"c0fe143e-02b1-4866-a4bd-a271ef19ec97\") " pod="openshift-dns/node-resolver-6qlj7" Jun 09 14:12:06.094685 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.094652 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 14:12:06.168271 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168236 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-sysctl-conf\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.168271 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168279 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-var-lib-openvswitch\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.168531 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168306 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-run\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.168531 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-log-socket\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.168531 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168356 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-run-ovn-kubernetes\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.168531 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168383 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.168531 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168448 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-run\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.168531 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168462 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc27edc3-d7be-4a36-beca-e2792a6f436d-ovnkube-config\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.168531 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168462 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-run-ovn-kubernetes\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.168531 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168462 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-log-socket\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.168531 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168483 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-var-lib-openvswitch\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.168531 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168524 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.168531 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168533 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-slash\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168448 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-sysctl-conf\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168570 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-slash\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168562 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-modprobe-d\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168628 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-kubelet\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168658 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-modprobe-d\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-node-log\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-sysconfig\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168699 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-kubelet\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168720 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/386d098e-006f-43ef-8d69-f005af17d916-etc-tuned\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168730 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-node-log\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzpx7\" (UniqueName: \"kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7\") pod \"network-check-target-26vrm\" (UID: \"6b4404c8-360b-4043-9d51-9505f09b90ee\") " pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168748 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-sysconfig\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168770 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-run-openvswitch\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168797 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-cni-netd\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168822 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-run-netns\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168846 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-host\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168854 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-run-openvswitch\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168870 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-etc-openvswitch\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168898 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-systemd\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168940 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-run-ovn\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.168963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc27edc3-d7be-4a36-beca-e2792a6f436d-ovn-node-metrics-cert\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169002 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-lib-modules\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169027 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-systemd-units\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6l6f\" (UniqueName: \"kubernetes.io/projected/dc27edc3-d7be-4a36-beca-e2792a6f436d-kube-api-access-c6l6f\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169056 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dc27edc3-d7be-4a36-beca-e2792a6f436d-ovnkube-config\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-sysctl-d\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169095 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-etc-openvswitch\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-var-lib-kubelet\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169159 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-systemd-units\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169177 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-systemd\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169240 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-var-lib-kubelet\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169280 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-lib-modules\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169336 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-run-netns\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169339 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-sysctl-d\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169280 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-host\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.169843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169372 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-run-ovn\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169397 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-cni-netd\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169409 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc27edc3-d7be-4a36-beca-e2792a6f436d-ovnkube-script-lib\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-sys\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-run-systemd\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169509 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc27edc3-d7be-4a36-beca-e2792a6f436d-env-overrides\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169522 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-sys\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-kubernetes\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169551 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/386d098e-006f-43ef-8d69-f005af17d916-tmp\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfx28\" (UniqueName: \"kubernetes.io/projected/386d098e-006f-43ef-8d69-f005af17d916-kube-api-access-xfx28\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169599 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-run-systemd\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169603 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-cni-bin\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169641 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc27edc3-d7be-4a36-beca-e2792a6f436d-host-cni-bin\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169645 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/386d098e-006f-43ef-8d69-f005af17d916-etc-kubernetes\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.170761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.169912 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dc27edc3-d7be-4a36-beca-e2792a6f436d-ovnkube-script-lib\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.171475 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.171001 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dc27edc3-d7be-4a36-beca-e2792a6f436d-env-overrides\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.171475 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.171432 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/386d098e-006f-43ef-8d69-f005af17d916-etc-tuned\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.171879 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.171845 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dc27edc3-d7be-4a36-beca-e2792a6f436d-ovn-node-metrics-cert\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.172102 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.172082 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/386d098e-006f-43ef-8d69-f005af17d916-tmp\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.175021 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.174979 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:12:06.175021 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.175011 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:12:06.175021 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.175025 2572 projected.go:196] Error preparing data for projected volume kube-api-access-wzpx7 for pod openshift-network-diagnostics/network-check-target-26vrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:06.175285 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.175096 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7 podName:6b4404c8-360b-4043-9d51-9505f09b90ee nodeName:}" failed. No retries permitted until 2026-06-09 14:12:06.675077932 +0000 UTC m=+3.117277106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wzpx7" (UniqueName: "kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7") pod "network-check-target-26vrm" (UID: "6b4404c8-360b-4043-9d51-9505f09b90ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:06.177716 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.177635 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfx28\" (UniqueName: \"kubernetes.io/projected/386d098e-006f-43ef-8d69-f005af17d916-kube-api-access-xfx28\") pod \"tuned-54w7b\" (UID: \"386d098e-006f-43ef-8d69-f005af17d916\") " pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.177716 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.177641 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6l6f\" (UniqueName: \"kubernetes.io/projected/dc27edc3-d7be-4a36-beca-e2792a6f436d-kube-api-access-c6l6f\") pod \"ovnkube-node-fc7n9\" (UID: \"dc27edc3-d7be-4a36-beca-e2792a6f436d\") " pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.249147 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.249101 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" Jun 09 14:12:06.257394 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.257365 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xqjzs" Jun 09 14:12:06.267343 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.267314 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" Jun 09 14:12:06.274456 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.274421 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-c8hgs" Jun 09 14:12:06.281394 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.281369 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-49t44" Jun 09 14:12:06.287397 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.287372 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:06.293399 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.293376 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6qlj7" Jun 09 14:12:06.300428 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.300407 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-54w7b" Jun 09 14:12:06.305474 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.305447 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:06.572119 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.572021 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:06.572119 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.572095 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:06.572321 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.572201 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:06.572321 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.572240 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:06.572321 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.572275 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret podName:b9a106a4-e64e-494f-8759-ae6dfe56384f nodeName:}" failed. No retries permitted until 2026-06-09 14:12:07.572258897 +0000 UTC m=+4.014458073 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret") pod "global-pull-secret-syncer-vzbm9" (UID: "b9a106a4-e64e-494f-8759-ae6dfe56384f") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:06.572321 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.572296 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs podName:02bc8053-f2b2-4d78-b65d-573a14482c57 nodeName:}" failed. No retries permitted until 2026-06-09 14:12:07.572285612 +0000 UTC m=+4.014484786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs") pod "network-metrics-daemon-nhcwv" (UID: "02bc8053-f2b2-4d78-b65d-573a14482c57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:06.774066 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.774025 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzpx7\" (UniqueName: \"kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7\") pod \"network-check-target-26vrm\" (UID: \"6b4404c8-360b-4043-9d51-9505f09b90ee\") " pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:06.774263 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.774194 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:12:06.774263 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.774215 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:12:06.774263 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.774224 2572 projected.go:196] Error preparing data for projected volume kube-api-access-wzpx7 for pod openshift-network-diagnostics/network-check-target-26vrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:06.774422 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:06.774284 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7 podName:6b4404c8-360b-4043-9d51-9505f09b90ee nodeName:}" failed. No retries permitted until 2026-06-09 14:12:07.774266178 +0000 UTC m=+4.216465372 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzpx7" (UniqueName: "kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7") pod "network-check-target-26vrm" (UID: "6b4404c8-360b-4043-9d51-9505f09b90ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:06.880065 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:06.880034 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc27edc3_d7be_4a36_beca_e2792a6f436d.slice/crio-ec9a22382657f97c0673f59f898a878a62d2746fe2012ab2e04127217f399dc6 WatchSource:0}: Error finding container ec9a22382657f97c0673f59f898a878a62d2746fe2012ab2e04127217f399dc6: Status 404 returned error can't find the container with id ec9a22382657f97c0673f59f898a878a62d2746fe2012ab2e04127217f399dc6 Jun 09 14:12:06.881582 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:06.881451 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8a6a503_3148_4901_8489_7ef746f890bf.slice/crio-22a7434047d1f8868ba6948e277422b25af97106256b5585a749e6f5cb8d0796 WatchSource:0}: Error finding container 22a7434047d1f8868ba6948e277422b25af97106256b5585a749e6f5cb8d0796: Status 404 returned error can't find the container with id 22a7434047d1f8868ba6948e277422b25af97106256b5585a749e6f5cb8d0796 Jun 09 14:12:06.885957 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:06.885923 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a937b25_9644_43ec_8712_bda95709a011.slice/crio-450dc8e1cfe30851d6f239b68ce9d5cd5b778496f90d57d5000a9b8fe733f0a4 WatchSource:0}: Error finding container 450dc8e1cfe30851d6f239b68ce9d5cd5b778496f90d57d5000a9b8fe733f0a4: Status 404 returned error can't find the container with id 450dc8e1cfe30851d6f239b68ce9d5cd5b778496f90d57d5000a9b8fe733f0a4 Jun 09 14:12:06.888380 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:06.888296 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bde0a0_6d0a_41eb_a773_c5f817a072e2.slice/crio-15135063cfa280f5f5d5224aaaf118b43d065016384fe169b6b6a4fd7db32523 WatchSource:0}: Error finding container 15135063cfa280f5f5d5224aaaf118b43d065016384fe169b6b6a4fd7db32523: Status 404 returned error can't find the container with id 15135063cfa280f5f5d5224aaaf118b43d065016384fe169b6b6a4fd7db32523 Jun 09 14:12:06.889037 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:06.889014 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386d098e_006f_43ef_8d69_f005af17d916.slice/crio-2132f41a9cb236522d100217a477a555adab1b43dcc938400262ee21a777b76b WatchSource:0}: Error finding container 2132f41a9cb236522d100217a477a555adab1b43dcc938400262ee21a777b76b: Status 404 returned error can't find the container with id 2132f41a9cb236522d100217a477a555adab1b43dcc938400262ee21a777b76b Jun 09 14:12:06.891634 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:06.891603 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeffafd9f_d087_4170_85ee_00b4b7be09df.slice/crio-eb1af5fdb3953ef39980c7b0613e613069bbc5c22a454db01bedfbb65061d75b WatchSource:0}: Error finding container eb1af5fdb3953ef39980c7b0613e613069bbc5c22a454db01bedfbb65061d75b: Status 404 returned error can't find the container with id eb1af5fdb3953ef39980c7b0613e613069bbc5c22a454db01bedfbb65061d75b Jun 09 14:12:06.892590 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:06.892534 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca38f39_2d09_446e_95b3_4cf9acdd3fba.slice/crio-a661d8ba9ca5176ca8975dbcdbd6faf99f10d924f1b29b02d361b978db2dc065 WatchSource:0}: Error finding container a661d8ba9ca5176ca8975dbcdbd6faf99f10d924f1b29b02d361b978db2dc065: Status 404 returned error can't find the container with id a661d8ba9ca5176ca8975dbcdbd6faf99f10d924f1b29b02d361b978db2dc065 Jun 09 14:12:06.893673 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:06.893646 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f9c799_543d_4af0_81b4_3457e301f3bb.slice/crio-a3614d8c7e678661e016e6e65395557666dccd6a56d64cabc564bae46e702827 WatchSource:0}: Error finding container a3614d8c7e678661e016e6e65395557666dccd6a56d64cabc564bae46e702827: Status 404 returned error can't find the container with id a3614d8c7e678661e016e6e65395557666dccd6a56d64cabc564bae46e702827 Jun 09 14:12:06.896040 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:06.896014 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0fe143e_02b1_4866_a4bd_a271ef19ec97.slice/crio-ef36c45f658d9f9503a3ef0da88215820a434780939f2b6c44e941179e7de033 WatchSource:0}: Error finding container ef36c45f658d9f9503a3ef0da88215820a434780939f2b6c44e941179e7de033: Status 404 returned error can't find the container with id ef36c45f658d9f9503a3ef0da88215820a434780939f2b6c44e941179e7de033 Jun 09 14:12:06.994736 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.994685 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:07:05 +0000 UTC" deadline="2028-03-01 14:12:13.854886848 +0000 UTC" Jun 09 14:12:06.994736 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:06.994732 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15144h0m6.860157613s" Jun 09 14:12:07.039799 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.039762 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" event={"ID":"dc27edc3-d7be-4a36-beca-e2792a6f436d","Type":"ContainerStarted","Data":"ec9a22382657f97c0673f59f898a878a62d2746fe2012ab2e04127217f399dc6"} Jun 09 14:12:07.040900 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.040871 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-49t44" event={"ID":"50bde0a0-6d0a-41eb-a773-c5f817a072e2","Type":"ContainerStarted","Data":"15135063cfa280f5f5d5224aaaf118b43d065016384fe169b6b6a4fd7db32523"} Jun 09 14:12:07.041911 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.041888 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqjzs" event={"ID":"10f9c799-543d-4af0-81b4-3457e301f3bb","Type":"ContainerStarted","Data":"a3614d8c7e678661e016e6e65395557666dccd6a56d64cabc564bae46e702827"} Jun 09 14:12:07.046085 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.046060 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-54w7b" event={"ID":"386d098e-006f-43ef-8d69-f005af17d916","Type":"ContainerStarted","Data":"2132f41a9cb236522d100217a477a555adab1b43dcc938400262ee21a777b76b"} Jun 09 14:12:07.048795 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.048759 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-120.ec2.internal" event={"ID":"16b6c839f3f5f672e5e6038ba9c6104d","Type":"ContainerStarted","Data":"e5e616b117bc97c6c28c197a31fff39ae3a1625b4ef0e4e348030f174cec6539"} Jun 09 14:12:07.054146 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.054098 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8hgs" event={"ID":"effafd9f-d087-4170-85ee-00b4b7be09df","Type":"ContainerStarted","Data":"eb1af5fdb3953ef39980c7b0613e613069bbc5c22a454db01bedfbb65061d75b"} Jun 09 14:12:07.057250 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.057197 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" event={"ID":"cca38f39-2d09-446e-95b3-4cf9acdd3fba","Type":"ContainerStarted","Data":"a661d8ba9ca5176ca8975dbcdbd6faf99f10d924f1b29b02d361b978db2dc065"} Jun 09 14:12:07.058315 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.058293 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6qlj7" event={"ID":"c0fe143e-02b1-4866-a4bd-a271ef19ec97","Type":"ContainerStarted","Data":"ef36c45f658d9f9503a3ef0da88215820a434780939f2b6c44e941179e7de033"} Jun 09 14:12:07.060758 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.060728 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dddlm" event={"ID":"2a937b25-9644-43ec-8712-bda95709a011","Type":"ContainerStarted","Data":"450dc8e1cfe30851d6f239b68ce9d5cd5b778496f90d57d5000a9b8fe733f0a4"} Jun 09 14:12:07.062173 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.062134 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-120.ec2.internal" podStartSLOduration=2.062121887 podStartE2EDuration="2.062121887s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:07.062006527 +0000 UTC m=+3.504205741" watchObservedRunningTime="2026-06-09 14:12:07.062121887 +0000 UTC m=+3.504321079" Jun 09 14:12:07.063381 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.063361 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" event={"ID":"e8a6a503-3148-4901-8489-7ef746f890bf","Type":"ContainerStarted","Data":"22a7434047d1f8868ba6948e277422b25af97106256b5585a749e6f5cb8d0796"} Jun 09 14:12:07.580695 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.579851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:07.580695 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.579945 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:07.580695 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:07.580086 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:07.580695 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:07.580176 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs podName:02bc8053-f2b2-4d78-b65d-573a14482c57 nodeName:}" failed. No retries permitted until 2026-06-09 14:12:09.580155513 +0000 UTC m=+6.022354705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs") pod "network-metrics-daemon-nhcwv" (UID: "02bc8053-f2b2-4d78-b65d-573a14482c57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:07.580695 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:07.580615 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:07.580695 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:07.580669 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret podName:b9a106a4-e64e-494f-8759-ae6dfe56384f nodeName:}" failed. No retries permitted until 2026-06-09 14:12:09.580653196 +0000 UTC m=+6.022852389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret") pod "global-pull-secret-syncer-vzbm9" (UID: "b9a106a4-e64e-494f-8759-ae6dfe56384f") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:07.781190 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.781091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzpx7\" (UniqueName: \"kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7\") pod \"network-check-target-26vrm\" (UID: \"6b4404c8-360b-4043-9d51-9505f09b90ee\") " pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:07.781392 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:07.781308 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:12:07.781392 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:07.781334 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:12:07.781392 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:07.781348 2572 projected.go:196] Error preparing data for projected volume kube-api-access-wzpx7 for pod openshift-network-diagnostics/network-check-target-26vrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:07.781585 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:07.781413 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7 podName:6b4404c8-360b-4043-9d51-9505f09b90ee nodeName:}" failed. No retries permitted until 2026-06-09 14:12:09.781394215 +0000 UTC m=+6.223593408 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzpx7" (UniqueName: "kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7") pod "network-check-target-26vrm" (UID: "6b4404c8-360b-4043-9d51-9505f09b90ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:07.996048 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.996003 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 14:07:05 +0000 UTC" deadline="2027-11-05 12:28:08.969030527 +0000 UTC" Jun 09 14:12:07.996048 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:07.996046 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12334h16m0.972989038s" Jun 09 14:12:08.027258 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:08.027226 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:08.027422 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:08.027230 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:08.027422 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:08.027344 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:08.027422 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:08.027369 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:08.027576 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:08.027438 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:08.027632 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:08.027568 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:08.084265 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:08.084165 2572 generic.go:356] "Generic (PLEG): container finished" podID="60e4a7bf1af317e32f763d4b27e8d9df" containerID="7407cce466df7d0d9d2a73263284eadb6a87cea9da6be512e479f2551dd66b43" exitCode=0 Jun 09 14:12:08.084440 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:08.084269 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" event={"ID":"60e4a7bf1af317e32f763d4b27e8d9df","Type":"ContainerDied","Data":"7407cce466df7d0d9d2a73263284eadb6a87cea9da6be512e479f2551dd66b43"} Jun 09 14:12:09.090193 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:09.090077 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" event={"ID":"60e4a7bf1af317e32f763d4b27e8d9df","Type":"ContainerStarted","Data":"ae0d6101381695e95fd6a68dcb2adb6d181546c610a5271d2a98380f37ff71e0"} Jun 09 14:12:09.599610 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:09.599569 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:09.599827 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:09.599646 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:09.599827 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:09.599770 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:09.599978 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:09.599833 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret podName:b9a106a4-e64e-494f-8759-ae6dfe56384f nodeName:}" failed. No retries permitted until 2026-06-09 14:12:13.599815616 +0000 UTC m=+10.042014791 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret") pod "global-pull-secret-syncer-vzbm9" (UID: "b9a106a4-e64e-494f-8759-ae6dfe56384f") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:09.600324 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:09.600297 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:09.600430 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:09.600358 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs podName:02bc8053-f2b2-4d78-b65d-573a14482c57 nodeName:}" failed. No retries permitted until 2026-06-09 14:12:13.600340277 +0000 UTC m=+10.042539453 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs") pod "network-metrics-daemon-nhcwv" (UID: "02bc8053-f2b2-4d78-b65d-573a14482c57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:09.801355 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:09.801307 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzpx7\" (UniqueName: \"kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7\") pod \"network-check-target-26vrm\" (UID: \"6b4404c8-360b-4043-9d51-9505f09b90ee\") " pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:09.801554 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:09.801530 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:12:09.801554 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:09.801554 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:12:09.801668 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:09.801568 2572 projected.go:196] Error preparing data for projected volume kube-api-access-wzpx7 for pod openshift-network-diagnostics/network-check-target-26vrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:09.801668 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:09.801654 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7 podName:6b4404c8-360b-4043-9d51-9505f09b90ee nodeName:}" failed. No retries permitted until 2026-06-09 14:12:13.801608966 +0000 UTC m=+10.243808140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzpx7" (UniqueName: "kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7") pod "network-check-target-26vrm" (UID: "6b4404c8-360b-4043-9d51-9505f09b90ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:10.027060 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:10.027018 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:10.027060 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:10.027044 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:10.027359 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:10.027194 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:10.027359 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:10.027247 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:10.027359 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:10.027277 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:10.027518 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:10.027381 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:12.026544 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:12.026509 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:12.027067 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:12.026509 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:12.027067 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:12.026662 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:12.027067 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:12.026739 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:12.027067 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:12.026773 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:12.027067 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:12.026843 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:13.640961 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:13.640634 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:13.640961 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:13.640714 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:13.640961 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:13.640778 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:13.640961 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:13.640871 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:13.640961 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:13.640874 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs podName:02bc8053-f2b2-4d78-b65d-573a14482c57 nodeName:}" failed. No retries permitted until 2026-06-09 14:12:21.640853297 +0000 UTC m=+18.083052485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs") pod "network-metrics-daemon-nhcwv" (UID: "02bc8053-f2b2-4d78-b65d-573a14482c57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:13.640961 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:13.640934 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret podName:b9a106a4-e64e-494f-8759-ae6dfe56384f nodeName:}" failed. No retries permitted until 2026-06-09 14:12:21.640918237 +0000 UTC m=+18.083117415 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret") pod "global-pull-secret-syncer-vzbm9" (UID: "b9a106a4-e64e-494f-8759-ae6dfe56384f") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:13.842063 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:13.842023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzpx7\" (UniqueName: \"kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7\") pod \"network-check-target-26vrm\" (UID: \"6b4404c8-360b-4043-9d51-9505f09b90ee\") " pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:13.842315 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:13.842234 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:12:13.842315 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:13.842258 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:12:13.842315 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:13.842270 2572 projected.go:196] Error preparing data for projected volume kube-api-access-wzpx7 for pod openshift-network-diagnostics/network-check-target-26vrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:13.842512 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:13.842338 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7 podName:6b4404c8-360b-4043-9d51-9505f09b90ee nodeName:}" failed. No retries permitted until 2026-06-09 14:12:21.842318476 +0000 UTC m=+18.284517658 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzpx7" (UniqueName: "kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7") pod "network-check-target-26vrm" (UID: "6b4404c8-360b-4043-9d51-9505f09b90ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:14.028073 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:14.027336 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:14.028073 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:14.027453 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:14.028073 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:14.027826 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:14.028073 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:14.027911 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:14.028073 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:14.027967 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:14.028073 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:14.028044 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:16.027247 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:16.027197 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:16.027701 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:16.027347 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:16.027701 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:16.027215 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:16.027701 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:16.027431 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:16.027701 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:16.027209 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:16.027701 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:16.027513 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:18.026902 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:18.026851 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:18.026902 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:18.026901 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:18.027443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:18.026850 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:18.027443 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:18.026986 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:18.027443 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:18.027059 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:18.027443 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:18.027191 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:20.027236 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:20.027192 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:20.027236 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:20.027242 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:20.027732 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:20.027204 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:20.027732 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:20.027332 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:20.027732 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:20.027438 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:20.027732 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:20.027561 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:21.699567 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:21.699526 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:21.700148 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:21.699584 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:21.700148 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:21.699721 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:21.700148 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:21.699790 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs podName:02bc8053-f2b2-4d78-b65d-573a14482c57 nodeName:}" failed. No retries permitted until 2026-06-09 14:12:37.699773804 +0000 UTC m=+34.141972976 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs") pod "network-metrics-daemon-nhcwv" (UID: "02bc8053-f2b2-4d78-b65d-573a14482c57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:21.700148 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:21.699728 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:21.700148 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:21.699882 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret podName:b9a106a4-e64e-494f-8759-ae6dfe56384f nodeName:}" failed. No retries permitted until 2026-06-09 14:12:37.699865958 +0000 UTC m=+34.142065150 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret") pod "global-pull-secret-syncer-vzbm9" (UID: "b9a106a4-e64e-494f-8759-ae6dfe56384f") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:21.900616 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:21.900567 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzpx7\" (UniqueName: \"kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7\") pod \"network-check-target-26vrm\" (UID: \"6b4404c8-360b-4043-9d51-9505f09b90ee\") " pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:21.900803 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:21.900759 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:12:21.900803 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:21.900785 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:12:21.900803 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:21.900800 2572 projected.go:196] Error preparing data for projected volume kube-api-access-wzpx7 for pod openshift-network-diagnostics/network-check-target-26vrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:21.900934 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:21.900868 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7 podName:6b4404c8-360b-4043-9d51-9505f09b90ee nodeName:}" failed. No retries permitted until 2026-06-09 14:12:37.900851576 +0000 UTC m=+34.343050751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzpx7" (UniqueName: "kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7") pod "network-check-target-26vrm" (UID: "6b4404c8-360b-4043-9d51-9505f09b90ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:22.030147 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:22.030052 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:22.030147 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:22.030085 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:22.030147 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:22.030092 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:22.030406 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:22.030178 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:22.030406 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:22.030277 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:22.030406 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:22.030346 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:24.030866 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:24.030663 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:24.031324 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:24.030672 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:24.031324 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:24.030942 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:24.031324 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:24.030682 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:24.031324 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:24.031065 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:24.031324 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:24.031204 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:26.027779 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.027258 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:26.027779 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.027284 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:26.027779 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:26.027412 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:26.027779 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:26.027472 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:26.027779 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.027536 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:26.027779 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:26.027609 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:26.123824 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.123794 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-54w7b" event={"ID":"386d098e-006f-43ef-8d69-f005af17d916","Type":"ContainerStarted","Data":"525e6057020a3a268f5dcf934735742a216d13bd25539bac6bc80e710965a79c"} Jun 09 14:12:26.126086 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.125937 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-dddlm" event={"ID":"2a937b25-9644-43ec-8712-bda95709a011","Type":"ContainerStarted","Data":"f833eab4546a48c6499cc7beb0460a6ffe45d9e4c0c743824060fd0edb488eb3"} Jun 09 14:12:26.128653 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.128612 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" event={"ID":"dc27edc3-d7be-4a36-beca-e2792a6f436d","Type":"ContainerStarted","Data":"7c165b7173afd38bd78131f32220331be16e56a3bcf8b45eddcf5e99d0c385f8"} Jun 09 14:12:26.135657 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.135588 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-49t44" event={"ID":"50bde0a0-6d0a-41eb-a773-c5f817a072e2","Type":"ContainerStarted","Data":"e9b4eaae4b0bb6685e751cf4c0ffa710f3b0dd96709d4d42aa0de420442f2d28"} Jun 09 14:12:26.140280 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.139897 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xqjzs" event={"ID":"10f9c799-543d-4af0-81b4-3457e301f3bb","Type":"ContainerStarted","Data":"a096b8af58652c5755eb55afb95f623342497dca24910304325cff1063613fbb"} Jun 09 14:12:26.141807 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.141668 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-120.ec2.internal" podStartSLOduration=21.141651837 podStartE2EDuration="21.141651837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:12:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:09.112223802 +0000 UTC m=+5.554422998" watchObservedRunningTime="2026-06-09 14:12:26.141651837 +0000 UTC m=+22.583851033" Jun 09 14:12:26.142608 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.142555 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-54w7b" podStartSLOduration=3.135417237 podStartE2EDuration="22.142545539s" totalImagesPullingTime="19.007128302s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:26.141644964 +0000 UTC m=+22.583844148" watchObservedRunningTime="2026-06-09 14:12:26.142545539 +0000 UTC m=+22.584744734" Jun 09 14:12:26.158151 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.158007 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-49t44" podStartSLOduration=3.1373362399999998 podStartE2EDuration="22.157985611s" totalImagesPullingTime="19.020649371s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:26.15793931 +0000 UTC m=+22.600138526" watchObservedRunningTime="2026-06-09 14:12:26.157985611 +0000 UTC m=+22.600185012" Jun 09 14:12:26.173089 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:26.172970 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-dddlm" podStartSLOduration=8.255136466 podStartE2EDuration="22.172951716s" totalImagesPullingTime="13.91781525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:26.172449897 +0000 UTC m=+22.614649091" watchObservedRunningTime="2026-06-09 14:12:26.172951716 +0000 UTC m=+22.615150911" Jun 09 14:12:27.071307 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.071279 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 14:12:27.142913 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.142878 2572 generic.go:356] "Generic (PLEG): container finished" podID="cca38f39-2d09-446e-95b3-4cf9acdd3fba" containerID="c0ab3f48a8a3d8df2f82b78f22a7930d53c79e8755ebb7a2d6284bb61dc60dcd" exitCode=0 Jun 09 14:12:27.143085 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.142950 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" event={"ID":"cca38f39-2d09-446e-95b3-4cf9acdd3fba","Type":"ContainerDied","Data":"c0ab3f48a8a3d8df2f82b78f22a7930d53c79e8755ebb7a2d6284bb61dc60dcd"} Jun 09 14:12:27.144458 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.144359 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6qlj7" event={"ID":"c0fe143e-02b1-4866-a4bd-a271ef19ec97","Type":"ContainerStarted","Data":"132d4fb2441db1aaa3c8d6816f4cc1a5a946ed8658e8f418571cb3fd5bcbe973"} Jun 09 14:12:27.146395 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.146371 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" event={"ID":"e8a6a503-3148-4901-8489-7ef746f890bf","Type":"ContainerStarted","Data":"23f3157a91ee12a5cb12e41559fb8f4d3f3c340e2596da82dc82adab900d0805"} Jun 09 14:12:27.146485 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.146415 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" event={"ID":"e8a6a503-3148-4901-8489-7ef746f890bf","Type":"ContainerStarted","Data":"aa2d3c19b33c6d797a66a3867cfb0d1a97d4d1ce7fae789b547483de16fff9da"} Jun 09 14:12:27.149243 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.149212 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" event={"ID":"dc27edc3-d7be-4a36-beca-e2792a6f436d","Type":"ContainerStarted","Data":"f8de4ae2cebd66dd5d10c42ba58db2ffa637664015a482acfba472df3d1ed487"} Jun 09 14:12:27.149372 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.149281 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" event={"ID":"dc27edc3-d7be-4a36-beca-e2792a6f436d","Type":"ContainerStarted","Data":"6563a89ab385be30027328eb5a8267a10eef8f4693b9bb9513001d556fdb8963"} Jun 09 14:12:27.149372 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.149312 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" event={"ID":"dc27edc3-d7be-4a36-beca-e2792a6f436d","Type":"ContainerStarted","Data":"48e2ec1e8e55639102d0e4298e9904cd4bc6e69c2d15ece3d4f04c76cfeaa0e2"} Jun 09 14:12:27.149372 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.149340 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" event={"ID":"dc27edc3-d7be-4a36-beca-e2792a6f436d","Type":"ContainerStarted","Data":"62139743c249ae206832833bb10ca862d55a916447ba36ef9248437d4e5154f9"} Jun 09 14:12:27.149372 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.149368 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" event={"ID":"dc27edc3-d7be-4a36-beca-e2792a6f436d","Type":"ContainerStarted","Data":"2389e9a48bf18c0d0cf397ffb45a8eb45878e5124b47e3eccb6a6280173caaf7"} Jun 09 14:12:27.163651 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.163609 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xqjzs" podStartSLOduration=9.254656788 podStartE2EDuration="23.163596947s" totalImagesPullingTime="13.908940159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:26.186232036 +0000 UTC m=+22.628431261" watchObservedRunningTime="2026-06-09 14:12:27.163596947 +0000 UTC m=+23.605796141" Jun 09 14:12:27.176780 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.176742 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6qlj7" podStartSLOduration=4.696675727 podStartE2EDuration="23.176729157s" totalImagesPullingTime="18.48005343s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:27.176682942 +0000 UTC m=+23.618882135" watchObservedRunningTime="2026-06-09 14:12:27.176729157 +0000 UTC m=+23.618928350" Jun 09 14:12:27.413435 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.413238 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:27.414333 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.414312 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:27.856996 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.856965 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:27.858083 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:27.857507 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-dddlm" Jun 09 14:12:28.027141 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:28.026935 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:28.027141 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:28.027071 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:28.027141 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:28.027089 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:28.027141 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:28.027137 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:28.027460 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:28.027208 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:28.027460 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:28.027312 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:28.027460 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:28.027361 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T14:12:27.071304977Z","UUID":"00120b7f-1f77-49b7-a0ce-96de082eb038","Handler":null,"Name":"","Endpoint":""} Jun 09 14:12:28.029203 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:28.029180 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 14:12:28.029342 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:28.029225 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 14:12:28.153216 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:28.153125 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-c8hgs" event={"ID":"effafd9f-d087-4170-85ee-00b4b7be09df","Type":"ContainerStarted","Data":"a92587f681358850c209ab5c0b097e73dc61535dc619e01c64bf25ebdbf41a63"} Jun 09 14:12:28.155711 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:28.155682 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" event={"ID":"e8a6a503-3148-4901-8489-7ef746f890bf","Type":"ContainerStarted","Data":"1df94869307a471fcb94cdf116704657503b9504f06d717aa092870114b1b2f3"} Jun 09 14:12:28.168234 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:28.168176 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-c8hgs" podStartSLOduration=10.256642585 podStartE2EDuration="24.168160127s" totalImagesPullingTime="13.911517542s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:28.167650765 +0000 UTC m=+24.609849961" watchObservedRunningTime="2026-06-09 14:12:28.168160127 +0000 UTC m=+24.610359320" Jun 09 14:12:28.183993 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:28.183928 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jbfz9" podStartSLOduration=4.070665634 podStartE2EDuration="24.183904575s" totalImagesPullingTime="20.113238941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:28.183160678 +0000 UTC m=+24.625359871" watchObservedRunningTime="2026-06-09 14:12:28.183904575 +0000 UTC m=+24.626103770" Jun 09 14:12:29.162047 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:29.161999 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" event={"ID":"dc27edc3-d7be-4a36-beca-e2792a6f436d","Type":"ContainerStarted","Data":"630a029e931e971001932d4951023a49e9c342205ce2fa03ee6e1a685d05db8f"} Jun 09 14:12:30.026994 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:30.026957 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:30.027177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:30.027002 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:30.027177 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:30.026957 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:30.027177 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:30.027095 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:30.027342 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:30.027176 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:30.027342 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:30.027292 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:31.070246 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:31.070210 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dddlm_2a937b25-9644-43ec-8712-bda95709a011/konnectivity-agent/0.log" limit=1024 Jun 09 14:12:31.154084 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:31.154044 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dddlm_2a937b25-9644-43ec-8712-bda95709a011/konnectivity-agent/0.log" limit=1024 Jun 09 14:12:32.027003 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:32.026817 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:32.027192 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:32.026825 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:32.027192 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:32.027070 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:32.027313 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:32.027198 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:32.027313 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:32.026878 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:32.027313 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:32.027297 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:32.171455 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:32.171417 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" event={"ID":"dc27edc3-d7be-4a36-beca-e2792a6f436d","Type":"ContainerStarted","Data":"a3f92c51c3b40890b440602a1b0a84a83c766e8e2a3c7aacec1fc3b2efaabda6"} Jun 09 14:12:32.171877 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:32.171709 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:32.173500 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:32.173475 2572 generic.go:356] "Generic (PLEG): container finished" podID="cca38f39-2d09-446e-95b3-4cf9acdd3fba" containerID="64aff3adc2c0bd4c71e9b6763f5e8747b7351bf4426c8567a709d99d65b3585d" exitCode=0 Jun 09 14:12:32.173636 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:32.173516 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" event={"ID":"cca38f39-2d09-446e-95b3-4cf9acdd3fba","Type":"ContainerDied","Data":"64aff3adc2c0bd4c71e9b6763f5e8747b7351bf4426c8567a709d99d65b3585d"} Jun 09 14:12:32.189016 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:32.188978 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:32.246091 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:32.246025 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" podStartSLOduration=9.182649936 podStartE2EDuration="28.246008407s" totalImagesPullingTime="19.063358471s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:32.215282402 +0000 UTC m=+28.657481605" watchObservedRunningTime="2026-06-09 14:12:32.246008407 +0000 UTC m=+28.688207601" Jun 09 14:12:33.176339 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:33.176306 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:33.176778 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:33.176398 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:33.193490 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:33.193262 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:12:33.411534 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:33.411502 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26vrm"] Jun 09 14:12:33.411742 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:33.411626 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:33.411742 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:33.411719 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:33.414565 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:33.414539 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vzbm9"] Jun 09 14:12:33.414707 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:33.414642 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:33.414754 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:33.414727 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:33.415247 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:33.415217 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nhcwv"] Jun 09 14:12:33.415404 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:33.415337 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:33.415481 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:33.415442 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:34.179497 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:34.179454 2572 generic.go:356] "Generic (PLEG): container finished" podID="cca38f39-2d09-446e-95b3-4cf9acdd3fba" containerID="f53837e19b1135f31c56224403a9175e6a0a2412391063561230b702e260b445" exitCode=0 Jun 09 14:12:34.180067 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:34.179537 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" event={"ID":"cca38f39-2d09-446e-95b3-4cf9acdd3fba","Type":"ContainerDied","Data":"f53837e19b1135f31c56224403a9175e6a0a2412391063561230b702e260b445"} Jun 09 14:12:35.027206 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:35.027170 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:35.027206 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:35.027201 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:35.027396 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:35.027280 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:35.027396 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:35.027305 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:35.027502 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:35.027408 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:35.027561 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:35.027530 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:35.184486 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:35.184454 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" event={"ID":"cca38f39-2d09-446e-95b3-4cf9acdd3fba","Type":"ContainerStarted","Data":"b69dc80ae74b938fbd5c24e3b9425c0cef49c4e96d905bbcd364e3a925c49b3f"} Jun 09 14:12:35.268286 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:35.268208 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dddlm_2a937b25-9644-43ec-8712-bda95709a011/konnectivity-agent/0.log" limit=1024 Jun 09 14:12:35.319842 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:35.319811 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dddlm_2a937b25-9644-43ec-8712-bda95709a011/konnectivity-agent/0.log" limit=1024 Jun 09 14:12:36.188712 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:36.188678 2572 generic.go:356] "Generic (PLEG): container finished" podID="cca38f39-2d09-446e-95b3-4cf9acdd3fba" containerID="b69dc80ae74b938fbd5c24e3b9425c0cef49c4e96d905bbcd364e3a925c49b3f" exitCode=0 Jun 09 14:12:36.189196 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:36.188750 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" event={"ID":"cca38f39-2d09-446e-95b3-4cf9acdd3fba","Type":"ContainerDied","Data":"b69dc80ae74b938fbd5c24e3b9425c0cef49c4e96d905bbcd364e3a925c49b3f"} Jun 09 14:12:37.026915 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:37.026882 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:37.026915 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:37.026920 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:37.027169 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:37.026889 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:37.027169 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:37.027007 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:12:37.027169 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:37.027128 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-26vrm" podUID="6b4404c8-360b-4043-9d51-9505f09b90ee" Jun 09 14:12:37.027320 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:37.027209 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vzbm9" podUID="b9a106a4-e64e-494f-8759-ae6dfe56384f" Jun 09 14:12:37.718452 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:37.718185 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:37.718877 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:37.718503 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:37.718877 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:37.718328 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:37.718877 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:37.718611 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs podName:02bc8053-f2b2-4d78-b65d-573a14482c57 nodeName:}" failed. No retries permitted until 2026-06-09 14:13:09.718585104 +0000 UTC m=+66.160784288 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs") pod "network-metrics-daemon-nhcwv" (UID: "02bc8053-f2b2-4d78-b65d-573a14482c57") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 14:12:37.718877 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:37.718621 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:37.718877 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:37.718671 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret podName:b9a106a4-e64e-494f-8759-ae6dfe56384f nodeName:}" failed. No retries permitted until 2026-06-09 14:13:09.718654905 +0000 UTC m=+66.160854091 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret") pod "global-pull-secret-syncer-vzbm9" (UID: "b9a106a4-e64e-494f-8759-ae6dfe56384f") : object "kube-system"/"original-pull-secret" not registered Jun 09 14:12:37.920181 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:37.920143 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzpx7\" (UniqueName: \"kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7\") pod \"network-check-target-26vrm\" (UID: \"6b4404c8-360b-4043-9d51-9505f09b90ee\") " pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:37.920359 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:37.920311 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 14:12:37.920359 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:37.920335 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 14:12:37.920359 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:37.920346 2572 projected.go:196] Error preparing data for projected volume kube-api-access-wzpx7 for pod openshift-network-diagnostics/network-check-target-26vrm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:37.920520 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:37.920395 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7 podName:6b4404c8-360b-4043-9d51-9505f09b90ee nodeName:}" failed. No retries permitted until 2026-06-09 14:13:09.920381372 +0000 UTC m=+66.362580571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wzpx7" (UniqueName: "kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7") pod "network-check-target-26vrm" (UID: "6b4404c8-360b-4043-9d51-9505f09b90ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 14:12:38.187549 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.187517 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dddlm_2a937b25-9644-43ec-8712-bda95709a011/konnectivity-agent/0.log" limit=1024 Jun 09 14:12:38.284679 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.284641 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dddlm_2a937b25-9644-43ec-8712-bda95709a011/konnectivity-agent/0.log" limit=1024 Jun 09 14:12:38.828296 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.828181 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-120.ec2.internal" event="NodeReady" Jun 09 14:12:38.828732 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.828349 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 14:12:38.869321 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.869290 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bgsqh"] Jun 09 14:12:38.886253 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.885419 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n4g6d"] Jun 09 14:12:38.886253 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.885537 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:38.888373 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.888152 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 14:12:38.888373 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.888157 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 14:12:38.888373 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.888205 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55pg5\"" Jun 09 14:12:38.898033 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.898005 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bgsqh"] Jun 09 14:12:38.898201 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.898064 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n4g6d"] Jun 09 14:12:38.898201 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.898127 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n4g6d" Jun 09 14:12:38.900908 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.900884 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 14:12:38.901455 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.900860 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 14:12:38.901619 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.900887 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dqnb4\"" Jun 09 14:12:38.902242 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.901878 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 14:12:38.979355 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:38.979309 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dddlm_2a937b25-9644-43ec-8712-bda95709a011/konnectivity-agent/0.log" limit=1024 Jun 09 14:12:39.027025 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.026977 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:12:39.027025 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.027003 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:12:39.027025 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.027018 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:12:39.028266 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.028243 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcx7g\" (UniqueName: \"kubernetes.io/projected/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-kube-api-access-qcx7g\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.028266 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.028272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/550ca9c4-bb68-4966-86db-fc75333f1114-cert\") pod \"ingress-canary-n4g6d\" (UID: \"550ca9c4-bb68-4966-86db-fc75333f1114\") " pod="openshift-ingress-canary/ingress-canary-n4g6d" Jun 09 14:12:39.028465 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.028372 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-config-volume\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.028465 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.028415 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgz8w\" (UniqueName: \"kubernetes.io/projected/550ca9c4-bb68-4966-86db-fc75333f1114-kube-api-access-qgz8w\") pod \"ingress-canary-n4g6d\" (UID: \"550ca9c4-bb68-4966-86db-fc75333f1114\") " pod="openshift-ingress-canary/ingress-canary-n4g6d" Jun 09 14:12:39.028465 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.028447 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.028617 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.028473 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-tmp-dir\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.029739 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.029718 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 14:12:39.029854 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.029777 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xvhx5\"" Jun 09 14:12:39.029925 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.029904 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hlvfh\"" Jun 09 14:12:39.029991 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.029975 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 14:12:39.030046 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.030009 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 14:12:39.030329 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.030309 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 14:12:39.080591 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.080513 2572 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-dddlm_2a937b25-9644-43ec-8712-bda95709a011/konnectivity-agent/0.log" limit=1024 Jun 09 14:12:39.129601 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.129565 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgz8w\" (UniqueName: \"kubernetes.io/projected/550ca9c4-bb68-4966-86db-fc75333f1114-kube-api-access-qgz8w\") pod \"ingress-canary-n4g6d\" (UID: \"550ca9c4-bb68-4966-86db-fc75333f1114\") " pod="openshift-ingress-canary/ingress-canary-n4g6d" Jun 09 14:12:39.129601 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.129604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.129913 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:39.129701 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:12:39.129913 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.129726 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-tmp-dir\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.129913 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:39.129764 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls podName:e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0 nodeName:}" failed. No retries permitted until 2026-06-09 14:12:39.629745116 +0000 UTC m=+36.071944312 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls") pod "dns-default-bgsqh" (UID: "e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0") : secret "dns-default-metrics-tls" not found Jun 09 14:12:39.129913 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.129856 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcx7g\" (UniqueName: \"kubernetes.io/projected/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-kube-api-access-qcx7g\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.129913 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.129880 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/550ca9c4-bb68-4966-86db-fc75333f1114-cert\") pod \"ingress-canary-n4g6d\" (UID: \"550ca9c4-bb68-4966-86db-fc75333f1114\") " pod="openshift-ingress-canary/ingress-canary-n4g6d" Jun 09 14:12:39.130183 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.129933 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-config-volume\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.130183 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.130058 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-tmp-dir\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.130606 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.130577 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-config-volume\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.134523 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.134488 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/550ca9c4-bb68-4966-86db-fc75333f1114-cert\") pod \"ingress-canary-n4g6d\" (UID: \"550ca9c4-bb68-4966-86db-fc75333f1114\") " pod="openshift-ingress-canary/ingress-canary-n4g6d" Jun 09 14:12:39.138226 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.138203 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcx7g\" (UniqueName: \"kubernetes.io/projected/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-kube-api-access-qcx7g\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.138344 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.138324 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgz8w\" (UniqueName: \"kubernetes.io/projected/550ca9c4-bb68-4966-86db-fc75333f1114-kube-api-access-qgz8w\") pod \"ingress-canary-n4g6d\" (UID: \"550ca9c4-bb68-4966-86db-fc75333f1114\") " pod="openshift-ingress-canary/ingress-canary-n4g6d" Jun 09 14:12:39.211412 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.211376 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n4g6d" Jun 09 14:12:39.634590 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:39.634552 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:39.634816 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:39.634728 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:12:39.634881 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:39.634814 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls podName:e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0 nodeName:}" failed. No retries permitted until 2026-06-09 14:12:40.634790288 +0000 UTC m=+37.076989460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls") pod "dns-default-bgsqh" (UID: "e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0") : secret "dns-default-metrics-tls" not found Jun 09 14:12:40.258632 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.258601 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n4g6d"] Jun 09 14:12:40.262557 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:40.262525 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod550ca9c4_bb68_4966_86db_fc75333f1114.slice/crio-d1b526645a7b2910c537fa50f89c7b9d147a7d8d665f3154d98ca8452e709926 WatchSource:0}: Error finding container d1b526645a7b2910c537fa50f89c7b9d147a7d8d665f3154d98ca8452e709926: Status 404 returned error can't find the container with id d1b526645a7b2910c537fa50f89c7b9d147a7d8d665f3154d98ca8452e709926 Jun 09 14:12:40.397621 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.397548 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh"] Jun 09 14:12:40.414769 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.414649 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k"] Jun 09 14:12:40.414960 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.414783 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" Jun 09 14:12:40.417482 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.417267 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 09 14:12:40.417482 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.417291 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vqffh\"" Jun 09 14:12:40.417482 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.417305 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 09 14:12:40.417482 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.417326 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 09 14:12:40.417482 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.417291 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 09 14:12:40.430382 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.430358 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s"] Jun 09 14:12:40.430523 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.430486 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:40.432713 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.432693 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 09 14:12:40.452643 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.452617 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh"] Jun 09 14:12:40.452763 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.452649 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k"] Jun 09 14:12:40.452763 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.452670 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s"] Jun 09 14:12:40.452763 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.452762 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.455067 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.455040 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 09 14:12:40.455269 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.455144 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 09 14:12:40.455269 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.455169 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 09 14:12:40.455442 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.455425 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 09 14:12:40.542829 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.542804 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.542910 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.542857 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca1399d4-4dee-457b-9a21-a60542d830d2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh\" (UID: \"ca1399d4-4dee-457b-9a21-a60542d830d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" Jun 09 14:12:40.542910 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.542884 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcff4\" (UniqueName: \"kubernetes.io/projected/ca1399d4-4dee-457b-9a21-a60542d830d2-kube-api-access-rcff4\") pod \"managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh\" (UID: \"ca1399d4-4dee-457b-9a21-a60542d830d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" Jun 09 14:12:40.543003 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.542928 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.543003 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.542944 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djdv\" (UniqueName: \"kubernetes.io/projected/7391550e-7814-448d-a092-2489cb83940c-kube-api-access-8djdv\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.543127 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.543065 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78f12462-c4b9-4151-8aa4-e021d251c720-klusterlet-config\") pod \"klusterlet-addon-workmgr-69f59ffb7f-7b77k\" (UID: \"78f12462-c4b9-4151-8aa4-e021d251c720\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:40.543168 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.543127 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-hub\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.543168 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.543161 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7391550e-7814-448d-a092-2489cb83940c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.543251 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.543193 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-ca\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.543251 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.543234 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78f12462-c4b9-4151-8aa4-e021d251c720-tmp\") pod \"klusterlet-addon-workmgr-69f59ffb7f-7b77k\" (UID: \"78f12462-c4b9-4151-8aa4-e021d251c720\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:40.543352 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.543259 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4ffj\" (UniqueName: \"kubernetes.io/projected/78f12462-c4b9-4151-8aa4-e021d251c720-kube-api-access-j4ffj\") pod \"klusterlet-addon-workmgr-69f59ffb7f-7b77k\" (UID: \"78f12462-c4b9-4151-8aa4-e021d251c720\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:40.644051 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644016 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.644228 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644063 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:40.644228 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca1399d4-4dee-457b-9a21-a60542d830d2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh\" (UID: \"ca1399d4-4dee-457b-9a21-a60542d830d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" Jun 09 14:12:40.644228 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644131 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcff4\" (UniqueName: \"kubernetes.io/projected/ca1399d4-4dee-457b-9a21-a60542d830d2-kube-api-access-rcff4\") pod \"managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh\" (UID: \"ca1399d4-4dee-457b-9a21-a60542d830d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" Jun 09 14:12:40.644228 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644168 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.644228 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644191 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djdv\" (UniqueName: \"kubernetes.io/projected/7391550e-7814-448d-a092-2489cb83940c-kube-api-access-8djdv\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.644462 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644269 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78f12462-c4b9-4151-8aa4-e021d251c720-klusterlet-config\") pod \"klusterlet-addon-workmgr-69f59ffb7f-7b77k\" (UID: \"78f12462-c4b9-4151-8aa4-e021d251c720\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:40.644462 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-hub\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.644462 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644316 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7391550e-7814-448d-a092-2489cb83940c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.644462 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-ca\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.644462 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644384 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78f12462-c4b9-4151-8aa4-e021d251c720-tmp\") pod \"klusterlet-addon-workmgr-69f59ffb7f-7b77k\" (UID: \"78f12462-c4b9-4151-8aa4-e021d251c720\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:40.644462 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.644407 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4ffj\" (UniqueName: \"kubernetes.io/projected/78f12462-c4b9-4151-8aa4-e021d251c720-kube-api-access-j4ffj\") pod \"klusterlet-addon-workmgr-69f59ffb7f-7b77k\" (UID: \"78f12462-c4b9-4151-8aa4-e021d251c720\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:40.644462 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:40.644416 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:12:40.644776 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:40.644500 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls podName:e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0 nodeName:}" failed. No retries permitted until 2026-06-09 14:12:42.644474103 +0000 UTC m=+39.086673315 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls") pod "dns-default-bgsqh" (UID: "e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0") : secret "dns-default-metrics-tls" not found Jun 09 14:12:40.645698 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.645334 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7391550e-7814-448d-a092-2489cb83940c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.645698 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.645395 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78f12462-c4b9-4151-8aa4-e021d251c720-tmp\") pod \"klusterlet-addon-workmgr-69f59ffb7f-7b77k\" (UID: \"78f12462-c4b9-4151-8aa4-e021d251c720\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:40.648509 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.648446 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.648938 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.648916 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-ca\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.649067 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.649043 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-hub\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.649142 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.649064 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7391550e-7814-448d-a092-2489cb83940c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.649142 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.649134 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/78f12462-c4b9-4151-8aa4-e021d251c720-klusterlet-config\") pod \"klusterlet-addon-workmgr-69f59ffb7f-7b77k\" (UID: \"78f12462-c4b9-4151-8aa4-e021d251c720\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:40.649281 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.649258 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ca1399d4-4dee-457b-9a21-a60542d830d2-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh\" (UID: \"ca1399d4-4dee-457b-9a21-a60542d830d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" Jun 09 14:12:40.652308 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.652275 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcff4\" (UniqueName: \"kubernetes.io/projected/ca1399d4-4dee-457b-9a21-a60542d830d2-kube-api-access-rcff4\") pod \"managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh\" (UID: \"ca1399d4-4dee-457b-9a21-a60542d830d2\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" Jun 09 14:12:40.653200 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.653175 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djdv\" (UniqueName: \"kubernetes.io/projected/7391550e-7814-448d-a092-2489cb83940c-kube-api-access-8djdv\") pod \"cluster-proxy-proxy-agent-6dc7cff689-8ps2s\" (UID: \"7391550e-7814-448d-a092-2489cb83940c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.653660 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.653643 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4ffj\" (UniqueName: \"kubernetes.io/projected/78f12462-c4b9-4151-8aa4-e021d251c720-kube-api-access-j4ffj\") pod \"klusterlet-addon-workmgr-69f59ffb7f-7b77k\" (UID: \"78f12462-c4b9-4151-8aa4-e021d251c720\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:40.738286 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.738246 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" Jun 09 14:12:40.745946 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.745914 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:40.761901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.761870 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:12:40.908502 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.908129 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh"] Jun 09 14:12:40.913311 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:40.913282 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca1399d4_4dee_457b_9a21_a60542d830d2.slice/crio-ff33607404135c12de0d95194aeacd4ea32c3ddb8484b220b967e454408cbd22 WatchSource:0}: Error finding container ff33607404135c12de0d95194aeacd4ea32c3ddb8484b220b967e454408cbd22: Status 404 returned error can't find the container with id ff33607404135c12de0d95194aeacd4ea32c3ddb8484b220b967e454408cbd22 Jun 09 14:12:40.925914 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.925883 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k"] Jun 09 14:12:40.928943 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:40.928909 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78f12462_c4b9_4151_8aa4_e021d251c720.slice/crio-6a99404a99cbc229ae435b16b9f932e2d7bae9a2457abd2155c5028d01671cd1 WatchSource:0}: Error finding container 6a99404a99cbc229ae435b16b9f932e2d7bae9a2457abd2155c5028d01671cd1: Status 404 returned error can't find the container with id 6a99404a99cbc229ae435b16b9f932e2d7bae9a2457abd2155c5028d01671cd1 Jun 09 14:12:40.949997 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:40.949964 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s"] Jun 09 14:12:40.953573 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:12:40.953542 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7391550e_7814_448d_a092_2489cb83940c.slice/crio-da154360ccec3f888c8fe26ff0976ffdf0b88b93abd648ba74a5821bfc2f8e57 WatchSource:0}: Error finding container da154360ccec3f888c8fe26ff0976ffdf0b88b93abd648ba74a5821bfc2f8e57: Status 404 returned error can't find the container with id da154360ccec3f888c8fe26ff0976ffdf0b88b93abd648ba74a5821bfc2f8e57 Jun 09 14:12:41.205103 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:41.205068 2572 generic.go:356] "Generic (PLEG): container finished" podID="cca38f39-2d09-446e-95b3-4cf9acdd3fba" containerID="0ebb58a3c15d7535c868fbfe3697e40200be4d447537ab27261cafcea9f7f5be" exitCode=0 Jun 09 14:12:41.205290 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:41.205156 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" event={"ID":"cca38f39-2d09-446e-95b3-4cf9acdd3fba","Type":"ContainerDied","Data":"0ebb58a3c15d7535c868fbfe3697e40200be4d447537ab27261cafcea9f7f5be"} Jun 09 14:12:41.206544 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:41.206518 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" event={"ID":"7391550e-7814-448d-a092-2489cb83940c","Type":"ContainerStarted","Data":"da154360ccec3f888c8fe26ff0976ffdf0b88b93abd648ba74a5821bfc2f8e57"} Jun 09 14:12:41.207790 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:41.207752 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" event={"ID":"78f12462-c4b9-4151-8aa4-e021d251c720","Type":"ContainerStarted","Data":"6a99404a99cbc229ae435b16b9f932e2d7bae9a2457abd2155c5028d01671cd1"} Jun 09 14:12:41.208998 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:41.208976 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n4g6d" event={"ID":"550ca9c4-bb68-4966-86db-fc75333f1114","Type":"ContainerStarted","Data":"d1b526645a7b2910c537fa50f89c7b9d147a7d8d665f3154d98ca8452e709926"} Jun 09 14:12:41.210017 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:41.209997 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" event={"ID":"ca1399d4-4dee-457b-9a21-a60542d830d2","Type":"ContainerStarted","Data":"ff33607404135c12de0d95194aeacd4ea32c3ddb8484b220b967e454408cbd22"} Jun 09 14:12:42.218661 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:42.218625 2572 generic.go:356] "Generic (PLEG): container finished" podID="cca38f39-2d09-446e-95b3-4cf9acdd3fba" containerID="35216499cade9f875229e8cb857b58cf0d9b4c6ccd47126c1f865e05cada32a9" exitCode=0 Jun 09 14:12:42.219499 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:42.218704 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" event={"ID":"cca38f39-2d09-446e-95b3-4cf9acdd3fba","Type":"ContainerDied","Data":"35216499cade9f875229e8cb857b58cf0d9b4c6ccd47126c1f865e05cada32a9"} Jun 09 14:12:42.659790 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:42.659618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:42.659973 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:42.659835 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:12:42.659973 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:42.659906 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls podName:e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0 nodeName:}" failed. No retries permitted until 2026-06-09 14:12:46.659886703 +0000 UTC m=+43.102085891 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls") pod "dns-default-bgsqh" (UID: "e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0") : secret "dns-default-metrics-tls" not found Jun 09 14:12:46.694401 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:46.694358 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:46.694925 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:46.694532 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:12:46.694925 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:46.694602 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls podName:e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0 nodeName:}" failed. No retries permitted until 2026-06-09 14:12:54.694585383 +0000 UTC m=+51.136784555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls") pod "dns-default-bgsqh" (UID: "e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0") : secret "dns-default-metrics-tls" not found Jun 09 14:12:49.238848 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.238806 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" event={"ID":"78f12462-c4b9-4151-8aa4-e021d251c720","Type":"ContainerStarted","Data":"ac9a091e248bb7e178d96de2123beef87bd6cd6b7409f89c1271b60ea2995ac2"} Jun 09 14:12:49.239313 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.239019 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:49.240518 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.240488 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n4g6d" event={"ID":"550ca9c4-bb68-4966-86db-fc75333f1114","Type":"ContainerStarted","Data":"5b11933447350dbad885bf2a41dac5bee8584840a3f1d4cfd254f2def93384d5"} Jun 09 14:12:49.241088 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.241065 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:12:49.242034 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.242012 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" event={"ID":"ca1399d4-4dee-457b-9a21-a60542d830d2","Type":"ContainerStarted","Data":"6cf7793de5317c14145738a9eec81e97fefacf3b94bb96c5d91afb492b7c7b7e"} Jun 09 14:12:49.245081 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.245061 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" event={"ID":"cca38f39-2d09-446e-95b3-4cf9acdd3fba","Type":"ContainerStarted","Data":"0714c7d2ab1150120d85f193b0e433c9a205e750c2e61c44940bbccbbffc59a2"} Jun 09 14:12:49.246899 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.246879 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" event={"ID":"7391550e-7814-448d-a092-2489cb83940c","Type":"ContainerStarted","Data":"cfe09717fd0f51203b989d2e007dd3c0ae95462f545de6196b6b6e6d329cacad"} Jun 09 14:12:49.246968 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.246907 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" event={"ID":"7391550e-7814-448d-a092-2489cb83940c","Type":"ContainerStarted","Data":"61b5d09d1c10572d31cf0444a940437828c61724054b3264766cc0195c2e3530"} Jun 09 14:12:49.246968 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.246919 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" event={"ID":"7391550e-7814-448d-a092-2489cb83940c","Type":"ContainerStarted","Data":"bd513933c8bc434e582dac3f6bffc79e6c05ccd7ea04859d607613e4a9341488"} Jun 09 14:12:49.255043 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.255001 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" podStartSLOduration=1.8847527830000002 podStartE2EDuration="9.254989747s" totalImagesPullingTime="7.370236964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:49.253253985 +0000 UTC m=+45.695453179" watchObservedRunningTime="2026-06-09 14:12:49.254989747 +0000 UTC m=+45.697188941" Jun 09 14:12:49.266921 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.266877 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" podStartSLOduration=1.928545224 podStartE2EDuration="9.266863654s" totalImagesPullingTime="7.33831843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:49.266425693 +0000 UTC m=+45.708624887" watchObservedRunningTime="2026-06-09 14:12:49.266863654 +0000 UTC m=+45.709062925" Jun 09 14:12:49.283202 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.283137 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" podStartSLOduration=1.952780865 podStartE2EDuration="9.283095036s" totalImagesPullingTime="7.330314171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:12:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:49.282577121 +0000 UTC m=+45.724776314" watchObservedRunningTime="2026-06-09 14:12:49.283095036 +0000 UTC m=+45.725294243" Jun 09 14:12:49.296857 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.296821 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n4g6d" podStartSLOduration=3.307206446 podStartE2EDuration="11.29681087s" totalImagesPullingTime="7.989604424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:49.296187316 +0000 UTC m=+45.738386527" watchObservedRunningTime="2026-06-09 14:12:49.29681087 +0000 UTC m=+45.739010042" Jun 09 14:12:49.331469 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:49.331433 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-2x4xx" podStartSLOduration=15.614001019 podStartE2EDuration="45.331419992s" totalImagesPullingTime="29.717418973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:12:49.330076891 +0000 UTC m=+45.772276086" watchObservedRunningTime="2026-06-09 14:12:49.331419992 +0000 UTC m=+45.773619186" Jun 09 14:12:54.749432 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:12:54.749392 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:12:54.749889 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:54.749517 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:12:54.749889 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:12:54.749577 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls podName:e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0 nodeName:}" failed. No retries permitted until 2026-06-09 14:13:10.749560313 +0000 UTC m=+67.191759485 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls") pod "dns-default-bgsqh" (UID: "e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0") : secret "dns-default-metrics-tls" not found Jun 09 14:13:05.205122 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:05.205075 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fc7n9" Jun 09 14:13:09.750907 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:09.750849 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:13:09.751397 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:09.750949 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:13:09.753301 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:09.753282 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 14:13:09.753351 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:09.753325 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 14:13:09.761312 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:13:09.761292 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 14:13:09.761367 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:13:09.761353 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs podName:02bc8053-f2b2-4d78-b65d-573a14482c57 nodeName:}" failed. No retries permitted until 2026-06-09 14:14:13.761335459 +0000 UTC m=+130.203534643 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs") pod "network-metrics-daemon-nhcwv" (UID: "02bc8053-f2b2-4d78-b65d-573a14482c57") : secret "metrics-daemon-secret" not found Jun 09 14:13:09.763681 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:09.763661 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/b9a106a4-e64e-494f-8759-ae6dfe56384f-original-pull-secret\") pod \"global-pull-secret-syncer-vzbm9\" (UID: \"b9a106a4-e64e-494f-8759-ae6dfe56384f\") " pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:13:09.947221 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:09.947173 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vzbm9" Jun 09 14:13:09.952481 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:09.952456 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzpx7\" (UniqueName: \"kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7\") pod \"network-check-target-26vrm\" (UID: \"6b4404c8-360b-4043-9d51-9505f09b90ee\") " pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:13:09.955041 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:09.955021 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 14:13:09.965916 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:09.965890 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 14:13:09.976003 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:09.975976 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzpx7\" (UniqueName: \"kubernetes.io/projected/6b4404c8-360b-4043-9d51-9505f09b90ee-kube-api-access-wzpx7\") pod \"network-check-target-26vrm\" (UID: \"6b4404c8-360b-4043-9d51-9505f09b90ee\") " pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:13:10.071469 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:10.071428 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vzbm9"] Jun 09 14:13:10.075009 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:13:10.074987 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9a106a4_e64e_494f_8759_ae6dfe56384f.slice/crio-d3c5df1e8062ad4c3d4b31833dd8044d661f2d934e2829b7fc2a40f6ae858e1c WatchSource:0}: Error finding container d3c5df1e8062ad4c3d4b31833dd8044d661f2d934e2829b7fc2a40f6ae858e1c: Status 404 returned error can't find the container with id d3c5df1e8062ad4c3d4b31833dd8044d661f2d934e2829b7fc2a40f6ae858e1c Jun 09 14:13:10.255956 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:10.255922 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hlvfh\"" Jun 09 14:13:10.263986 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:10.263956 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:13:10.315961 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:10.315925 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vzbm9" event={"ID":"b9a106a4-e64e-494f-8759-ae6dfe56384f","Type":"ContainerStarted","Data":"d3c5df1e8062ad4c3d4b31833dd8044d661f2d934e2829b7fc2a40f6ae858e1c"} Jun 09 14:13:10.384335 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:10.384296 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-26vrm"] Jun 09 14:13:10.387998 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:13:10.387971 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4404c8_360b_4043_9d51_9505f09b90ee.slice/crio-5825f605cf8ffe62b8d043c03685094689cf8f0d08778d0bff318596db73040c WatchSource:0}: Error finding container 5825f605cf8ffe62b8d043c03685094689cf8f0d08778d0bff318596db73040c: Status 404 returned error can't find the container with id 5825f605cf8ffe62b8d043c03685094689cf8f0d08778d0bff318596db73040c Jun 09 14:13:10.760301 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:10.760264 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:13:10.760708 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:13:10.760441 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:13:10.760708 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:13:10.760512 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls podName:e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0 nodeName:}" failed. No retries permitted until 2026-06-09 14:13:42.760496042 +0000 UTC m=+99.202695214 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls") pod "dns-default-bgsqh" (UID: "e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0") : secret "dns-default-metrics-tls" not found Jun 09 14:13:11.321074 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:11.321029 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26vrm" event={"ID":"6b4404c8-360b-4043-9d51-9505f09b90ee","Type":"ContainerStarted","Data":"5825f605cf8ffe62b8d043c03685094689cf8f0d08778d0bff318596db73040c"} Jun 09 14:13:15.339592 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:15.339547 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vzbm9" event={"ID":"b9a106a4-e64e-494f-8759-ae6dfe56384f","Type":"ContainerStarted","Data":"81b5b4a1b6f53dd7c275b0b037a742b8a9a84a5e6b4e0e628b579767b17d85c6"} Jun 09 14:13:15.341059 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:15.341031 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-26vrm" event={"ID":"6b4404c8-360b-4043-9d51-9505f09b90ee","Type":"ContainerStarted","Data":"56a292d715310764f51db2141fcd84321c579891f501bd048d07295900aa8b2d"} Jun 09 14:13:15.341179 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:15.341164 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:13:15.354201 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:15.354150 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vzbm9" podStartSLOduration=66.821246408 podStartE2EDuration="1m11.354134945s" totalImagesPullingTime="4.532888537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:13:15.353211102 +0000 UTC m=+71.795410298" watchObservedRunningTime="2026-06-09 14:13:15.354134945 +0000 UTC m=+71.796334133" Jun 09 14:13:15.366933 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:15.366893 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-26vrm" podStartSLOduration=67.150683195 podStartE2EDuration="1m11.366877483s" totalImagesPullingTime="4.216194288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:13:15.36679874 +0000 UTC m=+71.808997935" watchObservedRunningTime="2026-06-09 14:13:15.366877483 +0000 UTC m=+71.809076678" Jun 09 14:13:42.783920 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:42.783874 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:13:42.784523 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:13:42.784041 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:13:42.784523 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:13:42.784136 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls podName:e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0 nodeName:}" failed. No retries permitted until 2026-06-09 14:14:46.784099206 +0000 UTC m=+163.226298379 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls") pod "dns-default-bgsqh" (UID: "e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0") : secret "dns-default-metrics-tls" not found Jun 09 14:13:46.346800 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:13:46.346763 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-26vrm" Jun 09 14:14:13.809995 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:13.809951 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:14:13.810530 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:14:13.810092 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 14:14:13.810530 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:14:13.810182 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs podName:02bc8053-f2b2-4d78-b65d-573a14482c57 nodeName:}" failed. No retries permitted until 2026-06-09 14:16:15.810166836 +0000 UTC m=+252.252366021 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs") pod "network-metrics-daemon-nhcwv" (UID: "02bc8053-f2b2-4d78-b65d-573a14482c57") : secret "metrics-daemon-secret" not found Jun 09 14:14:41.897486 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:14:41.897383 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bgsqh" podUID="e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0" Jun 09 14:14:42.039478 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:14:42.039442 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nhcwv" podUID="02bc8053-f2b2-4d78-b65d-573a14482c57" Jun 09 14:14:42.593726 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:42.593691 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgsqh" Jun 09 14:14:46.847368 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:46.847329 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:14:46.847952 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:14:46.847508 2572 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 14:14:46.847952 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:14:46.847601 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls podName:e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0 nodeName:}" failed. No retries permitted until 2026-06-09 14:16:48.847579557 +0000 UTC m=+285.289778739 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls") pod "dns-default-bgsqh" (UID: "e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0") : secret "dns-default-metrics-tls" not found Jun 09 14:14:48.613843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:48.613809 2572 generic.go:356] "Generic (PLEG): container finished" podID="78f12462-c4b9-4151-8aa4-e021d251c720" containerID="ac9a091e248bb7e178d96de2123beef87bd6cd6b7409f89c1271b60ea2995ac2" exitCode=1 Jun 09 14:14:48.614305 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:48.613883 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" event={"ID":"78f12462-c4b9-4151-8aa4-e021d251c720","Type":"ContainerDied","Data":"ac9a091e248bb7e178d96de2123beef87bd6cd6b7409f89c1271b60ea2995ac2"} Jun 09 14:14:48.614305 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:48.614264 2572 scope.go:117] "RemoveContainer" containerID="ac9a091e248bb7e178d96de2123beef87bd6cd6b7409f89c1271b60ea2995ac2" Jun 09 14:14:48.615374 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:48.615347 2572 generic.go:356] "Generic (PLEG): container finished" podID="ca1399d4-4dee-457b-9a21-a60542d830d2" containerID="6cf7793de5317c14145738a9eec81e97fefacf3b94bb96c5d91afb492b7c7b7e" exitCode=255 Jun 09 14:14:48.615488 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:48.615392 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" event={"ID":"ca1399d4-4dee-457b-9a21-a60542d830d2","Type":"ContainerDied","Data":"6cf7793de5317c14145738a9eec81e97fefacf3b94bb96c5d91afb492b7c7b7e"} Jun 09 14:14:48.615654 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:48.615642 2572 scope.go:117] "RemoveContainer" containerID="6cf7793de5317c14145738a9eec81e97fefacf3b94bb96c5d91afb492b7c7b7e" Jun 09 14:14:49.239507 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:49.239468 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:14:49.619997 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:49.619912 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" event={"ID":"ca1399d4-4dee-457b-9a21-a60542d830d2","Type":"ContainerStarted","Data":"980183df30f067e2abfd1ab8822c8bf14a588062a5d67d4b755819467eceabd8"} Jun 09 14:14:49.621481 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:49.621459 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" event={"ID":"78f12462-c4b9-4151-8aa4-e021d251c720","Type":"ContainerStarted","Data":"4e0cfc147b122cfde2d475b12fe5a42c7f4ca372a2fabd38ee840334af18f638"} Jun 09 14:14:49.621655 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:49.621642 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:14:49.622280 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:49.622263 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:14:53.026745 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:14:53.026691 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:15:58.632726 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.632695 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6qlj7_c0fe143e-02b1-4866-a4bd-a271ef19ec97/dns-node-resolver/0.log" Jun 09 14:15:58.681062 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.681016 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jcdzw"] Jun 09 14:15:58.683275 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.683255 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.685603 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.685576 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 14:15:58.686479 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.686452 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 14:15:58.686479 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.686466 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7cblk\"" Jun 09 14:15:58.686479 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.686482 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 14:15:58.686479 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.686500 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 14:15:58.694541 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.694514 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jcdzw"] Jun 09 14:15:58.872708 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.872670 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fff11e01-5d1e-44dd-99d4-650e1c39e5df-data-volume\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.872887 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.872742 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.872887 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.872778 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljqb5\" (UniqueName: \"kubernetes.io/projected/fff11e01-5d1e-44dd-99d4-650e1c39e5df-kube-api-access-ljqb5\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.872887 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.872849 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fff11e01-5d1e-44dd-99d4-650e1c39e5df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.872887 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.872872 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fff11e01-5d1e-44dd-99d4-650e1c39e5df-crio-socket\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.973371 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.973337 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fff11e01-5d1e-44dd-99d4-650e1c39e5df-data-volume\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.973585 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.973397 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.973585 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.973425 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljqb5\" (UniqueName: \"kubernetes.io/projected/fff11e01-5d1e-44dd-99d4-650e1c39e5df-kube-api-access-ljqb5\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.973585 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.973466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fff11e01-5d1e-44dd-99d4-650e1c39e5df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.973585 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.973494 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fff11e01-5d1e-44dd-99d4-650e1c39e5df-crio-socket\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.973870 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:15:58.973591 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 14:15:58.973870 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.973608 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fff11e01-5d1e-44dd-99d4-650e1c39e5df-crio-socket\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.973870 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:15:58.973677 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls podName:fff11e01-5d1e-44dd-99d4-650e1c39e5df nodeName:}" failed. No retries permitted until 2026-06-09 14:15:59.473653674 +0000 UTC m=+235.915852849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jcdzw" (UID: "fff11e01-5d1e-44dd-99d4-650e1c39e5df") : secret "insights-runtime-extractor-tls" not found Jun 09 14:15:58.973870 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.973745 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fff11e01-5d1e-44dd-99d4-650e1c39e5df-data-volume\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.974027 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.973958 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fff11e01-5d1e-44dd-99d4-650e1c39e5df-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:58.983789 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:58.983756 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljqb5\" (UniqueName: \"kubernetes.io/projected/fff11e01-5d1e-44dd-99d4-650e1c39e5df-kube-api-access-ljqb5\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:59.477447 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:59.477387 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:15:59.477644 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:15:59.477514 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 14:15:59.477644 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:15:59.477570 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls podName:fff11e01-5d1e-44dd-99d4-650e1c39e5df nodeName:}" failed. No retries permitted until 2026-06-09 14:16:00.477554351 +0000 UTC m=+236.919753524 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jcdzw" (UID: "fff11e01-5d1e-44dd-99d4-650e1c39e5df") : secret "insights-runtime-extractor-tls" not found Jun 09 14:15:59.830142 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:15:59.830035 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqjzs_10f9c799-543d-4af0-81b4-3457e301f3bb/node-ca/0.log" Jun 09 14:16:00.484657 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:00.484616 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:16:00.484840 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:00.484762 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 14:16:00.484840 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:00.484830 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls podName:fff11e01-5d1e-44dd-99d4-650e1c39e5df nodeName:}" failed. No retries permitted until 2026-06-09 14:16:02.484815047 +0000 UTC m=+238.927014219 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jcdzw" (UID: "fff11e01-5d1e-44dd-99d4-650e1c39e5df") : secret "insights-runtime-extractor-tls" not found Jun 09 14:16:00.631194 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:00.631157 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n4g6d_550ca9c4-bb68-4966-86db-fc75333f1114/serve-healthcheck-canary/0.log" Jun 09 14:16:02.499537 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:02.499495 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:16:02.499951 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:02.499635 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 14:16:02.499951 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:02.499710 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls podName:fff11e01-5d1e-44dd-99d4-650e1c39e5df nodeName:}" failed. No retries permitted until 2026-06-09 14:16:06.499693983 +0000 UTC m=+242.941893155 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jcdzw" (UID: "fff11e01-5d1e-44dd-99d4-650e1c39e5df") : secret "insights-runtime-extractor-tls" not found Jun 09 14:16:06.527577 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:06.527530 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:16:06.528004 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:06.527652 2572 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 09 14:16:06.528004 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:06.527717 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls podName:fff11e01-5d1e-44dd-99d4-650e1c39e5df nodeName:}" failed. No retries permitted until 2026-06-09 14:16:14.527701626 +0000 UTC m=+250.969900799 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jcdzw" (UID: "fff11e01-5d1e-44dd-99d4-650e1c39e5df") : secret "insights-runtime-extractor-tls" not found Jun 09 14:16:10.763834 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:10.763788 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" podUID="7391550e-7814-448d-a092-2489cb83940c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 14:16:14.582284 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:14.582240 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:16:14.584925 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:14.584892 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fff11e01-5d1e-44dd-99d4-650e1c39e5df-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jcdzw\" (UID: \"fff11e01-5d1e-44dd-99d4-650e1c39e5df\") " pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:16:14.595565 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:14.595533 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7cblk\"" Jun 09 14:16:14.603608 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:14.603580 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jcdzw" Jun 09 14:16:14.732142 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:14.732095 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jcdzw"] Jun 09 14:16:14.735737 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:16:14.735708 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfff11e01_5d1e_44dd_99d4_650e1c39e5df.slice/crio-ddd46b3fc7dad41f16f733b8a8aaa60dfec6efca2bb35c502e09e31d96af0acf WatchSource:0}: Error finding container ddd46b3fc7dad41f16f733b8a8aaa60dfec6efca2bb35c502e09e31d96af0acf: Status 404 returned error can't find the container with id ddd46b3fc7dad41f16f733b8a8aaa60dfec6efca2bb35c502e09e31d96af0acf Jun 09 14:16:14.878173 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:14.878064 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jcdzw" event={"ID":"fff11e01-5d1e-44dd-99d4-650e1c39e5df","Type":"ContainerStarted","Data":"4bc42302aed6db8da86f47ecbb3fd93d8d664249f1b7dad660189e389ed1a2b9"} Jun 09 14:16:14.878173 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:14.878140 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jcdzw" event={"ID":"fff11e01-5d1e-44dd-99d4-650e1c39e5df","Type":"ContainerStarted","Data":"ddd46b3fc7dad41f16f733b8a8aaa60dfec6efca2bb35c502e09e31d96af0acf"} Jun 09 14:16:15.884703 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:15.884666 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jcdzw" event={"ID":"fff11e01-5d1e-44dd-99d4-650e1c39e5df","Type":"ContainerStarted","Data":"685bfe2eeb9328625c0ded69470aa51fb692ffedd66aa657c229300a130d1c9e"} Jun 09 14:16:15.893304 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:15.893258 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:16:15.896057 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:15.896023 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02bc8053-f2b2-4d78-b65d-573a14482c57-metrics-certs\") pod \"network-metrics-daemon-nhcwv\" (UID: \"02bc8053-f2b2-4d78-b65d-573a14482c57\") " pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:16:16.130655 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:16.130617 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xvhx5\"" Jun 09 14:16:16.137739 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:16.137658 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nhcwv" Jun 09 14:16:16.284087 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:16.284041 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nhcwv"] Jun 09 14:16:16.731351 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:16:16.731315 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bc8053_f2b2_4d78_b65d_573a14482c57.slice/crio-c7e84d93392f816361c3f17500c24b60c7d516d640673d2d24d739b0ac87125d WatchSource:0}: Error finding container c7e84d93392f816361c3f17500c24b60c7d516d640673d2d24d739b0ac87125d: Status 404 returned error can't find the container with id c7e84d93392f816361c3f17500c24b60c7d516d640673d2d24d739b0ac87125d Jun 09 14:16:16.889688 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:16.889650 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jcdzw" event={"ID":"fff11e01-5d1e-44dd-99d4-650e1c39e5df","Type":"ContainerStarted","Data":"d256b2856500806833ba3cb2d2caeb2d132eb945386c0b645d14d60df1d48618"} Jun 09 14:16:16.890781 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:16.890760 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nhcwv" event={"ID":"02bc8053-f2b2-4d78-b65d-573a14482c57","Type":"ContainerStarted","Data":"c7e84d93392f816361c3f17500c24b60c7d516d640673d2d24d739b0ac87125d"} Jun 09 14:16:16.909920 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:16.909859 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jcdzw" podStartSLOduration=16.994267242 podStartE2EDuration="18.909843338s" totalImagesPullingTime="1.915576096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:15:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:16:16.909302144 +0000 UTC m=+253.351501364" watchObservedRunningTime="2026-06-09 14:16:16.909843338 +0000 UTC m=+253.352042532" Jun 09 14:16:17.895781 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:17.895686 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nhcwv" event={"ID":"02bc8053-f2b2-4d78-b65d-573a14482c57","Type":"ContainerStarted","Data":"49da3281b96f6a54bf740c7482e4c00eaf25449592b28a56f3517efc6182db6e"} Jun 09 14:16:17.895781 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:17.895775 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nhcwv" event={"ID":"02bc8053-f2b2-4d78-b65d-573a14482c57","Type":"ContainerStarted","Data":"7948f981f2316c0d7effeaf951e05ae794b2f97fad4dece2c00790db9e2bc269"} Jun 09 14:16:17.911678 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:17.911631 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nhcwv" podStartSLOduration=253.063850913 podStartE2EDuration="4m13.911614621s" totalImagesPullingTime="847.763708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:12:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:16:17.910274296 +0000 UTC m=+254.352473504" watchObservedRunningTime="2026-06-09 14:16:17.911614621 +0000 UTC m=+254.353813815" Jun 09 14:16:20.763680 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:20.763643 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" podUID="7391550e-7814-448d-a092-2489cb83940c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 14:16:30.763628 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:30.763582 2572 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" podUID="7391550e-7814-448d-a092-2489cb83940c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 09 14:16:30.764138 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:30.763658 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" Jun 09 14:16:30.764243 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:30.764211 2572 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"cfe09717fd0f51203b989d2e007dd3c0ae95462f545de6196b6b6e6d329cacad"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 09 14:16:30.764288 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:30.764269 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" podUID="7391550e-7814-448d-a092-2489cb83940c" containerName="service-proxy" containerID="cri-o://cfe09717fd0f51203b989d2e007dd3c0ae95462f545de6196b6b6e6d329cacad" gracePeriod=30 Jun 09 14:16:30.938213 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:30.938180 2572 generic.go:356] "Generic (PLEG): container finished" podID="7391550e-7814-448d-a092-2489cb83940c" containerID="cfe09717fd0f51203b989d2e007dd3c0ae95462f545de6196b6b6e6d329cacad" exitCode=2 Jun 09 14:16:30.938374 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:30.938236 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" event={"ID":"7391550e-7814-448d-a092-2489cb83940c","Type":"ContainerDied","Data":"cfe09717fd0f51203b989d2e007dd3c0ae95462f545de6196b6b6e6d329cacad"} Jun 09 14:16:30.938374 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:30.938272 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6dc7cff689-8ps2s" event={"ID":"7391550e-7814-448d-a092-2489cb83940c","Type":"ContainerStarted","Data":"ac3344c90cb24b471f945043f585ddd1758b9e221288b937a8fb6416e5b414e8"} Jun 09 14:16:35.701847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.701817 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jc6sm"] Jun 09 14:16:35.709312 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.709289 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.711617 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.711593 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 14:16:35.712356 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.712333 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 14:16:35.712656 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.712638 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 14:16:35.712720 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.712708 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 14:16:35.712783 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.712730 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 14:16:35.712783 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.712731 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 14:16:35.712783 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.712735 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fjqn6\"" Jun 09 14:16:35.836555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.836513 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrzns\" (UniqueName: \"kubernetes.io/projected/4ec412d0-d8df-49a4-aac4-93a70a1791c2-kube-api-access-lrzns\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.836740 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.836564 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-tls\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.836740 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.836614 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.836740 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.836688 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ec412d0-d8df-49a4-aac4-93a70a1791c2-sys\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.836740 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.836711 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-wtmp\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.836944 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.836741 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ec412d0-d8df-49a4-aac4-93a70a1791c2-metrics-client-ca\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.836944 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.836812 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ec412d0-d8df-49a4-aac4-93a70a1791c2-root\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.836944 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.836846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-textfile\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.836944 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.836878 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937411 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937370 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ec412d0-d8df-49a4-aac4-93a70a1791c2-sys\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937411 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937412 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-wtmp\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937679 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937432 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ec412d0-d8df-49a4-aac4-93a70a1791c2-metrics-client-ca\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937679 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ec412d0-d8df-49a4-aac4-93a70a1791c2-root\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937679 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937486 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-textfile\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937679 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937481 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4ec412d0-d8df-49a4-aac4-93a70a1791c2-sys\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937679 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937518 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4ec412d0-d8df-49a4-aac4-93a70a1791c2-root\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937679 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937559 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937679 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937583 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-wtmp\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937679 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937612 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrzns\" (UniqueName: \"kubernetes.io/projected/4ec412d0-d8df-49a4-aac4-93a70a1791c2-kube-api-access-lrzns\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937679 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937642 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-tls\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.937679 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937664 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.938202 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.937834 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-textfile\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.938202 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.938031 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ec412d0-d8df-49a4-aac4-93a70a1791c2-metrics-client-ca\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.938202 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.938170 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-accelerators-collector-config\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.939827 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.939810 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.940035 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.940018 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4ec412d0-d8df-49a4-aac4-93a70a1791c2-node-exporter-tls\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:35.946156 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:35.946135 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrzns\" (UniqueName: \"kubernetes.io/projected/4ec412d0-d8df-49a4-aac4-93a70a1791c2-kube-api-access-lrzns\") pod \"node-exporter-jc6sm\" (UID: \"4ec412d0-d8df-49a4-aac4-93a70a1791c2\") " pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:36.018216 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:36.018124 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jc6sm" Jun 09 14:16:36.028157 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:16:36.028128 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ec412d0_d8df_49a4_aac4_93a70a1791c2.slice/crio-b3081cd9afc4cc585dae685d7573679b7bb84db964fe7a7b89301ddd6f9343b0 WatchSource:0}: Error finding container b3081cd9afc4cc585dae685d7573679b7bb84db964fe7a7b89301ddd6f9343b0: Status 404 returned error can't find the container with id b3081cd9afc4cc585dae685d7573679b7bb84db964fe7a7b89301ddd6f9343b0 Jun 09 14:16:36.960533 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:36.960478 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jc6sm" event={"ID":"4ec412d0-d8df-49a4-aac4-93a70a1791c2","Type":"ContainerStarted","Data":"b1bcb688e9430513af741b1d218627bd84a49381dc79d0b35016b29778d6abc8"} Jun 09 14:16:36.960843 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:36.960538 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jc6sm" event={"ID":"4ec412d0-d8df-49a4-aac4-93a70a1791c2","Type":"ContainerStarted","Data":"b3081cd9afc4cc585dae685d7573679b7bb84db964fe7a7b89301ddd6f9343b0"} Jun 09 14:16:37.965290 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:37.965258 2572 generic.go:356] "Generic (PLEG): container finished" podID="4ec412d0-d8df-49a4-aac4-93a70a1791c2" containerID="b1bcb688e9430513af741b1d218627bd84a49381dc79d0b35016b29778d6abc8" exitCode=0 Jun 09 14:16:37.965670 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:37.965333 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jc6sm" event={"ID":"4ec412d0-d8df-49a4-aac4-93a70a1791c2","Type":"ContainerDied","Data":"b1bcb688e9430513af741b1d218627bd84a49381dc79d0b35016b29778d6abc8"} Jun 09 14:16:38.970077 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:38.970043 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jc6sm" event={"ID":"4ec412d0-d8df-49a4-aac4-93a70a1791c2","Type":"ContainerStarted","Data":"7e4c05b167c4ece9fd12368f73487dd225b423b22888bd70903e1be5f61108cf"} Jun 09 14:16:38.970477 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:38.970160 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jc6sm" event={"ID":"4ec412d0-d8df-49a4-aac4-93a70a1791c2","Type":"ContainerStarted","Data":"6e36acc555f09cf0bb48b79781a508989df9feeae64ea4a51de895c0ccd91fb1"} Jun 09 14:16:39.960359 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:39.960308 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jc6sm" podStartSLOduration=4.090932645 podStartE2EDuration="4.960290547s" totalImagesPullingTime="804.659095ms" totalInitContainerRuntime="64.698807ms" isStatefulPod=true podCreationTimestamp="2026-06-09 14:16:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:16:38.989514522 +0000 UTC m=+275.431713716" watchObservedRunningTime="2026-06-09 14:16:39.960290547 +0000 UTC m=+276.402489741" Jun 09 14:16:39.960638 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:39.960623 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7d7f496f9c-d52hb"] Jun 09 14:16:39.962868 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:39.962853 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:39.966984 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:39.966965 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 14:16:39.969928 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:39.969907 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 14:16:39.970054 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:39.969954 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 14:16:39.970054 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:39.969952 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 14:16:39.970054 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:39.970017 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-7haocbqaj1br6\"" Jun 09 14:16:39.970054 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:39.969952 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-dnv4k\"" Jun 09 14:16:40.007608 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.007573 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7f496f9c-d52hb"] Jun 09 14:16:40.073382 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.073342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03da0534-ef50-4227-8e3e-4360a236b262-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.073382 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.073390 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03da0534-ef50-4227-8e3e-4360a236b262-client-ca-bundle\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.073611 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.073408 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/03da0534-ef50-4227-8e3e-4360a236b262-metrics-server-audit-profiles\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.073611 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.073495 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/03da0534-ef50-4227-8e3e-4360a236b262-secret-metrics-server-client-certs\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.073611 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.073544 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/03da0534-ef50-4227-8e3e-4360a236b262-secret-metrics-server-tls\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.073611 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.073586 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x7gs\" (UniqueName: \"kubernetes.io/projected/03da0534-ef50-4227-8e3e-4360a236b262-kube-api-access-6x7gs\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.073611 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.073611 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/03da0534-ef50-4227-8e3e-4360a236b262-audit-log\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.174652 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.174614 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/03da0534-ef50-4227-8e3e-4360a236b262-secret-metrics-server-client-certs\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.174744 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.174666 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/03da0534-ef50-4227-8e3e-4360a236b262-secret-metrics-server-tls\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.174744 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.174691 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x7gs\" (UniqueName: \"kubernetes.io/projected/03da0534-ef50-4227-8e3e-4360a236b262-kube-api-access-6x7gs\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.174744 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.174712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/03da0534-ef50-4227-8e3e-4360a236b262-audit-log\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.174744 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.174731 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03da0534-ef50-4227-8e3e-4360a236b262-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.174939 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.174755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03da0534-ef50-4227-8e3e-4360a236b262-client-ca-bundle\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.174939 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.174774 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/03da0534-ef50-4227-8e3e-4360a236b262-metrics-server-audit-profiles\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.175279 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.175250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/03da0534-ef50-4227-8e3e-4360a236b262-audit-log\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.175718 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.175693 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03da0534-ef50-4227-8e3e-4360a236b262-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.175827 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.175762 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/03da0534-ef50-4227-8e3e-4360a236b262-metrics-server-audit-profiles\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.177174 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.177143 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/03da0534-ef50-4227-8e3e-4360a236b262-secret-metrics-server-client-certs\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.177285 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.177201 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/03da0534-ef50-4227-8e3e-4360a236b262-secret-metrics-server-tls\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.177342 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.177289 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/03da0534-ef50-4227-8e3e-4360a236b262-client-ca-bundle\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.182558 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.182533 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x7gs\" (UniqueName: \"kubernetes.io/projected/03da0534-ef50-4227-8e3e-4360a236b262-kube-api-access-6x7gs\") pod \"metrics-server-7d7f496f9c-d52hb\" (UID: \"03da0534-ef50-4227-8e3e-4360a236b262\") " pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.271608 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.271513 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:16:40.405482 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.405450 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7d7f496f9c-d52hb"] Jun 09 14:16:40.407863 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:16:40.407837 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03da0534_ef50_4227_8e3e_4360a236b262.slice/crio-b8ddeb03483fbfc20133440783c4b8b6338dfe223dca6b8747fc1344f17465a8 WatchSource:0}: Error finding container b8ddeb03483fbfc20133440783c4b8b6338dfe223dca6b8747fc1344f17465a8: Status 404 returned error can't find the container with id b8ddeb03483fbfc20133440783c4b8b6338dfe223dca6b8747fc1344f17465a8 Jun 09 14:16:40.977515 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:40.977478 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" event={"ID":"03da0534-ef50-4227-8e3e-4360a236b262","Type":"ContainerStarted","Data":"b8ddeb03483fbfc20133440783c4b8b6338dfe223dca6b8747fc1344f17465a8"} Jun 09 14:16:41.820226 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.820193 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:16:41.823126 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.823082 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.825938 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.825883 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 14:16:41.826098 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.825976 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 14:16:41.826098 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.826072 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 14:16:41.826234 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.826139 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 14:16:41.826396 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.826378 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3e01bg48j37ei\"" Jun 09 14:16:41.826459 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.826399 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 14:16:41.826459 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.826411 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 14:16:41.826959 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.826902 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 14:16:41.826959 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.826921 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 14:16:41.827287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.827269 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 14:16:41.827369 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.827304 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 14:16:41.827944 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.827924 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pstfz\"" Jun 09 14:16:41.829061 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.829037 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 14:16:41.829061 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.829057 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 14:16:41.830349 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.830333 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 14:16:41.833867 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.833763 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 14:16:41.840302 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.840233 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:16:41.890799 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.890765 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.890799 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.890810 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfddd949-cc38-4858-8661-fdfbcd3e1b09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891028 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.890850 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcnjr\" (UniqueName: \"kubernetes.io/projected/cfddd949-cc38-4858-8661-fdfbcd3e1b09-kube-api-access-mcnjr\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891028 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.890873 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-config\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891028 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.890894 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891028 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.890953 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891028 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.890999 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891257 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891033 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891257 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891064 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfddd949-cc38-4858-8661-fdfbcd3e1b09-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891257 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891084 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891257 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891122 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891257 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891194 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891257 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891230 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891506 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891269 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891506 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891297 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891506 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891342 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891506 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891359 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891506 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891389 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891506 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891411 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.891506 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.891432 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.992708 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.992683 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.993090 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.992725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.993090 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.992753 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.993090 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.992782 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.993090 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.992805 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.993090 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.992844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.993090 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.992868 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.993090 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.992900 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.994024 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.993539 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.994148 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.994086 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.994148 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.994092 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.994266 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.994174 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.994315 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.994297 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.994366 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.994294 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.994417 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.994370 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfddd949-cc38-4858-8661-fdfbcd3e1b09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.996212 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.994542 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcnjr\" (UniqueName: \"kubernetes.io/projected/cfddd949-cc38-4858-8661-fdfbcd3e1b09-kube-api-access-mcnjr\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.996212 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.994667 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-config\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.996212 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.994696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.996212 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.994828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.996212 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.995012 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.996212 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.995084 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.996212 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.995165 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfddd949-cc38-4858-8661-fdfbcd3e1b09-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.996212 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.995248 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.996645 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.996370 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.998550 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.996979 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.998550 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.997159 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.998550 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.997801 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.998773 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.998687 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.999330 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.999262 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-web-config\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:41.999535 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:41.995951 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.001067 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.000273 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.001067 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.000983 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/cfddd949-cc38-4858-8661-fdfbcd3e1b09-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.001434 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.001333 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/cfddd949-cc38-4858-8661-fdfbcd3e1b09-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.003086 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.002141 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.003086 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.002758 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/cfddd949-cc38-4858-8661-fdfbcd3e1b09-config-out\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.003832 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.003780 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-config\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.004426 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.004378 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.005033 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.004719 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.005410 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.005366 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/cfddd949-cc38-4858-8661-fdfbcd3e1b09-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.006072 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.006053 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcnjr\" (UniqueName: \"kubernetes.io/projected/cfddd949-cc38-4858-8661-fdfbcd3e1b09-kube-api-access-mcnjr\") pod \"prometheus-k8s-0\" (UID: \"cfddd949-cc38-4858-8661-fdfbcd3e1b09\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.136308 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.136199 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:16:42.273807 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.273776 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 14:16:42.276549 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:16:42.276520 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfddd949_cc38_4858_8661_fdfbcd3e1b09.slice/crio-c0f80b200991881f01b6a947c1ed70bf1bbf24a7ffb46c330f20cb6aaf1eb6ea WatchSource:0}: Error finding container c0f80b200991881f01b6a947c1ed70bf1bbf24a7ffb46c330f20cb6aaf1eb6ea: Status 404 returned error can't find the container with id c0f80b200991881f01b6a947c1ed70bf1bbf24a7ffb46c330f20cb6aaf1eb6ea Jun 09 14:16:42.986309 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.986278 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfddd949-cc38-4858-8661-fdfbcd3e1b09","Type":"ContainerStarted","Data":"c0f80b200991881f01b6a947c1ed70bf1bbf24a7ffb46c330f20cb6aaf1eb6ea"} Jun 09 14:16:42.988153 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:42.988101 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" event={"ID":"03da0534-ef50-4227-8e3e-4360a236b262","Type":"ContainerStarted","Data":"e950c2e894f9397af17ea2295f4e3cecc7dcf7fbb62fb64af4b1cc354798a758"} Jun 09 14:16:43.004573 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:43.004513 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" podStartSLOduration=2.425552649 podStartE2EDuration="4.004491962s" totalImagesPullingTime="1.578939313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:16:43.003239447 +0000 UTC m=+279.445438641" watchObservedRunningTime="2026-06-09 14:16:43.004491962 +0000 UTC m=+279.446691155" Jun 09 14:16:43.993365 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:43.993329 2572 generic.go:356] "Generic (PLEG): container finished" podID="cfddd949-cc38-4858-8661-fdfbcd3e1b09" containerID="666d31bcebf05cb577b8dcc2b6094698e549b5433b3bf99c4dd8f3dbff1c90c6" exitCode=0 Jun 09 14:16:43.993514 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:43.993419 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfddd949-cc38-4858-8661-fdfbcd3e1b09","Type":"ContainerDied","Data":"666d31bcebf05cb577b8dcc2b6094698e549b5433b3bf99c4dd8f3dbff1c90c6"} Jun 09 14:16:45.595266 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:45.595212 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-bgsqh" podUID="e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0" Jun 09 14:16:46.004868 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:46.004836 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgsqh" Jun 09 14:16:47.012539 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:47.012436 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfddd949-cc38-4858-8661-fdfbcd3e1b09","Type":"ContainerStarted","Data":"421888fe669693c3f6d09ac836333129e5aee1a9fd4e4c4e1de807e8f913e8be"} Jun 09 14:16:47.012539 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:47.012533 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfddd949-cc38-4858-8661-fdfbcd3e1b09","Type":"ContainerStarted","Data":"ad4e55c4bc766ae30b26bfb18885c6748ced4f0d8826fe58c16e8b8bc928c22b"} Jun 09 14:16:48.861154 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:48.861101 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:16:48.863355 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:48.863327 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0-metrics-tls\") pod \"dns-default-bgsqh\" (UID: \"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0\") " pod="openshift-dns/dns-default-bgsqh" Jun 09 14:16:49.008272 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.008235 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-55pg5\"" Jun 09 14:16:49.017086 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.017055 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bgsqh" Jun 09 14:16:49.022017 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.021991 2572 generic.go:356] "Generic (PLEG): container finished" podID="78f12462-c4b9-4151-8aa4-e021d251c720" containerID="4e0cfc147b122cfde2d475b12fe5a42c7f4ca372a2fabd38ee840334af18f638" exitCode=1 Jun 09 14:16:49.022148 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.022070 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" event={"ID":"78f12462-c4b9-4151-8aa4-e021d251c720","Type":"ContainerDied","Data":"4e0cfc147b122cfde2d475b12fe5a42c7f4ca372a2fabd38ee840334af18f638"} Jun 09 14:16:49.022202 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.022146 2572 scope.go:117] "RemoveContainer" containerID="ac9a091e248bb7e178d96de2123beef87bd6cd6b7409f89c1271b60ea2995ac2" Jun 09 14:16:49.022545 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.022517 2572 scope.go:117] "RemoveContainer" containerID="4e0cfc147b122cfde2d475b12fe5a42c7f4ca372a2fabd38ee840334af18f638" Jun 09 14:16:49.022748 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:49.022728 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-69f59ffb7f-7b77k_open-cluster-management-agent-addon(78f12462-c4b9-4151-8aa4-e021d251c720)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" podUID="78f12462-c4b9-4151-8aa4-e021d251c720" Jun 09 14:16:49.025494 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.025472 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfddd949-cc38-4858-8661-fdfbcd3e1b09","Type":"ContainerStarted","Data":"7b508eb70a9dafe113182dd38c1bd7f1ff86f453e768b7e5c5e03261a881c1c9"} Jun 09 14:16:49.025594 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.025540 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfddd949-cc38-4858-8661-fdfbcd3e1b09","Type":"ContainerStarted","Data":"fd4a9e917f7a5a948703b7e6c683dca34eed46a49a26b01cc3b0af3c000c6ffe"} Jun 09 14:16:49.025594 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.025585 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfddd949-cc38-4858-8661-fdfbcd3e1b09","Type":"ContainerStarted","Data":"da9ece63059e94d19f4fe4a28d576a12c211892590f5bf7708158d437c7883bd"} Jun 09 14:16:49.025704 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.025628 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"cfddd949-cc38-4858-8661-fdfbcd3e1b09","Type":"ContainerStarted","Data":"0d36a328957490461b37d76be0d7b087f4fd731c83c06f5613155bb551c10606"} Jun 09 14:16:49.027577 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.027554 2572 generic.go:356] "Generic (PLEG): container finished" podID="ca1399d4-4dee-457b-9a21-a60542d830d2" containerID="980183df30f067e2abfd1ab8822c8bf14a588062a5d67d4b755819467eceabd8" exitCode=255 Jun 09 14:16:49.027665 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.027607 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" event={"ID":"ca1399d4-4dee-457b-9a21-a60542d830d2","Type":"ContainerDied","Data":"980183df30f067e2abfd1ab8822c8bf14a588062a5d67d4b755819467eceabd8"} Jun 09 14:16:49.027971 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.027898 2572 scope.go:117] "RemoveContainer" containerID="980183df30f067e2abfd1ab8822c8bf14a588062a5d67d4b755819467eceabd8" Jun 09 14:16:49.028088 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:49.028068 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh_open-cluster-management-agent-addon(ca1399d4-4dee-457b-9a21-a60542d830d2)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" podUID="ca1399d4-4dee-457b-9a21-a60542d830d2" Jun 09 14:16:49.040285 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.040262 2572 scope.go:117] "RemoveContainer" containerID="6cf7793de5317c14145738a9eec81e97fefacf3b94bb96c5d91afb492b7c7b7e" Jun 09 14:16:49.082813 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.082523 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.817981088 podStartE2EDuration="8.082499349s" totalImagesPullingTime="5.24529201s" totalInitContainerRuntime="19.226251ms" isStatefulPod=false podCreationTimestamp="2026-06-09 14:16:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:16:49.075906645 +0000 UTC m=+285.518105841" watchObservedRunningTime="2026-06-09 14:16:49.082499349 +0000 UTC m=+285.524698544" Jun 09 14:16:49.148605 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.148573 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bgsqh"] Jun 09 14:16:49.151772 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:16:49.151740 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61d37e4_3fba_4fb6_99a7_c9639fcbc9f0.slice/crio-1793bb0a3b6d2304beb3be535cfd293fc582906d8d87999784d2bd64d402707b WatchSource:0}: Error finding container 1793bb0a3b6d2304beb3be535cfd293fc582906d8d87999784d2bd64d402707b: Status 404 returned error can't find the container with id 1793bb0a3b6d2304beb3be535cfd293fc582906d8d87999784d2bd64d402707b Jun 09 14:16:49.622049 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:49.622012 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:16:50.033257 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:50.033213 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgsqh" event={"ID":"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0","Type":"ContainerStarted","Data":"1793bb0a3b6d2304beb3be535cfd293fc582906d8d87999784d2bd64d402707b"} Jun 09 14:16:50.034795 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:50.034775 2572 scope.go:117] "RemoveContainer" containerID="4e0cfc147b122cfde2d475b12fe5a42c7f4ca372a2fabd38ee840334af18f638" Jun 09 14:16:50.034950 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:50.034932 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-69f59ffb7f-7b77k_open-cluster-management-agent-addon(78f12462-c4b9-4151-8aa4-e021d251c720)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" podUID="78f12462-c4b9-4151-8aa4-e021d251c720" Jun 09 14:16:50.739006 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:50.738966 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" Jun 09 14:16:50.739437 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:50.739420 2572 scope.go:117] "RemoveContainer" containerID="980183df30f067e2abfd1ab8822c8bf14a588062a5d67d4b755819467eceabd8" Jun 09 14:16:50.739646 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:50.739623 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh_open-cluster-management-agent-addon(ca1399d4-4dee-457b-9a21-a60542d830d2)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" podUID="ca1399d4-4dee-457b-9a21-a60542d830d2" Jun 09 14:16:50.746552 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:50.746520 2572 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:16:51.038133 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:51.038093 2572 scope.go:117] "RemoveContainer" containerID="4e0cfc147b122cfde2d475b12fe5a42c7f4ca372a2fabd38ee840334af18f638" Jun 09 14:16:51.038420 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:16:51.038342 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-69f59ffb7f-7b77k_open-cluster-management-agent-addon(78f12462-c4b9-4151-8aa4-e021d251c720)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" podUID="78f12462-c4b9-4151-8aa4-e021d251c720" Jun 09 14:16:52.043580 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:52.043542 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgsqh" event={"ID":"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0","Type":"ContainerStarted","Data":"de7e0426dffb1e468b5d4f5dde11fb1a3ee410f9267672a65bb403f816c468db"} Jun 09 14:16:52.044133 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:52.043601 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bgsqh" event={"ID":"e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0","Type":"ContainerStarted","Data":"314dbc79635c23ef728227dff32913bfbe573b258b33d967d8b87b020328d0a3"} Jun 09 14:16:52.044133 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:52.043629 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bgsqh" Jun 09 14:16:52.059990 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:52.059942 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bgsqh" podStartSLOduration=252.24225706 podStartE2EDuration="4m14.059924516s" totalImagesPullingTime="1.817667456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:12:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:16:52.058587513 +0000 UTC m=+288.500786741" watchObservedRunningTime="2026-06-09 14:16:52.059924516 +0000 UTC m=+288.502123711" Jun 09 14:16:52.137045 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:16:52.137004 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:17:00.272263 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:00.272218 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:17:00.272643 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:00.272293 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:17:02.049494 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:02.049455 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bgsqh" Jun 09 14:17:03.978994 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:03.978964 2572 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 14:17:05.026568 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:05.026536 2572 scope.go:117] "RemoveContainer" containerID="980183df30f067e2abfd1ab8822c8bf14a588062a5d67d4b755819467eceabd8" Jun 09 14:17:05.090676 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:05.090648 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-64df8c6c4b-tdsbh" event={"ID":"ca1399d4-4dee-457b-9a21-a60542d830d2","Type":"ContainerStarted","Data":"eafa1d63ac22ee6a7ae697e01a3d65c91e7428039b42281029d552638fb2364b"} Jun 09 14:17:06.031214 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:06.031178 2572 scope.go:117] "RemoveContainer" containerID="4e0cfc147b122cfde2d475b12fe5a42c7f4ca372a2fabd38ee840334af18f638" Jun 09 14:17:06.096622 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:06.096585 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" event={"ID":"78f12462-c4b9-4151-8aa4-e021d251c720","Type":"ContainerStarted","Data":"ba3ea33ad15eefae39f4a9e69b2e3943dd36f5e75ebded203297a6ab05639789"} Jun 09 14:17:06.096942 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:06.096897 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:17:06.098058 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:06.098030 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" podUID="78f12462-c4b9-4151-8aa4-e021d251c720" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused" Jun 09 14:17:07.101093 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:07.101064 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f59ffb7f-7b77k" Jun 09 14:17:20.277645 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:20.277610 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:17:20.281738 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:20.281717 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7d7f496f9c-d52hb" Jun 09 14:17:42.136924 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:42.136821 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:17:42.156535 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:42.156504 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:17:42.244211 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:17:42.244183 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 14:20:21.048345 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.048311 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd"] Jun 09 14:20:21.050654 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.050636 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.053252 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.053225 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 14:20:21.053401 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.053356 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-rsghx\"" Jun 09 14:20:21.054134 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.054105 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 14:20:21.054537 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.054520 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 14:20:21.054604 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.054587 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 14:20:21.066008 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.065987 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd"] Jun 09 14:20:21.218421 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.218385 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6qhm\" (UniqueName: \"kubernetes.io/projected/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-kube-api-access-f6qhm\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.218421 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.218432 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-manifests\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.218640 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.218450 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.218640 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.218483 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.218640 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.218558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-tmp\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.319007 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.318915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qhm\" (UniqueName: \"kubernetes.io/projected/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-kube-api-access-f6qhm\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.319007 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.318967 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-manifests\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.319007 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.318993 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.319273 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.319015 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.319273 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.319075 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-tmp\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.319542 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.319522 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-manifests\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.321436 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.321411 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-tmp\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.321752 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.321731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.321794 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.321731 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-webhook-cert\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.331508 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.331486 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6qhm\" (UniqueName: \"kubernetes.io/projected/b57be5ab-3895-4b9b-983e-f13c6b9cf6d9-kube-api-access-f6qhm\") pod \"opendatahub-operator-controller-manager-c57c599f5-d2pvd\" (UID: \"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9\") " pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.361516 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.361486 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:21.494586 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.494557 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd"] Jun 09 14:20:21.497464 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:20:21.497435 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb57be5ab_3895_4b9b_983e_f13c6b9cf6d9.slice/crio-11615946f5c3ad6737e2a8026f3ebac1962b3b3c57eadfa6e69a2bf7359e0324 WatchSource:0}: Error finding container 11615946f5c3ad6737e2a8026f3ebac1962b3b3c57eadfa6e69a2bf7359e0324: Status 404 returned error can't find the container with id 11615946f5c3ad6737e2a8026f3ebac1962b3b3c57eadfa6e69a2bf7359e0324 Jun 09 14:20:21.499217 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.499190 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:20:21.777375 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:21.777338 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" event={"ID":"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9","Type":"ContainerStarted","Data":"11615946f5c3ad6737e2a8026f3ebac1962b3b3c57eadfa6e69a2bf7359e0324"} Jun 09 14:20:25.792057 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:25.792024 2572 generic.go:356] "Generic (PLEG): container finished" podID="b57be5ab-3895-4b9b-983e-f13c6b9cf6d9" containerID="e981916e5c40b42b4d949e0c1fd88bb2701c24d4ac5a5d7de6e3be0c0313c91f" exitCode=0 Jun 09 14:20:25.792445 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:25.792084 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" event={"ID":"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9","Type":"ContainerDied","Data":"e981916e5c40b42b4d949e0c1fd88bb2701c24d4ac5a5d7de6e3be0c0313c91f"} Jun 09 14:20:26.797800 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:26.797757 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" event={"ID":"b57be5ab-3895-4b9b-983e-f13c6b9cf6d9","Type":"ContainerStarted","Data":"48dccb458fc86382cfb78ba233db56e02f9ee2ffe27e72ecdddee9be3b48a462"} Jun 09 14:20:26.798239 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:26.797849 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:26.819872 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:26.819820 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" podStartSLOduration=1.32946378 podStartE2EDuration="5.819803702s" totalImagesPullingTime="3.566162767s" totalInitContainerRuntime="924.177155ms" isStatefulPod=false podCreationTimestamp="2026-06-09 14:20:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:20:26.819081179 +0000 UTC m=+503.261280373" watchObservedRunningTime="2026-06-09 14:20:26.819803702 +0000 UTC m=+503.262002895" Jun 09 14:20:37.803443 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:37.803408 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c57c599f5-d2pvd" Jun 09 14:20:50.740280 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.740198 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9"] Jun 09 14:20:50.743597 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.743578 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.746610 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.746584 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 14:20:50.747518 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.747491 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 14:20:50.747817 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.747790 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 14:20:50.747817 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.747792 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-684qc\"" Jun 09 14:20:50.747982 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.747870 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 14:20:50.747982 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.747934 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 14:20:50.754794 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.754766 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9"] Jun 09 14:20:50.863758 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.863715 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4bb6c41-630a-4108-9058-5ef010eaa0a9-cert\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.863954 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.863771 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mslsk\" (UniqueName: \"kubernetes.io/projected/f4bb6c41-630a-4108-9058-5ef010eaa0a9-kube-api-access-mslsk\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.863954 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.863854 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4bb6c41-630a-4108-9058-5ef010eaa0a9-manager-config\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.863954 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.863920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4bb6c41-630a-4108-9058-5ef010eaa0a9-metrics-cert\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.964766 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.964714 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4bb6c41-630a-4108-9058-5ef010eaa0a9-manager-config\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.964766 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.964779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4bb6c41-630a-4108-9058-5ef010eaa0a9-metrics-cert\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.964986 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.964839 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4bb6c41-630a-4108-9058-5ef010eaa0a9-cert\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.964986 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.964875 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mslsk\" (UniqueName: \"kubernetes.io/projected/f4bb6c41-630a-4108-9058-5ef010eaa0a9-kube-api-access-mslsk\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.965451 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.965421 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4bb6c41-630a-4108-9058-5ef010eaa0a9-manager-config\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.967276 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.967250 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4bb6c41-630a-4108-9058-5ef010eaa0a9-metrics-cert\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.967372 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.967294 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4bb6c41-630a-4108-9058-5ef010eaa0a9-cert\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:50.977134 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:50.977085 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mslsk\" (UniqueName: \"kubernetes.io/projected/f4bb6c41-630a-4108-9058-5ef010eaa0a9-kube-api-access-mslsk\") pod \"lws-controller-manager-65d785dc9d-dswp9\" (UID: \"f4bb6c41-630a-4108-9058-5ef010eaa0a9\") " pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:51.054056 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:51.053970 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:51.193146 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:51.193092 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9"] Jun 09 14:20:51.196657 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:20:51.196630 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4bb6c41_630a_4108_9058_5ef010eaa0a9.slice/crio-f0b83b326bf15c04dead92fa9d2f151b2412a59c6f4a1f740282eaefdcaae05d WatchSource:0}: Error finding container f0b83b326bf15c04dead92fa9d2f151b2412a59c6f4a1f740282eaefdcaae05d: Status 404 returned error can't find the container with id f0b83b326bf15c04dead92fa9d2f151b2412a59c6f4a1f740282eaefdcaae05d Jun 09 14:20:51.892368 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:51.892337 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" event={"ID":"f4bb6c41-630a-4108-9058-5ef010eaa0a9","Type":"ContainerStarted","Data":"f0b83b326bf15c04dead92fa9d2f151b2412a59c6f4a1f740282eaefdcaae05d"} Jun 09 14:20:53.901750 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:53.901708 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" event={"ID":"f4bb6c41-630a-4108-9058-5ef010eaa0a9","Type":"ContainerStarted","Data":"33c5e76bd1b83627f04313fb6bd968ad539532af014fec16e6ff370b0be4d4c1"} Jun 09 14:20:53.902176 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:53.901827 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:20:53.924048 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:20:53.923986 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" podStartSLOduration=1.422066307 podStartE2EDuration="3.923968347s" totalImagesPullingTime="2.50190204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:20:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:20:53.922877051 +0000 UTC m=+530.365076245" watchObservedRunningTime="2026-06-09 14:20:53.923968347 +0000 UTC m=+530.366167541" Jun 09 14:21:04.908248 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:04.908217 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-65d785dc9d-dswp9" Jun 09 14:21:14.045789 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.045756 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj"] Jun 09 14:21:14.048911 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.048886 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.051410 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.051390 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 14:21:14.051715 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.051698 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 14:21:14.051817 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.051790 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 09 14:21:14.051960 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.051942 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-kx65p\"" Jun 09 14:21:14.064246 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.064220 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj"] Jun 09 14:21:14.073313 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.073290 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.073417 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.073320 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.073417 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.073339 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d13f6f-8473-40ef-96e6-17a191150ff3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.073417 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.073358 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.073417 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.073397 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dprg\" (UniqueName: \"kubernetes.io/projected/93d13f6f-8473-40ef-96e6-17a191150ff3-kube-api-access-7dprg\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.073574 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.073433 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.073574 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.073493 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.073574 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.073523 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.073574 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.073542 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.174411 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.174356 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.174617 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.174420 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.174617 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.174454 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.174617 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.174477 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.174790 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.174631 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.174790 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.174672 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.174790 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.174701 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d13f6f-8473-40ef-96e6-17a191150ff3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.174790 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.174763 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.174996 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.174893 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.174996 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.174961 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dprg\" (UniqueName: \"kubernetes.io/projected/93d13f6f-8473-40ef-96e6-17a191150ff3-kube-api-access-7dprg\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.175136 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.174898 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.175136 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.175026 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.175253 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.175214 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.175413 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.175395 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93d13f6f-8473-40ef-96e6-17a191150ff3-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.177249 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.177222 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.177571 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.177552 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.186680 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.186658 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dprg\" (UniqueName: \"kubernetes.io/projected/93d13f6f-8473-40ef-96e6-17a191150ff3-kube-api-access-7dprg\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.186785 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.186701 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93d13f6f-8473-40ef-96e6-17a191150ff3-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f979548kwj\" (UID: \"93d13f6f-8473-40ef-96e6-17a191150ff3\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.359971 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.359885 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:14.507612 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.507537 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj"] Jun 09 14:21:14.510284 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:21:14.510247 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93d13f6f_8473_40ef_96e6_17a191150ff3.slice/crio-43c17ebc71ea29ce48e350dcd4d394e08dc9e3ef39a4edf4bf90dc398e1228b5 WatchSource:0}: Error finding container 43c17ebc71ea29ce48e350dcd4d394e08dc9e3ef39a4edf4bf90dc398e1228b5: Status 404 returned error can't find the container with id 43c17ebc71ea29ce48e350dcd4d394e08dc9e3ef39a4edf4bf90dc398e1228b5 Jun 09 14:21:14.982131 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:14.982077 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" event={"ID":"93d13f6f-8473-40ef-96e6-17a191150ff3","Type":"ContainerStarted","Data":"43c17ebc71ea29ce48e350dcd4d394e08dc9e3ef39a4edf4bf90dc398e1228b5"} Jun 09 14:21:17.332119 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:17.332025 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 14:21:17.332407 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:17.332173 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 14:21:17.332407 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:17.332218 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 14:21:17.997036 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:17.996996 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" event={"ID":"93d13f6f-8473-40ef-96e6-17a191150ff3","Type":"ContainerStarted","Data":"6b615e5219633b10928a18cdc244ab09cb49f1319d31284ca83735e6bd36a78e"} Jun 09 14:21:18.017149 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.017079 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" podStartSLOduration=1.198048427 podStartE2EDuration="4.017063229s" totalImagesPullingTime="2.819014802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:21:18.015442312 +0000 UTC m=+554.457641510" watchObservedRunningTime="2026-06-09 14:21:18.017063229 +0000 UTC m=+554.459262425" Jun 09 14:21:18.360936 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.360840 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:18.386269 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.386238 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-986494677-29zf7"] Jun 09 14:21:18.389633 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.389610 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-986494677-29zf7" Jun 09 14:21:18.392003 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.391981 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fdnmf\"" Jun 09 14:21:18.392215 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.391981 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 09 14:21:18.399897 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.399873 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-986494677-29zf7"] Jun 09 14:21:18.415240 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.415181 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kczb5\" (UniqueName: \"kubernetes.io/projected/a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8-kube-api-access-kczb5\") pod \"dashboard-redirect-986494677-29zf7\" (UID: \"a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8\") " pod="opendatahub/dashboard-redirect-986494677-29zf7" Jun 09 14:21:18.415417 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.415286 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8-redirect-config\") pod \"dashboard-redirect-986494677-29zf7\" (UID: \"a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8\") " pod="opendatahub/dashboard-redirect-986494677-29zf7" Jun 09 14:21:18.455055 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.455024 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:18.516329 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.516291 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kczb5\" (UniqueName: \"kubernetes.io/projected/a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8-kube-api-access-kczb5\") pod \"dashboard-redirect-986494677-29zf7\" (UID: \"a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8\") " pod="opendatahub/dashboard-redirect-986494677-29zf7" Jun 09 14:21:18.516503 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.516361 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8-redirect-config\") pod \"dashboard-redirect-986494677-29zf7\" (UID: \"a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8\") " pod="opendatahub/dashboard-redirect-986494677-29zf7" Jun 09 14:21:18.517160 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.517134 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8-redirect-config\") pod \"dashboard-redirect-986494677-29zf7\" (UID: \"a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8\") " pod="opendatahub/dashboard-redirect-986494677-29zf7" Jun 09 14:21:18.523919 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.523895 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kczb5\" (UniqueName: \"kubernetes.io/projected/a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8-kube-api-access-kczb5\") pod \"dashboard-redirect-986494677-29zf7\" (UID: \"a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8\") " pod="opendatahub/dashboard-redirect-986494677-29zf7" Jun 09 14:21:18.701155 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.701093 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-986494677-29zf7" Jun 09 14:21:18.824211 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:18.824184 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-986494677-29zf7"] Jun 09 14:21:18.826663 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:21:18.826636 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1eb6f85_e99d_4f5f_9953_3e73ae1eb8c8.slice/crio-81328452d0cef3ae34363934bd6dd7bd0ca23ef4db135c7e7e29ab8775e5492e WatchSource:0}: Error finding container 81328452d0cef3ae34363934bd6dd7bd0ca23ef4db135c7e7e29ab8775e5492e: Status 404 returned error can't find the container with id 81328452d0cef3ae34363934bd6dd7bd0ca23ef4db135c7e7e29ab8775e5492e Jun 09 14:21:19.002062 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:19.001979 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-986494677-29zf7" event={"ID":"a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8","Type":"ContainerStarted","Data":"81328452d0cef3ae34363934bd6dd7bd0ca23ef4db135c7e7e29ab8775e5492e"} Jun 09 14:21:19.002296 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:19.002282 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:19.003266 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:19.003249 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f979548kwj" Jun 09 14:21:22.015746 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:22.015714 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-986494677-29zf7" event={"ID":"a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8","Type":"ContainerStarted","Data":"4b864e9a86559f0b7c2190c6c7e0a1bb94e3fe73a6fa35fd96c5cf838729a483"} Jun 09 14:21:22.030004 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:22.029956 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-986494677-29zf7" podStartSLOduration=1.8395406300000001 podStartE2EDuration="4.029941791s" totalImagesPullingTime="2.190401161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:21:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:21:22.028575169 +0000 UTC m=+558.470774364" watchObservedRunningTime="2026-06-09 14:21:22.029941791 +0000 UTC m=+558.472141023" Jun 09 14:21:42.160462 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.160430 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tn6lh"] Jun 09 14:21:42.163053 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.163029 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" Jun 09 14:21:42.165517 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.165494 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 14:21:42.165640 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.165597 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-glt2d\"" Jun 09 14:21:42.165640 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.165629 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 14:21:42.175415 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.175390 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tn6lh"] Jun 09 14:21:42.322098 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.322064 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8c57\" (UniqueName: \"kubernetes.io/projected/9b457ab8-71fc-489b-91d0-8b8e29cbe77e-kube-api-access-f8c57\") pod \"kuadrant-operator-catalog-tn6lh\" (UID: \"9b457ab8-71fc-489b-91d0-8b8e29cbe77e\") " pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" Jun 09 14:21:42.423538 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.423506 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8c57\" (UniqueName: \"kubernetes.io/projected/9b457ab8-71fc-489b-91d0-8b8e29cbe77e-kube-api-access-f8c57\") pod \"kuadrant-operator-catalog-tn6lh\" (UID: \"9b457ab8-71fc-489b-91d0-8b8e29cbe77e\") " pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" Jun 09 14:21:42.436475 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.436447 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8c57\" (UniqueName: \"kubernetes.io/projected/9b457ab8-71fc-489b-91d0-8b8e29cbe77e-kube-api-access-f8c57\") pod \"kuadrant-operator-catalog-tn6lh\" (UID: \"9b457ab8-71fc-489b-91d0-8b8e29cbe77e\") " pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" Jun 09 14:21:42.472547 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.472520 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" Jun 09 14:21:42.525201 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.525168 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tn6lh"] Jun 09 14:21:42.596597 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.596561 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tn6lh"] Jun 09 14:21:42.599513 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:21:42.599484 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b457ab8_71fc_489b_91d0_8b8e29cbe77e.slice/crio-691eb31b33ee03c89cd627e4bbee313c27a00f8acd880e77d288094026c819c0 WatchSource:0}: Error finding container 691eb31b33ee03c89cd627e4bbee313c27a00f8acd880e77d288094026c819c0: Status 404 returned error can't find the container with id 691eb31b33ee03c89cd627e4bbee313c27a00f8acd880e77d288094026c819c0 Jun 09 14:21:42.734591 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.734505 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrgtl"] Jun 09 14:21:42.737435 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.737418 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" Jun 09 14:21:42.745489 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.745463 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrgtl"] Jun 09 14:21:42.825900 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.825870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjwlh\" (UniqueName: \"kubernetes.io/projected/82f5a84a-4d0e-4019-bf46-5b096beee6b0-kube-api-access-jjwlh\") pod \"kuadrant-operator-catalog-lrgtl\" (UID: \"82f5a84a-4d0e-4019-bf46-5b096beee6b0\") " pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" Jun 09 14:21:42.927022 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.926983 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjwlh\" (UniqueName: \"kubernetes.io/projected/82f5a84a-4d0e-4019-bf46-5b096beee6b0-kube-api-access-jjwlh\") pod \"kuadrant-operator-catalog-lrgtl\" (UID: \"82f5a84a-4d0e-4019-bf46-5b096beee6b0\") " pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" Jun 09 14:21:42.935599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:42.935569 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjwlh\" (UniqueName: \"kubernetes.io/projected/82f5a84a-4d0e-4019-bf46-5b096beee6b0-kube-api-access-jjwlh\") pod \"kuadrant-operator-catalog-lrgtl\" (UID: \"82f5a84a-4d0e-4019-bf46-5b096beee6b0\") " pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" Jun 09 14:21:43.047136 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:43.047024 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" Jun 09 14:21:43.103690 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:43.102999 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" event={"ID":"9b457ab8-71fc-489b-91d0-8b8e29cbe77e","Type":"ContainerStarted","Data":"691eb31b33ee03c89cd627e4bbee313c27a00f8acd880e77d288094026c819c0"} Jun 09 14:21:43.188880 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:43.188846 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lrgtl"] Jun 09 14:21:43.217731 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:21:43.217693 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82f5a84a_4d0e_4019_bf46_5b096beee6b0.slice/crio-bc1bbc355291aa62ebbae90e415164164284ab6e484abe0bb850c804e2e52917 WatchSource:0}: Error finding container bc1bbc355291aa62ebbae90e415164164284ab6e484abe0bb850c804e2e52917: Status 404 returned error can't find the container with id bc1bbc355291aa62ebbae90e415164164284ab6e484abe0bb850c804e2e52917 Jun 09 14:21:44.110058 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:44.109992 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" event={"ID":"82f5a84a-4d0e-4019-bf46-5b096beee6b0","Type":"ContainerStarted","Data":"bc1bbc355291aa62ebbae90e415164164284ab6e484abe0bb850c804e2e52917"} Jun 09 14:21:45.115814 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:45.115715 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" event={"ID":"9b457ab8-71fc-489b-91d0-8b8e29cbe77e","Type":"ContainerStarted","Data":"f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0"} Jun 09 14:21:45.115814 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:45.115746 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" podUID="9b457ab8-71fc-489b-91d0-8b8e29cbe77e" containerName="registry-server" containerID="cri-o://f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0" gracePeriod=2 Jun 09 14:21:45.117365 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:45.117334 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" event={"ID":"82f5a84a-4d0e-4019-bf46-5b096beee6b0","Type":"ContainerStarted","Data":"b48c0ef515113a789ad836f4977055ea84ea9ff41993447f685c8ab67c47939d"} Jun 09 14:21:45.130081 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:45.129873 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" podStartSLOduration=0.892932769 podStartE2EDuration="3.129854871s" totalImagesPullingTime="2.236922102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:21:45.128986543 +0000 UTC m=+581.571185733" watchObservedRunningTime="2026-06-09 14:21:45.129854871 +0000 UTC m=+581.572054065" Jun 09 14:21:45.142355 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:45.142310 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" podStartSLOduration=1.5289353380000001 podStartE2EDuration="3.142296543s" totalImagesPullingTime="1.613361205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:21:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:21:45.142018621 +0000 UTC m=+581.584217816" watchObservedRunningTime="2026-06-09 14:21:45.142296543 +0000 UTC m=+581.584495737" Jun 09 14:21:45.355445 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:45.355422 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" Jun 09 14:21:45.451190 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:45.451164 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8c57\" (UniqueName: \"kubernetes.io/projected/9b457ab8-71fc-489b-91d0-8b8e29cbe77e-kube-api-access-f8c57\") pod \"9b457ab8-71fc-489b-91d0-8b8e29cbe77e\" (UID: \"9b457ab8-71fc-489b-91d0-8b8e29cbe77e\") " Jun 09 14:21:45.453334 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:45.453310 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b457ab8-71fc-489b-91d0-8b8e29cbe77e-kube-api-access-f8c57" (OuterVolumeSpecName: "kube-api-access-f8c57") pod "9b457ab8-71fc-489b-91d0-8b8e29cbe77e" (UID: "9b457ab8-71fc-489b-91d0-8b8e29cbe77e"). InnerVolumeSpecName "kube-api-access-f8c57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:21:45.552445 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:45.552414 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8c57\" (UniqueName: \"kubernetes.io/projected/9b457ab8-71fc-489b-91d0-8b8e29cbe77e-kube-api-access-f8c57\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:21:46.121988 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:46.121909 2572 generic.go:356] "Generic (PLEG): container finished" podID="9b457ab8-71fc-489b-91d0-8b8e29cbe77e" containerID="f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0" exitCode=0 Jun 09 14:21:46.121988 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:46.121951 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" Jun 09 14:21:46.122419 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:46.121995 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" event={"ID":"9b457ab8-71fc-489b-91d0-8b8e29cbe77e","Type":"ContainerDied","Data":"f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0"} Jun 09 14:21:46.122419 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:46.122047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tn6lh" event={"ID":"9b457ab8-71fc-489b-91d0-8b8e29cbe77e","Type":"ContainerDied","Data":"691eb31b33ee03c89cd627e4bbee313c27a00f8acd880e77d288094026c819c0"} Jun 09 14:21:46.122419 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:46.122067 2572 scope.go:117] "RemoveContainer" containerID="f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0" Jun 09 14:21:46.130223 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:46.130196 2572 scope.go:117] "RemoveContainer" containerID="f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0" Jun 09 14:21:46.130482 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:21:46.130463 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0\": container with ID starting with f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0 not found: ID does not exist" containerID="f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0" Jun 09 14:21:46.130542 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:46.130492 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0"} err="failed to get container status \"f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0\": rpc error: code = NotFound desc = could not find container \"f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0\": container with ID starting with f3cfa8996caca88879c73c08ff1f06555f1acfc30480d106ba7521f6f99a43f0 not found: ID does not exist" Jun 09 14:21:46.138212 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:46.138188 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tn6lh"] Jun 09 14:21:46.142063 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:46.142039 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tn6lh"] Jun 09 14:21:48.031404 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:48.031371 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b457ab8-71fc-489b-91d0-8b8e29cbe77e" path="/var/lib/kubelet/pods/9b457ab8-71fc-489b-91d0-8b8e29cbe77e/volumes" Jun 09 14:21:53.047287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:53.047249 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" Jun 09 14:21:53.047809 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:53.047306 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" Jun 09 14:21:53.069229 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:53.069205 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" Jun 09 14:21:53.170087 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:21:53.170058 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lrgtl" Jun 09 14:22:06.473979 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.473942 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t"] Jun 09 14:22:06.474402 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.474285 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b457ab8-71fc-489b-91d0-8b8e29cbe77e" containerName="registry-server" Jun 09 14:22:06.474402 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.474298 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b457ab8-71fc-489b-91d0-8b8e29cbe77e" containerName="registry-server" Jun 09 14:22:06.474402 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.474359 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b457ab8-71fc-489b-91d0-8b8e29cbe77e" containerName="registry-server" Jun 09 14:22:06.476392 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.476374 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:06.480645 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.480625 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vhr4k\"" Jun 09 14:22:06.491034 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.491011 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t"] Jun 09 14:22:06.522395 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.522368 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbvpj\" (UniqueName: \"kubernetes.io/projected/adef8235-2fc0-4e0f-9c7b-18d19b8b723a-kube-api-access-rbvpj\") pod \"limitador-operator-controller-manager-859d7b78bd-tm48t\" (UID: \"adef8235-2fc0-4e0f-9c7b-18d19b8b723a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:06.623012 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.622979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbvpj\" (UniqueName: \"kubernetes.io/projected/adef8235-2fc0-4e0f-9c7b-18d19b8b723a-kube-api-access-rbvpj\") pod \"limitador-operator-controller-manager-859d7b78bd-tm48t\" (UID: \"adef8235-2fc0-4e0f-9c7b-18d19b8b723a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:06.630805 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.630782 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbvpj\" (UniqueName: \"kubernetes.io/projected/adef8235-2fc0-4e0f-9c7b-18d19b8b723a-kube-api-access-rbvpj\") pod \"limitador-operator-controller-manager-859d7b78bd-tm48t\" (UID: \"adef8235-2fc0-4e0f-9c7b-18d19b8b723a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:06.785905 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.785816 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:06.912561 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:06.912535 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t"] Jun 09 14:22:06.914828 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:22:06.914792 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadef8235_2fc0_4e0f_9c7b_18d19b8b723a.slice/crio-71e61a353d998e5c41418397aba1505703d69e883c363360794b8d2e582e3395 WatchSource:0}: Error finding container 71e61a353d998e5c41418397aba1505703d69e883c363360794b8d2e582e3395: Status 404 returned error can't find the container with id 71e61a353d998e5c41418397aba1505703d69e883c363360794b8d2e582e3395 Jun 09 14:22:07.204609 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:07.204574 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" event={"ID":"adef8235-2fc0-4e0f-9c7b-18d19b8b723a","Type":"ContainerStarted","Data":"71e61a353d998e5c41418397aba1505703d69e883c363360794b8d2e582e3395"} Jun 09 14:22:10.218897 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:10.218855 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" event={"ID":"adef8235-2fc0-4e0f-9c7b-18d19b8b723a","Type":"ContainerStarted","Data":"884dd6bf3ff4e64894e6928cf6affde46753bd9b97682d6d847589e31183cde0"} Jun 09 14:22:10.219330 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:10.219031 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:14.100836 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:14.100726 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" podStartSLOduration=5.606326231 podStartE2EDuration="8.10070599s" totalImagesPullingTime="2.494379759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:22:10.247408989 +0000 UTC m=+606.689608185" watchObservedRunningTime="2026-06-09 14:22:14.10070599 +0000 UTC m=+610.542905185" Jun 09 14:22:14.101967 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:14.101940 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z"] Jun 09 14:22:14.104032 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:14.104014 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z" Jun 09 14:22:14.106423 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:14.106407 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 09 14:22:14.106570 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:14.106550 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8jxnw\"" Jun 09 14:22:14.115256 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:14.115233 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z"] Jun 09 14:22:14.188157 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:14.188104 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzzwk\" (UniqueName: \"kubernetes.io/projected/125a67fb-c6f9-4b35-8e2c-ede2d9899f54-kube-api-access-bzzwk\") pod \"dns-operator-controller-manager-864dd78c4c-qzw8z\" (UID: \"125a67fb-c6f9-4b35-8e2c-ede2d9899f54\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z" Jun 09 14:22:14.289278 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:14.289243 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzzwk\" (UniqueName: \"kubernetes.io/projected/125a67fb-c6f9-4b35-8e2c-ede2d9899f54-kube-api-access-bzzwk\") pod \"dns-operator-controller-manager-864dd78c4c-qzw8z\" (UID: \"125a67fb-c6f9-4b35-8e2c-ede2d9899f54\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z" Jun 09 14:22:14.298858 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:14.298833 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzzwk\" (UniqueName: \"kubernetes.io/projected/125a67fb-c6f9-4b35-8e2c-ede2d9899f54-kube-api-access-bzzwk\") pod \"dns-operator-controller-manager-864dd78c4c-qzw8z\" (UID: \"125a67fb-c6f9-4b35-8e2c-ede2d9899f54\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z" Jun 09 14:22:14.414435 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:14.414359 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z" Jun 09 14:22:14.542278 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:14.542212 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z"] Jun 09 14:22:14.544969 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:22:14.544936 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125a67fb_c6f9_4b35_8e2c_ede2d9899f54.slice/crio-06d18797ec56aa9e7a264a4c75dcabb3dc0d55c958292e65d11d9b00cfd8a75e WatchSource:0}: Error finding container 06d18797ec56aa9e7a264a4c75dcabb3dc0d55c958292e65d11d9b00cfd8a75e: Status 404 returned error can't find the container with id 06d18797ec56aa9e7a264a4c75dcabb3dc0d55c958292e65d11d9b00cfd8a75e Jun 09 14:22:15.240986 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:15.240956 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z" event={"ID":"125a67fb-c6f9-4b35-8e2c-ede2d9899f54","Type":"ContainerStarted","Data":"06d18797ec56aa9e7a264a4c75dcabb3dc0d55c958292e65d11d9b00cfd8a75e"} Jun 09 14:22:18.259312 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:18.259269 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z" event={"ID":"125a67fb-c6f9-4b35-8e2c-ede2d9899f54","Type":"ContainerStarted","Data":"be78bc39fd5fd2cc5389c671651a7fe2596a2c24a708882ea4b80d03303d0a48"} Jun 09 14:22:18.259727 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:18.259364 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z" Jun 09 14:22:18.276433 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:18.276381 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z" podStartSLOduration=1.378695161 podStartE2EDuration="4.276365881s" totalImagesPullingTime="2.89767072s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:22:18.275854996 +0000 UTC m=+614.718054190" watchObservedRunningTime="2026-06-09 14:22:18.276365881 +0000 UTC m=+614.718565075" Jun 09 14:22:21.224949 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:21.224923 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:29.264725 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:29.264694 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qzw8z" Jun 09 14:22:40.540057 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.540004 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2"] Jun 09 14:22:40.544609 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.544582 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:40.551386 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.551196 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-tmc76\"" Jun 09 14:22:40.560497 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.560470 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2"] Jun 09 14:22:40.718898 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.718853 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md8t2\" (UniqueName: \"kubernetes.io/projected/72327a93-6909-4019-a395-d11e959f5c94-kube-api-access-md8t2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxtq2\" (UID: \"72327a93-6909-4019-a395-d11e959f5c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:40.718898 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.718905 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72327a93-6909-4019-a395-d11e959f5c94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxtq2\" (UID: \"72327a93-6909-4019-a395-d11e959f5c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:40.819643 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.819541 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md8t2\" (UniqueName: \"kubernetes.io/projected/72327a93-6909-4019-a395-d11e959f5c94-kube-api-access-md8t2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxtq2\" (UID: \"72327a93-6909-4019-a395-d11e959f5c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:40.819643 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.819587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72327a93-6909-4019-a395-d11e959f5c94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxtq2\" (UID: \"72327a93-6909-4019-a395-d11e959f5c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:40.819946 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.819930 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72327a93-6909-4019-a395-d11e959f5c94-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxtq2\" (UID: \"72327a93-6909-4019-a395-d11e959f5c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:40.827735 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.827709 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md8t2\" (UniqueName: \"kubernetes.io/projected/72327a93-6909-4019-a395-d11e959f5c94-kube-api-access-md8t2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-nxtq2\" (UID: \"72327a93-6909-4019-a395-d11e959f5c94\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:40.855698 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.855657 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:40.996408 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:40.996378 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2"] Jun 09 14:22:40.999270 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:22:40.999241 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72327a93_6909_4019_a395_d11e959f5c94.slice/crio-93b5b00097b30e587e35c746291ea3cfbf0d595d1b41e13410b244169d72aa18 WatchSource:0}: Error finding container 93b5b00097b30e587e35c746291ea3cfbf0d595d1b41e13410b244169d72aa18: Status 404 returned error can't find the container with id 93b5b00097b30e587e35c746291ea3cfbf0d595d1b41e13410b244169d72aa18 Jun 09 14:22:41.173560 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.173533 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2"] Jun 09 14:22:41.177830 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.177804 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2"] Jun 09 14:22:41.196533 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.196498 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7"] Jun 09 14:22:41.202235 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.202207 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:22:41.211944 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.211903 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7"] Jun 09 14:22:41.214691 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.214668 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t"] Jun 09 14:22:41.214899 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.214853 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" podUID="adef8235-2fc0-4e0f-9c7b-18d19b8b723a" containerName="manager" containerID="cri-o://884dd6bf3ff4e64894e6928cf6affde46753bd9b97682d6d847589e31183cde0" gracePeriod=2 Jun 09 14:22:41.224387 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.224309 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" podUID="adef8235-2fc0-4e0f-9c7b-18d19b8b723a" containerName="manager" probeResult="failure" output="Get \"http://10.133.0.20:8081/readyz\": dial tcp 10.133.0.20:8081: connect: connection refused" Jun 09 14:22:41.224519 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.224318 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t"] Jun 09 14:22:41.230732 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:22:41.230632 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tm48t\" is forbidden: User \"system:node:ip-10-0-138-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-120.ec2.internal' and this object" podUID="adef8235-2fc0-4e0f-9c7b-18d19b8b723a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:41.244855 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.244816 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm"] Jun 09 14:22:41.245259 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.245240 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adef8235-2fc0-4e0f-9c7b-18d19b8b723a" containerName="manager" Jun 09 14:22:41.245372 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.245261 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="adef8235-2fc0-4e0f-9c7b-18d19b8b723a" containerName="manager" Jun 09 14:22:41.245372 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.245347 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="adef8235-2fc0-4e0f-9c7b-18d19b8b723a" containerName="manager" Jun 09 14:22:41.248721 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.248696 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm" Jun 09 14:22:41.251599 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:22:41.251558 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tm48t\" is forbidden: User \"system:node:ip-10-0-138-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-120.ec2.internal' and this object" podUID="adef8235-2fc0-4e0f-9c7b-18d19b8b723a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:41.260585 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.260552 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm"] Jun 09 14:22:41.323527 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.323487 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkpm2\" (UniqueName: \"kubernetes.io/projected/c69007ad-8b23-48e8-99de-cd16ddb3410a-kube-api-access-fkpm2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5ck7\" (UID: \"c69007ad-8b23-48e8-99de-cd16ddb3410a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:22:41.323710 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.323547 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c69007ad-8b23-48e8-99de-cd16ddb3410a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5ck7\" (UID: \"c69007ad-8b23-48e8-99de-cd16ddb3410a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:22:41.354508 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.354472 2572 generic.go:356] "Generic (PLEG): container finished" podID="adef8235-2fc0-4e0f-9c7b-18d19b8b723a" containerID="884dd6bf3ff4e64894e6928cf6affde46753bd9b97682d6d847589e31183cde0" exitCode=0 Jun 09 14:22:41.424716 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.424625 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn74g\" (UniqueName: \"kubernetes.io/projected/e84f654f-6a06-463b-8842-4bd5d7bcaa30-kube-api-access-qn74g\") pod \"limitador-operator-controller-manager-859d7b78bd-2gdrm\" (UID: \"e84f654f-6a06-463b-8842-4bd5d7bcaa30\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm" Jun 09 14:22:41.424716 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.424671 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c69007ad-8b23-48e8-99de-cd16ddb3410a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5ck7\" (UID: \"c69007ad-8b23-48e8-99de-cd16ddb3410a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:22:41.424897 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.424811 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkpm2\" (UniqueName: \"kubernetes.io/projected/c69007ad-8b23-48e8-99de-cd16ddb3410a-kube-api-access-fkpm2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5ck7\" (UID: \"c69007ad-8b23-48e8-99de-cd16ddb3410a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:22:41.425134 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.425090 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c69007ad-8b23-48e8-99de-cd16ddb3410a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5ck7\" (UID: \"c69007ad-8b23-48e8-99de-cd16ddb3410a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:22:41.440689 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.440660 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkpm2\" (UniqueName: \"kubernetes.io/projected/c69007ad-8b23-48e8-99de-cd16ddb3410a-kube-api-access-fkpm2\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-v5ck7\" (UID: \"c69007ad-8b23-48e8-99de-cd16ddb3410a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:22:41.450089 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.450063 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:41.452748 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:22:41.452703 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-tm48t\" is forbidden: User \"system:node:ip-10-0-138-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-120.ec2.internal' and this object" podUID="adef8235-2fc0-4e0f-9c7b-18d19b8b723a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:41.515773 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.515739 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:22:41.525365 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.525330 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn74g\" (UniqueName: \"kubernetes.io/projected/e84f654f-6a06-463b-8842-4bd5d7bcaa30-kube-api-access-qn74g\") pod \"limitador-operator-controller-manager-859d7b78bd-2gdrm\" (UID: \"e84f654f-6a06-463b-8842-4bd5d7bcaa30\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm" Jun 09 14:22:41.535079 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.535041 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn74g\" (UniqueName: \"kubernetes.io/projected/e84f654f-6a06-463b-8842-4bd5d7bcaa30-kube-api-access-qn74g\") pod \"limitador-operator-controller-manager-859d7b78bd-2gdrm\" (UID: \"e84f654f-6a06-463b-8842-4bd5d7bcaa30\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm" Jun 09 14:22:41.582007 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.581970 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm" Jun 09 14:22:41.626492 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.626179 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rbvpj\" (UniqueName: \"kubernetes.io/projected/adef8235-2fc0-4e0f-9c7b-18d19b8b723a-kube-api-access-rbvpj\") pod \"adef8235-2fc0-4e0f-9c7b-18d19b8b723a\" (UID: \"adef8235-2fc0-4e0f-9c7b-18d19b8b723a\") " Jun 09 14:22:41.629124 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.629071 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adef8235-2fc0-4e0f-9c7b-18d19b8b723a-kube-api-access-rbvpj" (OuterVolumeSpecName: "kube-api-access-rbvpj") pod "adef8235-2fc0-4e0f-9c7b-18d19b8b723a" (UID: "adef8235-2fc0-4e0f-9c7b-18d19b8b723a"). InnerVolumeSpecName "kube-api-access-rbvpj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:22:41.680473 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.680298 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7"] Jun 09 14:22:41.683718 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:22:41.683673 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69007ad_8b23_48e8_99de_cd16ddb3410a.slice/crio-0087b0ad0d10604ac869889d9a007de7b9d9287d43846d26b4fbfb9005fdc11a WatchSource:0}: Error finding container 0087b0ad0d10604ac869889d9a007de7b9d9287d43846d26b4fbfb9005fdc11a: Status 404 returned error can't find the container with id 0087b0ad0d10604ac869889d9a007de7b9d9287d43846d26b4fbfb9005fdc11a Jun 09 14:22:41.727628 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.727592 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rbvpj\" (UniqueName: \"kubernetes.io/projected/adef8235-2fc0-4e0f-9c7b-18d19b8b723a-kube-api-access-rbvpj\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:22:41.745353 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:41.745201 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm"] Jun 09 14:22:41.748737 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:22:41.748688 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode84f654f_6a06_463b_8842_4bd5d7bcaa30.slice/crio-fdf203c65187cd8c0739a7f9791bb85494b6027b4849152dacafe31adce0c41c WatchSource:0}: Error finding container fdf203c65187cd8c0739a7f9791bb85494b6027b4849152dacafe31adce0c41c: Status 404 returned error can't find the container with id fdf203c65187cd8c0739a7f9791bb85494b6027b4849152dacafe31adce0c41c Jun 09 14:22:42.033012 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:42.032911 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adef8235-2fc0-4e0f-9c7b-18d19b8b723a" path="/var/lib/kubelet/pods/adef8235-2fc0-4e0f-9c7b-18d19b8b723a/volumes" Jun 09 14:22:42.361717 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:42.361612 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm" event={"ID":"e84f654f-6a06-463b-8842-4bd5d7bcaa30","Type":"ContainerStarted","Data":"86d6f72248cdbce8bc8d4d7b1501bf2e2613025ac2c95a37b89ce33fbeea7404"} Jun 09 14:22:42.361717 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:42.361675 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm" event={"ID":"e84f654f-6a06-463b-8842-4bd5d7bcaa30","Type":"ContainerStarted","Data":"fdf203c65187cd8c0739a7f9791bb85494b6027b4849152dacafe31adce0c41c"} Jun 09 14:22:42.361960 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:42.361773 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm" Jun 09 14:22:42.363178 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:42.363148 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" event={"ID":"c69007ad-8b23-48e8-99de-cd16ddb3410a","Type":"ContainerStarted","Data":"0087b0ad0d10604ac869889d9a007de7b9d9287d43846d26b4fbfb9005fdc11a"} Jun 09 14:22:42.364669 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:42.364644 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-tm48t" Jun 09 14:22:42.364794 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:42.364672 2572 scope.go:117] "RemoveContainer" containerID="884dd6bf3ff4e64894e6928cf6affde46753bd9b97682d6d847589e31183cde0" Jun 09 14:22:42.384869 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:42.384810 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm" podStartSLOduration=1.384786942 podStartE2EDuration="1.384786942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:22:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:22:42.383074195 +0000 UTC m=+638.825273390" watchObservedRunningTime="2026-06-09 14:22:42.384786942 +0000 UTC m=+638.826986196" Jun 09 14:22:46.391330 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:46.391279 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" event={"ID":"c69007ad-8b23-48e8-99de-cd16ddb3410a","Type":"ContainerStarted","Data":"61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772"} Jun 09 14:22:46.391763 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:46.391416 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:22:46.392916 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:46.392889 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" podUID="72327a93-6909-4019-a395-d11e959f5c94" containerName="manager" containerID="cri-o://dc9476bfd8fd6d24b03df6b38aabe0e8904217a285241db319677050f2921818" gracePeriod=2 Jun 09 14:22:46.428319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:46.428264 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" podStartSLOduration=1.265755661 podStartE2EDuration="5.428247597s" totalImagesPullingTime="4.162491936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:22:46.42624331 +0000 UTC m=+642.868442524" watchObservedRunningTime="2026-06-09 14:22:46.428247597 +0000 UTC m=+642.870446791" Jun 09 14:22:46.430204 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:22:46.430165 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-nxtq2\" is forbidden: User \"system:node:ip-10-0-138-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-120.ec2.internal' and this object" podUID="72327a93-6909-4019-a395-d11e959f5c94" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:46.643366 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:46.643297 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:46.645492 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:22:46.645465 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-nxtq2\" is forbidden: User \"system:node:ip-10-0-138-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-120.ec2.internal' and this object" podUID="72327a93-6909-4019-a395-d11e959f5c94" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:46.670917 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:46.670881 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-md8t2\" (UniqueName: \"kubernetes.io/projected/72327a93-6909-4019-a395-d11e959f5c94-kube-api-access-md8t2\") pod \"72327a93-6909-4019-a395-d11e959f5c94\" (UID: \"72327a93-6909-4019-a395-d11e959f5c94\") " Jun 09 14:22:46.671003 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:46.670991 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72327a93-6909-4019-a395-d11e959f5c94-extensions-socket-volume\") pod \"72327a93-6909-4019-a395-d11e959f5c94\" (UID: \"72327a93-6909-4019-a395-d11e959f5c94\") " Jun 09 14:22:46.671321 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:46.671292 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72327a93-6909-4019-a395-d11e959f5c94-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "72327a93-6909-4019-a395-d11e959f5c94" (UID: "72327a93-6909-4019-a395-d11e959f5c94"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:22:46.673127 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:46.673077 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72327a93-6909-4019-a395-d11e959f5c94-kube-api-access-md8t2" (OuterVolumeSpecName: "kube-api-access-md8t2") pod "72327a93-6909-4019-a395-d11e959f5c94" (UID: "72327a93-6909-4019-a395-d11e959f5c94"). InnerVolumeSpecName "kube-api-access-md8t2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:22:46.772368 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:46.772326 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-md8t2\" (UniqueName: \"kubernetes.io/projected/72327a93-6909-4019-a395-d11e959f5c94-kube-api-access-md8t2\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:22:46.772368 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:46.772359 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72327a93-6909-4019-a395-d11e959f5c94-extensions-socket-volume\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:22:47.399295 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:47.399259 2572 generic.go:356] "Generic (PLEG): container finished" podID="72327a93-6909-4019-a395-d11e959f5c94" containerID="dc9476bfd8fd6d24b03df6b38aabe0e8904217a285241db319677050f2921818" exitCode=2 Jun 09 14:22:47.399758 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:47.399306 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:47.399758 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:47.399361 2572 scope.go:117] "RemoveContainer" containerID="dc9476bfd8fd6d24b03df6b38aabe0e8904217a285241db319677050f2921818" Jun 09 14:22:47.401679 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:22:47.401650 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-nxtq2\" is forbidden: User \"system:node:ip-10-0-138-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-120.ec2.internal' and this object" podUID="72327a93-6909-4019-a395-d11e959f5c94" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:47.408821 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:47.408802 2572 scope.go:117] "RemoveContainer" containerID="dc9476bfd8fd6d24b03df6b38aabe0e8904217a285241db319677050f2921818" Jun 09 14:22:47.409175 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:22:47.409154 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc9476bfd8fd6d24b03df6b38aabe0e8904217a285241db319677050f2921818\": container with ID starting with dc9476bfd8fd6d24b03df6b38aabe0e8904217a285241db319677050f2921818 not found: ID does not exist" containerID="dc9476bfd8fd6d24b03df6b38aabe0e8904217a285241db319677050f2921818" Jun 09 14:22:47.409234 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:47.409186 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc9476bfd8fd6d24b03df6b38aabe0e8904217a285241db319677050f2921818"} err="failed to get container status \"dc9476bfd8fd6d24b03df6b38aabe0e8904217a285241db319677050f2921818\": rpc error: code = NotFound desc = could not find container \"dc9476bfd8fd6d24b03df6b38aabe0e8904217a285241db319677050f2921818\": container with ID starting with dc9476bfd8fd6d24b03df6b38aabe0e8904217a285241db319677050f2921818 not found: ID does not exist" Jun 09 14:22:47.409925 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:22:47.409901 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-nxtq2\" is forbidden: User \"system:node:ip-10-0-138-120.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-120.ec2.internal' and this object" podUID="72327a93-6909-4019-a395-d11e959f5c94" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-nxtq2" Jun 09 14:22:48.031761 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:48.031724 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72327a93-6909-4019-a395-d11e959f5c94" path="/var/lib/kubelet/pods/72327a93-6909-4019-a395-d11e959f5c94/volumes" Jun 09 14:22:53.377294 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:53.377260 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2gdrm" Jun 09 14:22:57.401598 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:22:57.401562 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:23:09.693823 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:09.693785 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7"] Jun 09 14:23:09.694294 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:09.694016 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" podUID="c69007ad-8b23-48e8-99de-cd16ddb3410a" containerName="manager" containerID="cri-o://61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772" gracePeriod=10 Jun 09 14:23:09.935026 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:09.935002 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:23:10.082591 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.082516 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkpm2\" (UniqueName: \"kubernetes.io/projected/c69007ad-8b23-48e8-99de-cd16ddb3410a-kube-api-access-fkpm2\") pod \"c69007ad-8b23-48e8-99de-cd16ddb3410a\" (UID: \"c69007ad-8b23-48e8-99de-cd16ddb3410a\") " Jun 09 14:23:10.082730 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.082603 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c69007ad-8b23-48e8-99de-cd16ddb3410a-extensions-socket-volume\") pod \"c69007ad-8b23-48e8-99de-cd16ddb3410a\" (UID: \"c69007ad-8b23-48e8-99de-cd16ddb3410a\") " Jun 09 14:23:10.082968 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.082939 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69007ad-8b23-48e8-99de-cd16ddb3410a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c69007ad-8b23-48e8-99de-cd16ddb3410a" (UID: "c69007ad-8b23-48e8-99de-cd16ddb3410a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 14:23:10.084544 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.084518 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69007ad-8b23-48e8-99de-cd16ddb3410a-kube-api-access-fkpm2" (OuterVolumeSpecName: "kube-api-access-fkpm2") pod "c69007ad-8b23-48e8-99de-cd16ddb3410a" (UID: "c69007ad-8b23-48e8-99de-cd16ddb3410a"). InnerVolumeSpecName "kube-api-access-fkpm2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:23:10.183585 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.183553 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c69007ad-8b23-48e8-99de-cd16ddb3410a-extensions-socket-volume\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:23:10.183585 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.183579 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkpm2\" (UniqueName: \"kubernetes.io/projected/c69007ad-8b23-48e8-99de-cd16ddb3410a-kube-api-access-fkpm2\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:23:10.500435 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.500403 2572 generic.go:356] "Generic (PLEG): container finished" podID="c69007ad-8b23-48e8-99de-cd16ddb3410a" containerID="61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772" exitCode=0 Jun 09 14:23:10.500595 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.500452 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" Jun 09 14:23:10.500595 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.500480 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" event={"ID":"c69007ad-8b23-48e8-99de-cd16ddb3410a","Type":"ContainerDied","Data":"61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772"} Jun 09 14:23:10.500595 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.500520 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7" event={"ID":"c69007ad-8b23-48e8-99de-cd16ddb3410a","Type":"ContainerDied","Data":"0087b0ad0d10604ac869889d9a007de7b9d9287d43846d26b4fbfb9005fdc11a"} Jun 09 14:23:10.500595 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.500540 2572 scope.go:117] "RemoveContainer" containerID="61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772" Jun 09 14:23:10.509048 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.509030 2572 scope.go:117] "RemoveContainer" containerID="61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772" Jun 09 14:23:10.509285 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:23:10.509269 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772\": container with ID starting with 61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772 not found: ID does not exist" containerID="61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772" Jun 09 14:23:10.509335 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.509291 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772"} err="failed to get container status \"61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772\": rpc error: code = NotFound desc = could not find container \"61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772\": container with ID starting with 61cb1038c6ae7cea28605c7ab842b90db3553f591031da71019c75509ebca772 not found: ID does not exist" Jun 09 14:23:10.530558 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.530535 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7"] Jun 09 14:23:10.533490 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:10.533470 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-v5ck7"] Jun 09 14:23:12.032965 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:12.032930 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c69007ad-8b23-48e8-99de-cd16ddb3410a" path="/var/lib/kubelet/pods/c69007ad-8b23-48e8-99de-cd16ddb3410a/volumes" Jun 09 14:23:13.723477 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.723445 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks"] Jun 09 14:23:13.723992 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.723803 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69007ad-8b23-48e8-99de-cd16ddb3410a" containerName="manager" Jun 09 14:23:13.723992 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.723816 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69007ad-8b23-48e8-99de-cd16ddb3410a" containerName="manager" Jun 09 14:23:13.723992 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.723834 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72327a93-6909-4019-a395-d11e959f5c94" containerName="manager" Jun 09 14:23:13.723992 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.723842 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="72327a93-6909-4019-a395-d11e959f5c94" containerName="manager" Jun 09 14:23:13.723992 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.723894 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="72327a93-6909-4019-a395-d11e959f5c94" containerName="manager" Jun 09 14:23:13.723992 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.723903 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c69007ad-8b23-48e8-99de-cd16ddb3410a" containerName="manager" Jun 09 14:23:13.727034 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.727012 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.729587 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.729566 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fcwq5\"" Jun 09 14:23:13.747773 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.747745 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks"] Jun 09 14:23:13.813032 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.813001 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.813184 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.813081 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.813184 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.813141 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.813255 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.813212 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.813255 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.813236 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.813323 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.813252 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.813323 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.813312 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjr5x\" (UniqueName: \"kubernetes.io/projected/e5138eda-3b41-4f86-84f0-42b869d82cb7-kube-api-access-fjr5x\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.813385 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.813370 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.813418 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.813398 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5138eda-3b41-4f86-84f0-42b869d82cb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.914739 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.914710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.914890 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.914744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.914890 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.914765 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.914890 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.914787 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjr5x\" (UniqueName: \"kubernetes.io/projected/e5138eda-3b41-4f86-84f0-42b869d82cb7-kube-api-access-fjr5x\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.914890 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.914871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.915100 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.914913 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5138eda-3b41-4f86-84f0-42b869d82cb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.915100 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.914963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.915100 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.915009 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.915100 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.915077 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.915360 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.915202 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.915360 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.915338 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.915457 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.915367 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.915457 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.915410 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.915742 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.915721 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e5138eda-3b41-4f86-84f0-42b869d82cb7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.917270 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.917251 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.917467 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.917448 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.922639 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.922619 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjr5x\" (UniqueName: \"kubernetes.io/projected/e5138eda-3b41-4f86-84f0-42b869d82cb7-kube-api-access-fjr5x\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:13.922715 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:13.922696 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e5138eda-3b41-4f86-84f0-42b869d82cb7-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-7tbks\" (UID: \"e5138eda-3b41-4f86-84f0-42b869d82cb7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:14.039311 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:14.039236 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:14.177068 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:14.177040 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks"] Jun 09 14:23:14.179686 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:23:14.179661 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5138eda_3b41_4f86_84f0_42b869d82cb7.slice/crio-1bdce989140546983df91b848edea2fd800b60cbaae075bb9ef97d02ac13c2ae WatchSource:0}: Error finding container 1bdce989140546983df91b848edea2fd800b60cbaae075bb9ef97d02ac13c2ae: Status 404 returned error can't find the container with id 1bdce989140546983df91b848edea2fd800b60cbaae075bb9ef97d02ac13c2ae Jun 09 14:23:14.181672 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:14.181639 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 14:23:14.181736 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:14.181705 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 14:23:14.181772 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:14.181735 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 14:23:14.519707 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:14.519675 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" event={"ID":"e5138eda-3b41-4f86-84f0-42b869d82cb7","Type":"ContainerStarted","Data":"d8d4731bb059e44649f88164fd82d24ac04bbf65e21049d7b7a2a3de41b9a8ed"} Jun 09 14:23:14.519927 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:14.519739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" event={"ID":"e5138eda-3b41-4f86-84f0-42b869d82cb7","Type":"ContainerStarted","Data":"1bdce989140546983df91b848edea2fd800b60cbaae075bb9ef97d02ac13c2ae"} Jun 09 14:23:14.538807 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:14.538754 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" podStartSLOduration=1.538741118 podStartE2EDuration="1.538741118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:23:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:23:14.536791864 +0000 UTC m=+670.978991084" watchObservedRunningTime="2026-06-09 14:23:14.538741118 +0000 UTC m=+670.980940366" Jun 09 14:23:15.039952 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:15.039917 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:15.044790 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:15.044767 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:15.524161 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:15.524132 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:15.525189 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:15.525173 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:23:29.092737 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.092704 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdkjw"] Jun 09 14:23:29.095287 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.095264 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:29.097689 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.097666 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 14:23:29.097813 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.097772 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-wvdwj\"" Jun 09 14:23:29.103011 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.102987 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdkjw"] Jun 09 14:23:29.150101 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.150065 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hdrh\" (UniqueName: \"kubernetes.io/projected/f381f96b-4d44-4e00-a1f1-b80a998bb83b-kube-api-access-2hdrh\") pod \"limitador-limitador-64c94fd64f-vdkjw\" (UID: \"f381f96b-4d44-4e00-a1f1-b80a998bb83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:29.150304 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.150209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f381f96b-4d44-4e00-a1f1-b80a998bb83b-config-file\") pod \"limitador-limitador-64c94fd64f-vdkjw\" (UID: \"f381f96b-4d44-4e00-a1f1-b80a998bb83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:29.188982 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.188946 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdkjw"] Jun 09 14:23:29.251133 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.251080 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f381f96b-4d44-4e00-a1f1-b80a998bb83b-config-file\") pod \"limitador-limitador-64c94fd64f-vdkjw\" (UID: \"f381f96b-4d44-4e00-a1f1-b80a998bb83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:29.251307 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.251176 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hdrh\" (UniqueName: \"kubernetes.io/projected/f381f96b-4d44-4e00-a1f1-b80a998bb83b-kube-api-access-2hdrh\") pod \"limitador-limitador-64c94fd64f-vdkjw\" (UID: \"f381f96b-4d44-4e00-a1f1-b80a998bb83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:29.251808 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.251788 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f381f96b-4d44-4e00-a1f1-b80a998bb83b-config-file\") pod \"limitador-limitador-64c94fd64f-vdkjw\" (UID: \"f381f96b-4d44-4e00-a1f1-b80a998bb83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:29.258985 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.258962 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hdrh\" (UniqueName: \"kubernetes.io/projected/f381f96b-4d44-4e00-a1f1-b80a998bb83b-kube-api-access-2hdrh\") pod \"limitador-limitador-64c94fd64f-vdkjw\" (UID: \"f381f96b-4d44-4e00-a1f1-b80a998bb83b\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:29.406988 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.406907 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:29.533037 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.532948 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdkjw"] Jun 09 14:23:29.535435 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:23:29.535410 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf381f96b_4d44_4e00_a1f1_b80a998bb83b.slice/crio-67b59de83688fbe5d4fc3ca23bfbf89dc6cd84738dfc2946923af38357a05a80 WatchSource:0}: Error finding container 67b59de83688fbe5d4fc3ca23bfbf89dc6cd84738dfc2946923af38357a05a80: Status 404 returned error can't find the container with id 67b59de83688fbe5d4fc3ca23bfbf89dc6cd84738dfc2946923af38357a05a80 Jun 09 14:23:29.583202 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.583174 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" event={"ID":"f381f96b-4d44-4e00-a1f1-b80a998bb83b","Type":"ContainerStarted","Data":"67b59de83688fbe5d4fc3ca23bfbf89dc6cd84738dfc2946923af38357a05a80"} Jun 09 14:23:29.996599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.996556 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh4jn"] Jun 09 14:23:29.999721 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:29.999700 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nh4jn" Jun 09 14:23:30.002037 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:30.002019 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l7f74\"" Jun 09 14:23:30.006885 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:30.006858 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh4jn"] Jun 09 14:23:30.058388 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:30.058351 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvbd6\" (UniqueName: \"kubernetes.io/projected/c1e7c636-368b-49ae-9ef1-4fe9d6228473-kube-api-access-gvbd6\") pod \"authorino-75d556bd77-nh4jn\" (UID: \"c1e7c636-368b-49ae-9ef1-4fe9d6228473\") " pod="kuadrant-system/authorino-75d556bd77-nh4jn" Jun 09 14:23:30.159697 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:30.159661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvbd6\" (UniqueName: \"kubernetes.io/projected/c1e7c636-368b-49ae-9ef1-4fe9d6228473-kube-api-access-gvbd6\") pod \"authorino-75d556bd77-nh4jn\" (UID: \"c1e7c636-368b-49ae-9ef1-4fe9d6228473\") " pod="kuadrant-system/authorino-75d556bd77-nh4jn" Jun 09 14:23:30.167884 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:30.167849 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvbd6\" (UniqueName: \"kubernetes.io/projected/c1e7c636-368b-49ae-9ef1-4fe9d6228473-kube-api-access-gvbd6\") pod \"authorino-75d556bd77-nh4jn\" (UID: \"c1e7c636-368b-49ae-9ef1-4fe9d6228473\") " pod="kuadrant-system/authorino-75d556bd77-nh4jn" Jun 09 14:23:30.309809 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:30.309725 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nh4jn" Jun 09 14:23:30.489259 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:30.489040 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh4jn"] Jun 09 14:23:30.495999 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:23:30.495948 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc1e7c636_368b_49ae_9ef1_4fe9d6228473.slice/crio-082c65969227c43e6861b8789ef5bf71a8d19b9b0f8682de0044eb65dd8af1e5 WatchSource:0}: Error finding container 082c65969227c43e6861b8789ef5bf71a8d19b9b0f8682de0044eb65dd8af1e5: Status 404 returned error can't find the container with id 082c65969227c43e6861b8789ef5bf71a8d19b9b0f8682de0044eb65dd8af1e5 Jun 09 14:23:30.593127 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:30.592991 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nh4jn" event={"ID":"c1e7c636-368b-49ae-9ef1-4fe9d6228473","Type":"ContainerStarted","Data":"082c65969227c43e6861b8789ef5bf71a8d19b9b0f8682de0044eb65dd8af1e5"} Jun 09 14:23:34.617057 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:34.617012 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nh4jn" event={"ID":"c1e7c636-368b-49ae-9ef1-4fe9d6228473","Type":"ContainerStarted","Data":"c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0"} Jun 09 14:23:34.618632 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:34.618605 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" event={"ID":"f381f96b-4d44-4e00-a1f1-b80a998bb83b","Type":"ContainerStarted","Data":"7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8"} Jun 09 14:23:34.618741 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:34.618684 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:34.633949 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:34.633898 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-nh4jn" podStartSLOduration=1.904329523 podStartE2EDuration="5.633882008s" totalImagesPullingTime="3.729552485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:23:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:23:34.633830159 +0000 UTC m=+691.076029356" watchObservedRunningTime="2026-06-09 14:23:34.633882008 +0000 UTC m=+691.076081202" Jun 09 14:23:34.647857 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:34.647756 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" podStartSLOduration=1.015598615 podStartE2EDuration="5.647738289s" totalImagesPullingTime="4.632139674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:23:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:23:34.647346155 +0000 UTC m=+691.089545349" watchObservedRunningTime="2026-06-09 14:23:34.647738289 +0000 UTC m=+691.089937486" Jun 09 14:23:45.624902 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:45.624825 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:45.848034 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:45.847994 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdkjw"] Jun 09 14:23:45.848255 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:45.848218 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" podUID="f381f96b-4d44-4e00-a1f1-b80a998bb83b" containerName="limitador" containerID="cri-o://7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8" gracePeriod=30 Jun 09 14:23:46.402479 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.402456 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:46.512327 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.512285 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f381f96b-4d44-4e00-a1f1-b80a998bb83b-config-file\") pod \"f381f96b-4d44-4e00-a1f1-b80a998bb83b\" (UID: \"f381f96b-4d44-4e00-a1f1-b80a998bb83b\") " Jun 09 14:23:46.512529 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.512342 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hdrh\" (UniqueName: \"kubernetes.io/projected/f381f96b-4d44-4e00-a1f1-b80a998bb83b-kube-api-access-2hdrh\") pod \"f381f96b-4d44-4e00-a1f1-b80a998bb83b\" (UID: \"f381f96b-4d44-4e00-a1f1-b80a998bb83b\") " Jun 09 14:23:46.512725 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.512699 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f381f96b-4d44-4e00-a1f1-b80a998bb83b-config-file" (OuterVolumeSpecName: "config-file") pod "f381f96b-4d44-4e00-a1f1-b80a998bb83b" (UID: "f381f96b-4d44-4e00-a1f1-b80a998bb83b"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:23:46.514439 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.514420 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f381f96b-4d44-4e00-a1f1-b80a998bb83b-kube-api-access-2hdrh" (OuterVolumeSpecName: "kube-api-access-2hdrh") pod "f381f96b-4d44-4e00-a1f1-b80a998bb83b" (UID: "f381f96b-4d44-4e00-a1f1-b80a998bb83b"). InnerVolumeSpecName "kube-api-access-2hdrh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:23:46.613760 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.613732 2572 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f381f96b-4d44-4e00-a1f1-b80a998bb83b-config-file\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:23:46.613760 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.613757 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hdrh\" (UniqueName: \"kubernetes.io/projected/f381f96b-4d44-4e00-a1f1-b80a998bb83b-kube-api-access-2hdrh\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:23:46.673341 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.673309 2572 generic.go:356] "Generic (PLEG): container finished" podID="f381f96b-4d44-4e00-a1f1-b80a998bb83b" containerID="7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8" exitCode=0 Jun 09 14:23:46.673723 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.673355 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" Jun 09 14:23:46.673723 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.673394 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" event={"ID":"f381f96b-4d44-4e00-a1f1-b80a998bb83b","Type":"ContainerDied","Data":"7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8"} Jun 09 14:23:46.673723 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.673443 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-vdkjw" event={"ID":"f381f96b-4d44-4e00-a1f1-b80a998bb83b","Type":"ContainerDied","Data":"67b59de83688fbe5d4fc3ca23bfbf89dc6cd84738dfc2946923af38357a05a80"} Jun 09 14:23:46.673723 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.673463 2572 scope.go:117] "RemoveContainer" containerID="7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8" Jun 09 14:23:46.682253 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.682237 2572 scope.go:117] "RemoveContainer" containerID="7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8" Jun 09 14:23:46.682476 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:23:46.682460 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8\": container with ID starting with 7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8 not found: ID does not exist" containerID="7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8" Jun 09 14:23:46.682533 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.682487 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8"} err="failed to get container status \"7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8\": rpc error: code = NotFound desc = could not find container \"7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8\": container with ID starting with 7d62768d2a7c489808b16547bb9fd18efcc1de9d8a15bbd9f4f367695e5601e8 not found: ID does not exist" Jun 09 14:23:46.694867 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.694844 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdkjw"] Jun 09 14:23:46.700441 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:46.700421 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-vdkjw"] Jun 09 14:23:48.031915 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:48.031884 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f381f96b-4d44-4e00-a1f1-b80a998bb83b" path="/var/lib/kubelet/pods/f381f96b-4d44-4e00-a1f1-b80a998bb83b/volumes" Jun 09 14:23:49.426354 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.426322 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-4r2jf"] Jun 09 14:23:49.426792 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.426777 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f381f96b-4d44-4e00-a1f1-b80a998bb83b" containerName="limitador" Jun 09 14:23:49.426853 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.426796 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f381f96b-4d44-4e00-a1f1-b80a998bb83b" containerName="limitador" Jun 09 14:23:49.426912 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.426900 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f381f96b-4d44-4e00-a1f1-b80a998bb83b" containerName="limitador" Jun 09 14:23:49.431352 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.431326 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4r2jf" Jun 09 14:23:49.433678 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.433655 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 09 14:23:49.437130 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.437041 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4r2jf"] Jun 09 14:23:49.538360 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.538323 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzsgr\" (UniqueName: \"kubernetes.io/projected/303f8b02-6797-49de-bd90-9f4666d60bf0-kube-api-access-bzsgr\") pod \"postgres-69fb4594cf-4r2jf\" (UID: \"303f8b02-6797-49de-bd90-9f4666d60bf0\") " pod="opendatahub/postgres-69fb4594cf-4r2jf" Jun 09 14:23:49.538540 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.538385 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/303f8b02-6797-49de-bd90-9f4666d60bf0-data\") pod \"postgres-69fb4594cf-4r2jf\" (UID: \"303f8b02-6797-49de-bd90-9f4666d60bf0\") " pod="opendatahub/postgres-69fb4594cf-4r2jf" Jun 09 14:23:49.639088 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.639055 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzsgr\" (UniqueName: \"kubernetes.io/projected/303f8b02-6797-49de-bd90-9f4666d60bf0-kube-api-access-bzsgr\") pod \"postgres-69fb4594cf-4r2jf\" (UID: \"303f8b02-6797-49de-bd90-9f4666d60bf0\") " pod="opendatahub/postgres-69fb4594cf-4r2jf" Jun 09 14:23:49.639270 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.639139 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/303f8b02-6797-49de-bd90-9f4666d60bf0-data\") pod \"postgres-69fb4594cf-4r2jf\" (UID: \"303f8b02-6797-49de-bd90-9f4666d60bf0\") " pod="opendatahub/postgres-69fb4594cf-4r2jf" Jun 09 14:23:49.639463 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.639448 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/303f8b02-6797-49de-bd90-9f4666d60bf0-data\") pod \"postgres-69fb4594cf-4r2jf\" (UID: \"303f8b02-6797-49de-bd90-9f4666d60bf0\") " pod="opendatahub/postgres-69fb4594cf-4r2jf" Jun 09 14:23:49.646904 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.646881 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzsgr\" (UniqueName: \"kubernetes.io/projected/303f8b02-6797-49de-bd90-9f4666d60bf0-kube-api-access-bzsgr\") pod \"postgres-69fb4594cf-4r2jf\" (UID: \"303f8b02-6797-49de-bd90-9f4666d60bf0\") " pod="opendatahub/postgres-69fb4594cf-4r2jf" Jun 09 14:23:49.742496 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.742407 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-4r2jf" Jun 09 14:23:49.865308 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:49.865282 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-4r2jf"] Jun 09 14:23:49.867550 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:23:49.867522 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303f8b02_6797_49de_bd90_9f4666d60bf0.slice/crio-4badeab0fb184231412eea463500d33a8c0f54f1355468a325135b87c451b9f0 WatchSource:0}: Error finding container 4badeab0fb184231412eea463500d33a8c0f54f1355468a325135b87c451b9f0: Status 404 returned error can't find the container with id 4badeab0fb184231412eea463500d33a8c0f54f1355468a325135b87c451b9f0 Jun 09 14:23:50.691991 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:50.691958 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4r2jf" event={"ID":"303f8b02-6797-49de-bd90-9f4666d60bf0","Type":"ContainerStarted","Data":"4badeab0fb184231412eea463500d33a8c0f54f1355468a325135b87c451b9f0"} Jun 09 14:23:55.716509 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:55.716472 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-4r2jf" event={"ID":"303f8b02-6797-49de-bd90-9f4666d60bf0","Type":"ContainerStarted","Data":"0a09d3b820ea0f8b9e62ef567ed5668518f63dee3e373d65baf87420bbd64e0c"} Jun 09 14:23:55.717052 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:55.716597 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-4r2jf" Jun 09 14:23:55.733935 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:23:55.733882 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-4r2jf" podStartSLOduration=1.8661985429999999 podStartE2EDuration="6.733862306s" totalImagesPullingTime="4.867663763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:23:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:23:55.732652971 +0000 UTC m=+712.174852164" watchObservedRunningTime="2026-06-09 14:23:55.733862306 +0000 UTC m=+712.176061501" Jun 09 14:24:01.755602 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:01.755575 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-4r2jf" Jun 09 14:24:10.692179 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:10.692138 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-vnvdg"] Jun 09 14:24:10.713044 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:10.713012 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-vnvdg"] Jun 09 14:24:10.713227 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:10.713104 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-vnvdg" Jun 09 14:24:10.716405 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:10.716385 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-ggz2k\"" Jun 09 14:24:10.716549 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:10.716408 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 09 14:24:10.716699 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:10.716681 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 09 14:24:10.824070 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:10.824036 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4j2w\" (UniqueName: \"kubernetes.io/projected/556c03aa-8a07-4895-b940-16b875932c16-kube-api-access-d4j2w\") pod \"keycloak-operator-d67dbbb48-vnvdg\" (UID: \"556c03aa-8a07-4895-b940-16b875932c16\") " pod="keycloak-system/keycloak-operator-d67dbbb48-vnvdg" Jun 09 14:24:10.925464 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:10.925422 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4j2w\" (UniqueName: \"kubernetes.io/projected/556c03aa-8a07-4895-b940-16b875932c16-kube-api-access-d4j2w\") pod \"keycloak-operator-d67dbbb48-vnvdg\" (UID: \"556c03aa-8a07-4895-b940-16b875932c16\") " pod="keycloak-system/keycloak-operator-d67dbbb48-vnvdg" Jun 09 14:24:10.933704 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:10.933674 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4j2w\" (UniqueName: \"kubernetes.io/projected/556c03aa-8a07-4895-b940-16b875932c16-kube-api-access-d4j2w\") pod \"keycloak-operator-d67dbbb48-vnvdg\" (UID: \"556c03aa-8a07-4895-b940-16b875932c16\") " pod="keycloak-system/keycloak-operator-d67dbbb48-vnvdg" Jun 09 14:24:11.023245 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:11.023153 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-vnvdg" Jun 09 14:24:11.149445 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:11.149417 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-vnvdg"] Jun 09 14:24:11.151975 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:24:11.151947 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod556c03aa_8a07_4895_b940_16b875932c16.slice/crio-f4f3bce3a2cf5506ab5a23c38eb18cbedc0b8e281a2e7b4524749989ceb91af0 WatchSource:0}: Error finding container f4f3bce3a2cf5506ab5a23c38eb18cbedc0b8e281a2e7b4524749989ceb91af0: Status 404 returned error can't find the container with id f4f3bce3a2cf5506ab5a23c38eb18cbedc0b8e281a2e7b4524749989ceb91af0 Jun 09 14:24:11.792577 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:11.792537 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-vnvdg" event={"ID":"556c03aa-8a07-4895-b940-16b875932c16","Type":"ContainerStarted","Data":"f4f3bce3a2cf5506ab5a23c38eb18cbedc0b8e281a2e7b4524749989ceb91af0"} Jun 09 14:24:18.833585 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:18.833547 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-vnvdg" event={"ID":"556c03aa-8a07-4895-b940-16b875932c16","Type":"ContainerStarted","Data":"23a39606966c7d08e6e303284c1a0e3efb4463d93db8607fff426bd182fbb01c"} Jun 09 14:24:18.850599 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:18.850541 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-vnvdg" podStartSLOduration=1.856093815 podStartE2EDuration="8.850528157s" totalImagesPullingTime="6.994434342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:24:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:24:18.848612372 +0000 UTC m=+735.290811566" watchObservedRunningTime="2026-06-09 14:24:18.850528157 +0000 UTC m=+735.292727350" Jun 09 14:24:57.036635 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:57.036591 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c67b656fd-5r496"] Jun 09 14:24:57.044535 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:57.044513 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c67b656fd-5r496" Jun 09 14:24:57.046705 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:57.046681 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c67b656fd-5r496"] Jun 09 14:24:57.144020 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:57.143990 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npvbz\" (UniqueName: \"kubernetes.io/projected/d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e-kube-api-access-npvbz\") pod \"authorino-c67b656fd-5r496\" (UID: \"d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e\") " pod="kuadrant-system/authorino-c67b656fd-5r496" Jun 09 14:24:57.245036 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:57.244994 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npvbz\" (UniqueName: \"kubernetes.io/projected/d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e-kube-api-access-npvbz\") pod \"authorino-c67b656fd-5r496\" (UID: \"d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e\") " pod="kuadrant-system/authorino-c67b656fd-5r496" Jun 09 14:24:57.245234 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:57.245211 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c67b656fd-5r496"] Jun 09 14:24:57.245441 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:24:57.245419 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-npvbz], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-c67b656fd-5r496" podUID="d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e" Jun 09 14:24:57.254925 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:57.254904 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npvbz\" (UniqueName: \"kubernetes.io/projected/d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e-kube-api-access-npvbz\") pod \"authorino-c67b656fd-5r496\" (UID: \"d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e\") " pod="kuadrant-system/authorino-c67b656fd-5r496" Jun 09 14:24:58.001353 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:58.001322 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c67b656fd-5r496" Jun 09 14:24:58.007792 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:58.007767 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c67b656fd-5r496" Jun 09 14:24:58.152160 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:58.152104 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-npvbz\" (UniqueName: \"kubernetes.io/projected/d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e-kube-api-access-npvbz\") pod \"d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e\" (UID: \"d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e\") " Jun 09 14:24:58.154281 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:58.154257 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e-kube-api-access-npvbz" (OuterVolumeSpecName: "kube-api-access-npvbz") pod "d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e" (UID: "d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e"). InnerVolumeSpecName "kube-api-access-npvbz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:24:58.253369 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:58.253296 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-npvbz\" (UniqueName: \"kubernetes.io/projected/d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e-kube-api-access-npvbz\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:24:58.333842 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:58.333813 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh4jn"] Jun 09 14:24:58.333997 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:58.333975 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-nh4jn" podUID="c1e7c636-368b-49ae-9ef1-4fe9d6228473" containerName="authorino" containerID="cri-o://c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0" gracePeriod=30 Jun 09 14:24:58.581418 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:58.581396 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nh4jn" Jun 09 14:24:58.655933 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:58.655903 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvbd6\" (UniqueName: \"kubernetes.io/projected/c1e7c636-368b-49ae-9ef1-4fe9d6228473-kube-api-access-gvbd6\") pod \"c1e7c636-368b-49ae-9ef1-4fe9d6228473\" (UID: \"c1e7c636-368b-49ae-9ef1-4fe9d6228473\") " Jun 09 14:24:58.657919 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:58.657889 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e7c636-368b-49ae-9ef1-4fe9d6228473-kube-api-access-gvbd6" (OuterVolumeSpecName: "kube-api-access-gvbd6") pod "c1e7c636-368b-49ae-9ef1-4fe9d6228473" (UID: "c1e7c636-368b-49ae-9ef1-4fe9d6228473"). InnerVolumeSpecName "kube-api-access-gvbd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:24:58.757045 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:58.757007 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvbd6\" (UniqueName: \"kubernetes.io/projected/c1e7c636-368b-49ae-9ef1-4fe9d6228473-kube-api-access-gvbd6\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:24:59.007042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.007003 2572 generic.go:356] "Generic (PLEG): container finished" podID="c1e7c636-368b-49ae-9ef1-4fe9d6228473" containerID="c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0" exitCode=0 Jun 09 14:24:59.007042 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.007047 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-nh4jn" Jun 09 14:24:59.007327 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.007084 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nh4jn" event={"ID":"c1e7c636-368b-49ae-9ef1-4fe9d6228473","Type":"ContainerDied","Data":"c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0"} Jun 09 14:24:59.007327 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.007139 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-nh4jn" event={"ID":"c1e7c636-368b-49ae-9ef1-4fe9d6228473","Type":"ContainerDied","Data":"082c65969227c43e6861b8789ef5bf71a8d19b9b0f8682de0044eb65dd8af1e5"} Jun 09 14:24:59.007327 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.007157 2572 scope.go:117] "RemoveContainer" containerID="c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0" Jun 09 14:24:59.007327 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.007275 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c67b656fd-5r496" Jun 09 14:24:59.016162 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.016145 2572 scope.go:117] "RemoveContainer" containerID="c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0" Jun 09 14:24:59.016486 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:24:59.016462 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0\": container with ID starting with c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0 not found: ID does not exist" containerID="c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0" Jun 09 14:24:59.021227 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.016498 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0"} err="failed to get container status \"c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0\": rpc error: code = NotFound desc = could not find container \"c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0\": container with ID starting with c8516c53d191b5124fecd735ee436ab6cd0de0931577e93c3bfb56cdf0edaca0 not found: ID does not exist" Jun 09 14:24:59.034387 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.034365 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c67b656fd-5r496"] Jun 09 14:24:59.036299 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.036278 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c67b656fd-5r496"] Jun 09 14:24:59.044943 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.044923 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh4jn"] Jun 09 14:24:59.046940 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:24:59.046922 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-nh4jn"] Jun 09 14:25:00.031528 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:00.031497 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1e7c636-368b-49ae-9ef1-4fe9d6228473" path="/var/lib/kubelet/pods/c1e7c636-368b-49ae-9ef1-4fe9d6228473/volumes" Jun 09 14:25:00.031887 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:00.031805 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e" path="/var/lib/kubelet/pods/d2fd0ea1-f20a-4ddd-a5b6-26fa21f4890e/volumes" Jun 09 14:25:46.484794 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:46.484754 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7tbks container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": read tcp 10.133.0.2:50338->10.133.0.25:15021: read: connection reset by peer" start-of-body= Jun 09 14:25:46.485212 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:46.484867 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" podUID="e5138eda-3b41-4f86-84f0-42b869d82cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": read tcp 10.133.0.2:50338->10.133.0.25:15021: read: connection reset by peer" Jun 09 14:25:47.211913 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:47.211882 2572 generic.go:356] "Generic (PLEG): container finished" podID="e5138eda-3b41-4f86-84f0-42b869d82cb7" containerID="d8d4731bb059e44649f88164fd82d24ac04bbf65e21049d7b7a2a3de41b9a8ed" exitCode=0 Jun 09 14:25:47.212132 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:47.211963 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" event={"ID":"e5138eda-3b41-4f86-84f0-42b869d82cb7","Type":"ContainerDied","Data":"d8d4731bb059e44649f88164fd82d24ac04bbf65e21049d7b7a2a3de41b9a8ed"} Jun 09 14:25:47.212449 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:47.212425 2572 scope.go:117] "RemoveContainer" containerID="d8d4731bb059e44649f88164fd82d24ac04bbf65e21049d7b7a2a3de41b9a8ed" Jun 09 14:25:47.213399 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:47.213371 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 14:25:47.213458 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:47.213437 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 14:25:47.213492 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:47.213469 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 09 14:25:48.217641 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:48.217606 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" event={"ID":"e5138eda-3b41-4f86-84f0-42b869d82cb7","Type":"ContainerStarted","Data":"5d81cd007e9c96acedf3ac5e9f99e3ed2771bd6ecda093698e8378952b72501f"} Jun 09 14:25:49.040433 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:49.040403 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:25:49.040759 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:49.040738 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7tbks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 09 14:25:49.040898 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:49.040875 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" podUID="e5138eda-3b41-4f86-84f0-42b869d82cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 09 14:25:50.040198 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:50.040157 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7tbks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 09 14:25:50.040686 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:50.040220 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" podUID="e5138eda-3b41-4f86-84f0-42b869d82cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 09 14:25:51.040292 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:51.040252 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7tbks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 09 14:25:51.040862 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:51.040827 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" podUID="e5138eda-3b41-4f86-84f0-42b869d82cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 09 14:25:52.040354 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:52.040314 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-7tbks container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" start-of-body= Jun 09 14:25:52.040844 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:52.040384 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" podUID="e5138eda-3b41-4f86-84f0-42b869d82cb7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.25:15021/healthz/ready\": dial tcp 10.133.0.25:15021: connect: connection refused" Jun 09 14:25:53.045372 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:53.045342 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:25:53.045795 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:53.045601 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:25:53.046251 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:25:53.046233 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-7tbks" Jun 09 14:26:26.719050 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.719012 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-786bb67b68-j7d2r"] Jun 09 14:26:26.719566 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.719372 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e7c636-368b-49ae-9ef1-4fe9d6228473" containerName="authorino" Jun 09 14:26:26.719566 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.719385 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e7c636-368b-49ae-9ef1-4fe9d6228473" containerName="authorino" Jun 09 14:26:26.719566 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.719446 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e7c636-368b-49ae-9ef1-4fe9d6228473" containerName="authorino" Jun 09 14:26:26.722406 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.722390 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:26:26.725693 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.725670 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l7f74\"" Jun 09 14:26:26.725822 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.725670 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 14:26:26.725822 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.725671 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 14:26:26.730901 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.730878 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-786bb67b68-j7d2r"] Jun 09 14:26:26.803898 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.803847 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/076665de-c857-4358-9888-08c50d42a1db-tls-cert\") pod \"authorino-786bb67b68-j7d2r\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:26:26.803898 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.803897 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctjpl\" (UniqueName: \"kubernetes.io/projected/076665de-c857-4358-9888-08c50d42a1db-kube-api-access-ctjpl\") pod \"authorino-786bb67b68-j7d2r\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:26:26.804162 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.803966 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/076665de-c857-4358-9888-08c50d42a1db-oidc-ca\") pod \"authorino-786bb67b68-j7d2r\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:26:26.904412 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.904376 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/076665de-c857-4358-9888-08c50d42a1db-tls-cert\") pod \"authorino-786bb67b68-j7d2r\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:26:26.904607 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.904419 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctjpl\" (UniqueName: \"kubernetes.io/projected/076665de-c857-4358-9888-08c50d42a1db-kube-api-access-ctjpl\") pod \"authorino-786bb67b68-j7d2r\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:26:26.904607 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.904479 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/076665de-c857-4358-9888-08c50d42a1db-oidc-ca\") pod \"authorino-786bb67b68-j7d2r\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:26:26.905205 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.905181 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/076665de-c857-4358-9888-08c50d42a1db-oidc-ca\") pod \"authorino-786bb67b68-j7d2r\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:26:26.906749 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.906732 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/076665de-c857-4358-9888-08c50d42a1db-tls-cert\") pod \"authorino-786bb67b68-j7d2r\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:26:26.911615 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:26.911592 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctjpl\" (UniqueName: \"kubernetes.io/projected/076665de-c857-4358-9888-08c50d42a1db-kube-api-access-ctjpl\") pod \"authorino-786bb67b68-j7d2r\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:26:27.032404 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:27.032328 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:26:27.171838 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:27.171807 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-786bb67b68-j7d2r"] Jun 09 14:26:27.173475 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:26:27.173443 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod076665de_c857_4358_9888_08c50d42a1db.slice/crio-ca7972e0fd0da342882946fd81fe0ca893f83f0f23bbeae0893cc56b9ee7f7a8 WatchSource:0}: Error finding container ca7972e0fd0da342882946fd81fe0ca893f83f0f23bbeae0893cc56b9ee7f7a8: Status 404 returned error can't find the container with id ca7972e0fd0da342882946fd81fe0ca893f83f0f23bbeae0893cc56b9ee7f7a8 Jun 09 14:26:27.174765 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:27.174743 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:26:27.395387 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:27.395308 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786bb67b68-j7d2r" event={"ID":"076665de-c857-4358-9888-08c50d42a1db","Type":"ContainerStarted","Data":"ca7972e0fd0da342882946fd81fe0ca893f83f0f23bbeae0893cc56b9ee7f7a8"} Jun 09 14:26:28.407202 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:28.407168 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786bb67b68-j7d2r" event={"ID":"076665de-c857-4358-9888-08c50d42a1db","Type":"ContainerStarted","Data":"7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956"} Jun 09 14:26:28.421905 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:26:28.421859 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-786bb67b68-j7d2r" podStartSLOduration=2.090305645 podStartE2EDuration="2.421845454s" totalImagesPullingTime="331.539809ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:26:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:26:28.420576708 +0000 UTC m=+864.862775902" watchObservedRunningTime="2026-06-09 14:26:28.421845454 +0000 UTC m=+864.864044648" Jun 09 14:27:20.021622 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.021582 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk"] Jun 09 14:27:20.024819 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.024799 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.027537 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.027515 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 09 14:27:20.028423 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.028402 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 09 14:27:20.028554 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.028541 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vn2nc\"" Jun 09 14:27:20.028660 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.028641 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 09 14:27:20.035232 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.035201 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk"] Jun 09 14:27:20.140299 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.140242 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.140299 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.140297 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.140523 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.140356 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4r6g\" (UniqueName: \"kubernetes.io/projected/a23b4362-91ec-4e72-8d0d-261884010459-kube-api-access-h4r6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.140523 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.140488 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.140523 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.140513 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.140641 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.140538 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a23b4362-91ec-4e72-8d0d-261884010459-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.241555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.241516 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.241555 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.241556 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.241812 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.241574 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a23b4362-91ec-4e72-8d0d-261884010459-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.241812 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.241606 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.241812 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.241625 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.241812 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.241649 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4r6g\" (UniqueName: \"kubernetes.io/projected/a23b4362-91ec-4e72-8d0d-261884010459-kube-api-access-h4r6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.242049 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.242022 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.242131 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.242051 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.242131 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.242093 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.243801 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.243778 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a23b4362-91ec-4e72-8d0d-261884010459-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.244161 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.244142 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a23b4362-91ec-4e72-8d0d-261884010459-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.249582 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.249558 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4r6g\" (UniqueName: \"kubernetes.io/projected/a23b4362-91ec-4e72-8d0d-261884010459-kube-api-access-h4r6g\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk\" (UID: \"a23b4362-91ec-4e72-8d0d-261884010459\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.337334 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.337236 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:27:20.472121 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.472082 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk"] Jun 09 14:27:20.474760 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:27:20.474725 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda23b4362_91ec_4e72_8d0d_261884010459.slice/crio-45c236c10c660463d71e1184d6e7b39dafb5de286561754cb05c101c0c7c549f WatchSource:0}: Error finding container 45c236c10c660463d71e1184d6e7b39dafb5de286561754cb05c101c0c7c549f: Status 404 returned error can't find the container with id 45c236c10c660463d71e1184d6e7b39dafb5de286561754cb05c101c0c7c549f Jun 09 14:27:20.631793 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:20.631701 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" event={"ID":"a23b4362-91ec-4e72-8d0d-261884010459","Type":"ContainerStarted","Data":"45c236c10c660463d71e1184d6e7b39dafb5de286561754cb05c101c0c7c549f"} Jun 09 14:27:25.656605 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:27:25.656567 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" event={"ID":"a23b4362-91ec-4e72-8d0d-261884010459","Type":"ContainerStarted","Data":"08f325b4936a67ff89ba3f14fdca8e50cd5a14cac1c4a6d46dc890e83ba1a7e7"} Jun 09 14:28:18.888985 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:28:18.888903 2572 generic.go:356] "Generic (PLEG): container finished" podID="a23b4362-91ec-4e72-8d0d-261884010459" containerID="08f325b4936a67ff89ba3f14fdca8e50cd5a14cac1c4a6d46dc890e83ba1a7e7" exitCode=0 Jun 09 14:28:18.888985 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:28:18.888955 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" event={"ID":"a23b4362-91ec-4e72-8d0d-261884010459","Type":"ContainerDied","Data":"08f325b4936a67ff89ba3f14fdca8e50cd5a14cac1c4a6d46dc890e83ba1a7e7"} Jun 09 14:28:22.907413 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:28:22.907330 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" event={"ID":"a23b4362-91ec-4e72-8d0d-261884010459","Type":"ContainerStarted","Data":"5f1247bec3e1c42c8ebfd76c11a7bea170a7d712904d4ab41964e610a7975212"} Jun 09 14:28:22.928869 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:28:22.928823 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" podStartSLOduration=1.289036361 podStartE2EDuration="1m2.928807018s" totalImagesPullingTime="7.922134591s" totalInitContainerRuntime="53.717636066s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:27:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:28:22.926876822 +0000 UTC m=+979.369076015" watchObservedRunningTime="2026-06-09 14:28:22.928807018 +0000 UTC m=+979.371006210" Jun 09 14:28:30.337547 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:28:30.337512 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:28:30.338000 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:28:30.337604 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:28:30.350270 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:28:30.350247 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:28:30.954054 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:28:30.954021 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk" Jun 09 14:29:39.905035 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:39.905004 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-786bb67b68-j7d2r"] Jun 09 14:29:39.905535 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:39.905217 2572 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-786bb67b68-j7d2r" podUID="076665de-c857-4358-9888-08c50d42a1db" containerName="authorino" containerID="cri-o://7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956" gracePeriod=30 Jun 09 14:29:40.144556 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.144534 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:29:40.232271 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.232248 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctjpl\" (UniqueName: \"kubernetes.io/projected/076665de-c857-4358-9888-08c50d42a1db-kube-api-access-ctjpl\") pod \"076665de-c857-4358-9888-08c50d42a1db\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " Jun 09 14:29:40.232410 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.232363 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/076665de-c857-4358-9888-08c50d42a1db-tls-cert\") pod \"076665de-c857-4358-9888-08c50d42a1db\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " Jun 09 14:29:40.232410 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.232399 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/076665de-c857-4358-9888-08c50d42a1db-oidc-ca\") pod \"076665de-c857-4358-9888-08c50d42a1db\" (UID: \"076665de-c857-4358-9888-08c50d42a1db\") " Jun 09 14:29:40.234684 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.234659 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/076665de-c857-4358-9888-08c50d42a1db-kube-api-access-ctjpl" (OuterVolumeSpecName: "kube-api-access-ctjpl") pod "076665de-c857-4358-9888-08c50d42a1db" (UID: "076665de-c857-4358-9888-08c50d42a1db"). InnerVolumeSpecName "kube-api-access-ctjpl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:29:40.237156 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.237100 2572 generic.go:356] "Generic (PLEG): container finished" podID="076665de-c857-4358-9888-08c50d42a1db" containerID="7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956" exitCode=0 Jun 09 14:29:40.237260 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.237167 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786bb67b68-j7d2r" Jun 09 14:29:40.237260 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.237166 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786bb67b68-j7d2r" event={"ID":"076665de-c857-4358-9888-08c50d42a1db","Type":"ContainerDied","Data":"7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956"} Jun 09 14:29:40.237366 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.237290 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786bb67b68-j7d2r" event={"ID":"076665de-c857-4358-9888-08c50d42a1db","Type":"ContainerDied","Data":"ca7972e0fd0da342882946fd81fe0ca893f83f0f23bbeae0893cc56b9ee7f7a8"} Jun 09 14:29:40.237366 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.237317 2572 scope.go:117] "RemoveContainer" containerID="7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956" Jun 09 14:29:40.237876 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.237848 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/076665de-c857-4358-9888-08c50d42a1db-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "076665de-c857-4358-9888-08c50d42a1db" (UID: "076665de-c857-4358-9888-08c50d42a1db"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 14:29:40.242278 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.242257 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/076665de-c857-4358-9888-08c50d42a1db-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "076665de-c857-4358-9888-08c50d42a1db" (UID: "076665de-c857-4358-9888-08c50d42a1db"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 14:29:40.251654 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.251637 2572 scope.go:117] "RemoveContainer" containerID="7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956" Jun 09 14:29:40.251923 ip-10-0-138-120 kubenswrapper[2572]: E0609 14:29:40.251906 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956\": container with ID starting with 7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956 not found: ID does not exist" containerID="7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956" Jun 09 14:29:40.251971 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.251935 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956"} err="failed to get container status \"7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956\": rpc error: code = NotFound desc = could not find container \"7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956\": container with ID starting with 7a07f023bcda85cff18eb3666c5a5fc754fec4d1114bc3f655352306f3fa9956 not found: ID does not exist" Jun 09 14:29:40.333511 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.333467 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctjpl\" (UniqueName: \"kubernetes.io/projected/076665de-c857-4358-9888-08c50d42a1db-kube-api-access-ctjpl\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:29:40.333511 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.333508 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/076665de-c857-4358-9888-08c50d42a1db-tls-cert\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:29:40.333700 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.333539 2572 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/076665de-c857-4358-9888-08c50d42a1db-oidc-ca\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:29:40.557790 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.557762 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-786bb67b68-j7d2r"] Jun 09 14:29:40.560734 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:40.560710 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-786bb67b68-j7d2r"] Jun 09 14:29:42.032074 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:29:42.032003 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="076665de-c857-4358-9888-08c50d42a1db" path="/var/lib/kubelet/pods/076665de-c857-4358-9888-08c50d42a1db/volumes" Jun 09 14:30:00.138016 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.137953 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29683590-tcqkm"] Jun 09 14:30:00.138405 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.138272 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="076665de-c857-4358-9888-08c50d42a1db" containerName="authorino" Jun 09 14:30:00.138405 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.138283 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="076665de-c857-4358-9888-08c50d42a1db" containerName="authorino" Jun 09 14:30:00.138405 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.138352 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="076665de-c857-4358-9888-08c50d42a1db" containerName="authorino" Jun 09 14:30:00.140452 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.140435 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" Jun 09 14:30:00.142704 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.142676 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-n4xdg\"" Jun 09 14:30:00.147960 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.147939 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683590-tcqkm"] Jun 09 14:30:00.294967 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.294937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fzxr\" (UniqueName: \"kubernetes.io/projected/38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6-kube-api-access-4fzxr\") pod \"maas-api-key-cleanup-29683590-tcqkm\" (UID: \"38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6\") " pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" Jun 09 14:30:00.395609 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.395540 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fzxr\" (UniqueName: \"kubernetes.io/projected/38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6-kube-api-access-4fzxr\") pod \"maas-api-key-cleanup-29683590-tcqkm\" (UID: \"38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6\") " pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" Jun 09 14:30:00.404298 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.404274 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fzxr\" (UniqueName: \"kubernetes.io/projected/38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6-kube-api-access-4fzxr\") pod \"maas-api-key-cleanup-29683590-tcqkm\" (UID: \"38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6\") " pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" Jun 09 14:30:00.450812 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.450791 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" Jun 09 14:30:00.573684 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:00.573657 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683590-tcqkm"] Jun 09 14:30:00.575347 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:30:00.575324 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38cd6410_4e3d_40ab_a6fc_f8d7d77c63e6.slice/crio-d4d96853be5bea704448affd44430cea397dd45019b54f8452fb2df414de3d0c WatchSource:0}: Error finding container d4d96853be5bea704448affd44430cea397dd45019b54f8452fb2df414de3d0c: Status 404 returned error can't find the container with id d4d96853be5bea704448affd44430cea397dd45019b54f8452fb2df414de3d0c Jun 09 14:30:01.327557 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:01.327519 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" event={"ID":"38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6","Type":"ContainerStarted","Data":"d4d96853be5bea704448affd44430cea397dd45019b54f8452fb2df414de3d0c"} Jun 09 14:30:03.337863 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:03.337829 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" event={"ID":"38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6","Type":"ContainerStarted","Data":"0837603ed201f70a555ca96aa705fa814797bf440f0d896e187a2cfd50b7b4d2"} Jun 09 14:30:03.353350 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:03.353301 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" podStartSLOduration=1.375499603 podStartE2EDuration="3.353287585s" totalImagesPullingTime="1.977787982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:30:03.352436226 +0000 UTC m=+1079.794635419" watchObservedRunningTime="2026-06-09 14:30:03.353287585 +0000 UTC m=+1079.795486777" Jun 09 14:30:04.343340 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:04.343250 2572 generic.go:356] "Generic (PLEG): container finished" podID="38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6" containerID="0837603ed201f70a555ca96aa705fa814797bf440f0d896e187a2cfd50b7b4d2" exitCode=0 Jun 09 14:30:04.343340 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:04.343299 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" event={"ID":"38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6","Type":"ContainerDied","Data":"0837603ed201f70a555ca96aa705fa814797bf440f0d896e187a2cfd50b7b4d2"} Jun 09 14:30:05.471319 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:05.471297 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" Jun 09 14:30:05.639680 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:05.639656 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fzxr\" (UniqueName: \"kubernetes.io/projected/38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6-kube-api-access-4fzxr\") pod \"38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6\" (UID: \"38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6\") " Jun 09 14:30:05.641776 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:05.641753 2572 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6-kube-api-access-4fzxr" (OuterVolumeSpecName: "kube-api-access-4fzxr") pod "38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6" (UID: "38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6"). InnerVolumeSpecName "kube-api-access-4fzxr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 14:30:05.740574 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:05.740550 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fzxr\" (UniqueName: \"kubernetes.io/projected/38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6-kube-api-access-4fzxr\") on node \"ip-10-0-138-120.ec2.internal\" DevicePath \"\"" Jun 09 14:30:06.353075 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:06.353007 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" Jun 09 14:30:06.353220 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:06.353010 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683590-tcqkm" event={"ID":"38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6","Type":"ContainerDied","Data":"d4d96853be5bea704448affd44430cea397dd45019b54f8452fb2df414de3d0c"} Jun 09 14:30:06.353220 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:30:06.353142 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d4d96853be5bea704448affd44430cea397dd45019b54f8452fb2df414de3d0c" Jun 09 14:35:14.693583 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:14.693553 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-986494677-29zf7_a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8/nginx/0.log" Jun 09 14:35:15.261847 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:15.261824 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683590-tcqkm_38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6/cleanup/0.log" Jun 09 14:35:15.856019 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:15.855991 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c57c599f5-d2pvd_b57be5ab-3895-4b9b-983e-f13c6b9cf6d9/copy-manifests/0.log" Jun 09 14:35:15.868184 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:15.868158 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c57c599f5-d2pvd_b57be5ab-3895-4b9b-983e-f13c6b9cf6d9/manager/0.log" Jun 09 14:35:16.093595 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:16.093566 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4r2jf_303f8b02-6797-49de-bd90-9f4666d60bf0/postgres/0.log" Jun 09 14:35:17.619681 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:17.619655 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qzw8z_125a67fb-c6f9-4b35-8e2c-ede2d9899f54/manager/0.log" Jun 09 14:35:17.851511 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:17.851481 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lrgtl_82f5a84a-4d0e-4019-bf46-5b096beee6b0/registry-server/0.log" Jun 09 14:35:18.220126 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:18.220072 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2gdrm_e84f654f-6a06-463b-8842-4bd5d7bcaa30/manager/0.log" Jun 09 14:35:18.567860 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:18.567780 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f979548kwj_93d13f6f-8473-40ef-96e6-17a191150ff3/istio-proxy/0.log" Jun 09 14:35:19.028952 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:19.028923 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7tbks_e5138eda-3b41-4f86-84f0-42b869d82cb7/istio-proxy/1.log" Jun 09 14:35:20.099329 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:20.099302 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk_a23b4362-91ec-4e72-8d0d-261884010459/storage-initializer/0.log" Jun 09 14:35:20.106203 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:20.106173 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ctwrsk_a23b4362-91ec-4e72-8d0d-261884010459/main/0.log" Jun 09 14:35:24.919348 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:24.919312 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mncq/must-gather-prbt4"] Jun 09 14:35:24.919718 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:24.919670 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6" containerName="cleanup" Jun 09 14:35:24.919718 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:24.919683 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6" containerName="cleanup" Jun 09 14:35:24.919789 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:24.919744 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6" containerName="cleanup" Jun 09 14:35:24.922897 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:24.922882 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mncq/must-gather-prbt4" Jun 09 14:35:24.925218 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:24.925197 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mncq\"/\"openshift-service-ca.crt\"" Jun 09 14:35:24.925312 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:24.925252 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mncq\"/\"kube-root-ca.crt\"" Jun 09 14:35:24.925374 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:24.925357 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8mncq\"/\"default-dockercfg-l4ftw\"" Jun 09 14:35:24.930928 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:24.930906 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mncq/must-gather-prbt4"] Jun 09 14:35:25.036591 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:25.036555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/48128c18-88cd-4a9c-9950-875c11a94b74-must-gather-output\") pod \"must-gather-prbt4\" (UID: \"48128c18-88cd-4a9c-9950-875c11a94b74\") " pod="openshift-must-gather-8mncq/must-gather-prbt4" Jun 09 14:35:25.036756 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:25.036636 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d47zq\" (UniqueName: \"kubernetes.io/projected/48128c18-88cd-4a9c-9950-875c11a94b74-kube-api-access-d47zq\") pod \"must-gather-prbt4\" (UID: \"48128c18-88cd-4a9c-9950-875c11a94b74\") " pod="openshift-must-gather-8mncq/must-gather-prbt4" Jun 09 14:35:25.137838 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:25.137813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d47zq\" (UniqueName: \"kubernetes.io/projected/48128c18-88cd-4a9c-9950-875c11a94b74-kube-api-access-d47zq\") pod \"must-gather-prbt4\" (UID: \"48128c18-88cd-4a9c-9950-875c11a94b74\") " pod="openshift-must-gather-8mncq/must-gather-prbt4" Jun 09 14:35:25.138021 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:25.137856 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/48128c18-88cd-4a9c-9950-875c11a94b74-must-gather-output\") pod \"must-gather-prbt4\" (UID: \"48128c18-88cd-4a9c-9950-875c11a94b74\") " pod="openshift-must-gather-8mncq/must-gather-prbt4" Jun 09 14:35:25.138170 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:25.138150 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/48128c18-88cd-4a9c-9950-875c11a94b74-must-gather-output\") pod \"must-gather-prbt4\" (UID: \"48128c18-88cd-4a9c-9950-875c11a94b74\") " pod="openshift-must-gather-8mncq/must-gather-prbt4" Jun 09 14:35:25.148460 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:25.148434 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d47zq\" (UniqueName: \"kubernetes.io/projected/48128c18-88cd-4a9c-9950-875c11a94b74-kube-api-access-d47zq\") pod \"must-gather-prbt4\" (UID: \"48128c18-88cd-4a9c-9950-875c11a94b74\") " pod="openshift-must-gather-8mncq/must-gather-prbt4" Jun 09 14:35:25.232534 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:25.232502 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mncq/must-gather-prbt4" Jun 09 14:35:25.362041 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:25.362018 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mncq/must-gather-prbt4"] Jun 09 14:35:25.364168 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:35:25.364143 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48128c18_88cd_4a9c_9950_875c11a94b74.slice/crio-7aeaa18a31d41fde3fd0f3da565da78ec861ef2734cf956f7ab4f745e53f1dda WatchSource:0}: Error finding container 7aeaa18a31d41fde3fd0f3da565da78ec861ef2734cf956f7ab4f745e53f1dda: Status 404 returned error can't find the container with id 7aeaa18a31d41fde3fd0f3da565da78ec861ef2734cf956f7ab4f745e53f1dda Jun 09 14:35:25.365954 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:25.365938 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 14:35:25.748897 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:25.748863 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mncq/must-gather-prbt4" event={"ID":"48128c18-88cd-4a9c-9950-875c11a94b74","Type":"ContainerStarted","Data":"7aeaa18a31d41fde3fd0f3da565da78ec861ef2734cf956f7ab4f745e53f1dda"} Jun 09 14:35:26.759076 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:26.759040 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mncq/must-gather-prbt4" event={"ID":"48128c18-88cd-4a9c-9950-875c11a94b74","Type":"ContainerStarted","Data":"3f95ca8259a3b428dff06256e74c89ee65bfe02920b0487c15bb51da41107973"} Jun 09 14:35:26.759546 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:26.759101 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mncq/must-gather-prbt4" event={"ID":"48128c18-88cd-4a9c-9950-875c11a94b74","Type":"ContainerStarted","Data":"d8f3d4b61608edd700b85974e3b9a614ce7b077fc5f2b344b184145810eb5941"} Jun 09 14:35:26.776316 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:26.776260 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8mncq/must-gather-prbt4" podStartSLOduration=1.811372107 podStartE2EDuration="2.776240989s" totalImagesPullingTime="964.868882ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 14:35:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:35:26.773336104 +0000 UTC m=+1403.215535298" watchObservedRunningTime="2026-06-09 14:35:26.776240989 +0000 UTC m=+1403.218440185" Jun 09 14:35:28.020966 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:28.020917 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vzbm9_b9a106a4-e64e-494f-8759-ae6dfe56384f/global-pull-secret-syncer/0.log" Jun 09 14:35:28.092767 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:28.092739 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-dddlm_2a937b25-9644-43ec-8712-bda95709a011/konnectivity-agent/0.log" Jun 09 14:35:28.176102 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:28.176072 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-120.ec2.internal_16b6c839f3f5f672e5e6038ba9c6104d/haproxy/0.log" Jun 09 14:35:33.261697 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:33.261661 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qzw8z_125a67fb-c6f9-4b35-8e2c-ede2d9899f54/manager/0.log" Jun 09 14:35:33.321162 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:33.321127 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lrgtl_82f5a84a-4d0e-4019-bf46-5b096beee6b0/registry-server/0.log" Jun 09 14:35:33.435065 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:33.435030 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2gdrm_e84f654f-6a06-463b-8842-4bd5d7bcaa30/manager/0.log" Jun 09 14:35:35.514858 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:35.514688 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7d7f496f9c-d52hb_03da0534-ef50-4227-8e3e-4360a236b262/metrics-server/0.log" Jun 09 14:35:35.569719 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:35.569690 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jc6sm_4ec412d0-d8df-49a4-aac4-93a70a1791c2/node-exporter/0.log" Jun 09 14:35:35.588203 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:35.588175 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jc6sm_4ec412d0-d8df-49a4-aac4-93a70a1791c2/kube-rbac-proxy/0.log" Jun 09 14:35:35.618547 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:35.618519 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jc6sm_4ec412d0-d8df-49a4-aac4-93a70a1791c2/init-textfile/0.log" Jun 09 14:35:35.881047 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:35.880965 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfddd949-cc38-4858-8661-fdfbcd3e1b09/prometheus/0.log" Jun 09 14:35:35.900880 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:35.900837 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfddd949-cc38-4858-8661-fdfbcd3e1b09/config-reloader/0.log" Jun 09 14:35:35.924448 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:35.924422 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfddd949-cc38-4858-8661-fdfbcd3e1b09/thanos-sidecar/0.log" Jun 09 14:35:35.942613 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:35.942588 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfddd949-cc38-4858-8661-fdfbcd3e1b09/kube-rbac-proxy-web/0.log" Jun 09 14:35:35.962923 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:35.962882 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfddd949-cc38-4858-8661-fdfbcd3e1b09/kube-rbac-proxy/0.log" Jun 09 14:35:35.982427 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:35.982404 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfddd949-cc38-4858-8661-fdfbcd3e1b09/kube-rbac-proxy-thanos/0.log" Jun 09 14:35:36.001583 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:36.001558 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_cfddd949-cc38-4858-8661-fdfbcd3e1b09/init-config-reloader/0.log" Jun 09 14:35:38.540804 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.540767 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4"] Jun 09 14:35:38.547242 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.547203 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.554387 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.554348 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4"] Jun 09 14:35:38.672825 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.672791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-sys\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.673172 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.673150 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-proc\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.673388 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.673371 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-podres\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.673557 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.673539 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-lib-modules\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.673724 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.673707 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqvc5\" (UniqueName: \"kubernetes.io/projected/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-kube-api-access-wqvc5\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.775352 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.775307 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-podres\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.775631 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.775608 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-lib-modules\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.775770 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.775754 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqvc5\" (UniqueName: \"kubernetes.io/projected/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-kube-api-access-wqvc5\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.775924 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.775907 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-sys\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.776065 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.776051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-proc\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.776223 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.775773 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-lib-modules\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.776338 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.775643 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-podres\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.776338 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.776222 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-proc\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.776475 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.776231 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-sys\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.785180 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.785154 2572 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqvc5\" (UniqueName: \"kubernetes.io/projected/b3bc5faa-16d4-4416-853f-0ab1cf9dead7-kube-api-access-wqvc5\") pod \"perf-node-gather-daemonset-7bch4\" (UID: \"b3bc5faa-16d4-4416-853f-0ab1cf9dead7\") " pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:38.865438 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:38.865347 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:39.040549 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:39.040406 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4"] Jun 09 14:35:39.043434 ip-10-0-138-120 kubenswrapper[2572]: W0609 14:35:39.043404 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb3bc5faa_16d4_4416_853f_0ab1cf9dead7.slice/crio-95102a88800f366cb8032429f99d390d30e1effba3f60ebc28e04a1c9b05e456 WatchSource:0}: Error finding container 95102a88800f366cb8032429f99d390d30e1effba3f60ebc28e04a1c9b05e456: Status 404 returned error can't find the container with id 95102a88800f366cb8032429f99d390d30e1effba3f60ebc28e04a1c9b05e456 Jun 09 14:35:39.850032 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:39.849992 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" event={"ID":"b3bc5faa-16d4-4416-853f-0ab1cf9dead7","Type":"ContainerStarted","Data":"881befb8e9eddb1d16232c6eb2128b9913b9bc3bbeb8c2c5c5702d652dbf36f6"} Jun 09 14:35:39.850478 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:39.850099 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" event={"ID":"b3bc5faa-16d4-4416-853f-0ab1cf9dead7","Type":"ContainerStarted","Data":"95102a88800f366cb8032429f99d390d30e1effba3f60ebc28e04a1c9b05e456"} Jun 09 14:35:39.850478 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:39.850246 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:39.866017 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:39.865971 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" podStartSLOduration=1.865955332 podStartE2EDuration="1.865955332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 14:35:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 14:35:39.864941824 +0000 UTC m=+1416.307141019" watchObservedRunningTime="2026-06-09 14:35:39.865955332 +0000 UTC m=+1416.308154525" Jun 09 14:35:40.492320 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:40.492286 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgsqh_e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0/dns/0.log" Jun 09 14:35:40.515853 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:40.515827 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bgsqh_e61d37e4-3fba-4fb6-99a7-c9639fcbc9f0/kube-rbac-proxy/0.log" Jun 09 14:35:40.598019 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:40.597993 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6qlj7_c0fe143e-02b1-4866-a4bd-a271ef19ec97/dns-node-resolver/0.log" Jun 09 14:35:41.204325 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:41.204243 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xqjzs_10f9c799-543d-4af0-81b4-3457e301f3bb/node-ca/0.log" Jun 09 14:35:42.107718 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:42.107687 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f979548kwj_93d13f6f-8473-40ef-96e6-17a191150ff3/istio-proxy/0.log" Jun 09 14:35:42.257453 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:42.257422 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7tbks_e5138eda-3b41-4f86-84f0-42b869d82cb7/istio-proxy/0.log" Jun 09 14:35:42.270483 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:42.270462 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7tbks_e5138eda-3b41-4f86-84f0-42b869d82cb7/istio-proxy/1.log" Jun 09 14:35:42.974692 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:42.974664 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n4g6d_550ca9c4-bb68-4966-86db-fc75333f1114/serve-healthcheck-canary/0.log" Jun 09 14:35:43.601960 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:43.601929 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jcdzw_fff11e01-5d1e-44dd-99d4-650e1c39e5df/kube-rbac-proxy/0.log" Jun 09 14:35:43.665559 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:43.665531 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jcdzw_fff11e01-5d1e-44dd-99d4-650e1c39e5df/exporter/0.log" Jun 09 14:35:43.702228 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:43.702193 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jcdzw_fff11e01-5d1e-44dd-99d4-650e1c39e5df/extractor/0.log" Jun 09 14:35:45.865565 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:45.865537 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8mncq/perf-node-gather-daemonset-7bch4" Jun 09 14:35:45.877359 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:45.877334 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-986494677-29zf7_a1eb6f85-e99d-4f5f-9953-3e73ae1eb8c8/nginx/0.log" Jun 09 14:35:46.063458 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:46.063424 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683590-tcqkm_38cd6410-4e3d-40ab-a6fc-f8d7d77c63e6/cleanup/0.log" Jun 09 14:35:46.337798 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:46.337761 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c57c599f5-d2pvd_b57be5ab-3895-4b9b-983e-f13c6b9cf6d9/manager/0.log" Jun 09 14:35:46.354005 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:46.353981 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c57c599f5-d2pvd_b57be5ab-3895-4b9b-983e-f13c6b9cf6d9/copy-manifests/0.log" Jun 09 14:35:46.430386 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:46.430351 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-4r2jf_303f8b02-6797-49de-bd90-9f4666d60bf0/postgres/0.log" Jun 09 14:35:48.143058 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:48.142903 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-65d785dc9d-dswp9_f4bb6c41-630a-4108-9058-5ef010eaa0a9/manager/0.log" Jun 09 14:35:52.558234 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:52.558183 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f979548kwj_93d13f6f-8473-40ef-96e6-17a191150ff3/istio-proxy/0.log" Jun 09 14:35:52.645421 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:52.645396 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7tbks_e5138eda-3b41-4f86-84f0-42b869d82cb7/istio-proxy/0.log" Jun 09 14:35:52.658711 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:52.658686 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7tbks_e5138eda-3b41-4f86-84f0-42b869d82cb7/istio-proxy/1.log" Jun 09 14:35:53.765438 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:53.765413 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f979548kwj_93d13f6f-8473-40ef-96e6-17a191150ff3/istio-proxy/0.log" Jun 09 14:35:53.868689 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:53.868646 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7tbks_e5138eda-3b41-4f86-84f0-42b869d82cb7/istio-proxy/0.log" Jun 09 14:35:53.881272 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:53.881248 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7tbks_e5138eda-3b41-4f86-84f0-42b869d82cb7/istio-proxy/1.log" Jun 09 14:35:54.739863 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:54.739833 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-49t44_50bde0a0-6d0a-41eb-a773-c5f817a072e2/kube-multus/0.log" Jun 09 14:35:54.811494 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:54.811467 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2x4xx_cca38f39-2d09-446e-95b3-4cf9acdd3fba/kube-multus-additional-cni-plugins/0.log" Jun 09 14:35:54.842569 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:54.842535 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2x4xx_cca38f39-2d09-446e-95b3-4cf9acdd3fba/egress-router-binary-copy/0.log" Jun 09 14:35:54.876307 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:54.876280 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2x4xx_cca38f39-2d09-446e-95b3-4cf9acdd3fba/cni-plugins/0.log" Jun 09 14:35:54.906493 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:54.906473 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2x4xx_cca38f39-2d09-446e-95b3-4cf9acdd3fba/bond-cni-plugin/0.log" Jun 09 14:35:54.931286 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:54.931214 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2x4xx_cca38f39-2d09-446e-95b3-4cf9acdd3fba/routeoverride-cni/0.log" Jun 09 14:35:54.970274 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:54.970245 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2x4xx_cca38f39-2d09-446e-95b3-4cf9acdd3fba/whereabouts-cni-bincopy/0.log" Jun 09 14:35:55.002547 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:55.002483 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-2x4xx_cca38f39-2d09-446e-95b3-4cf9acdd3fba/whereabouts-cni/0.log" Jun 09 14:35:55.471135 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:55.471064 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f979548kwj_93d13f6f-8473-40ef-96e6-17a191150ff3/istio-proxy/0.log" Jun 09 14:35:55.654690 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:55.654661 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7tbks_e5138eda-3b41-4f86-84f0-42b869d82cb7/istio-proxy/0.log" Jun 09 14:35:55.666575 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:55.666546 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nhcwv_02bc8053-f2b2-4d78-b65d-573a14482c57/network-metrics-daemon/0.log" Jun 09 14:35:55.668417 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:55.668357 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-7tbks_e5138eda-3b41-4f86-84f0-42b869d82cb7/istio-proxy/1.log" Jun 09 14:35:55.687748 ip-10-0-138-120 kubenswrapper[2572]: I0609 14:35:55.687726 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-nhcwv_02bc8053-f2b2-4d78-b65d-573a14482c57/kube-rbac-proxy/0.log"