Jun 08 13:01:20.889952 ip-10-0-128-189 systemd[1]: Starting Kubernetes Kubelet... Jun 08 13:01:21.348741 ip-10-0-128-189 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:01:21.348741 ip-10-0-128-189 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 08 13:01:21.348741 ip-10-0-128-189 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:01:21.348741 ip-10-0-128-189 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 08 13:01:21.348741 ip-10-0-128-189 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 08 13:01:21.350825 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.350733 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 08 13:01:21.354253 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354237 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.354253 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354254 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354257 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354261 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354264 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354268 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354271 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354274 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354277 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354280 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354282 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354285 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354288 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354290 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354293 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354296 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354299 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354302 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354304 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354307 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354311 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.354322 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354313 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354316 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354318 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354321 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354324 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354327 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354330 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354332 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354336 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354340 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354344 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354347 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354350 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354352 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354355 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354358 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354361 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354364 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354368 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.354831 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354372 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354375 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354378 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354380 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354383 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354386 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354388 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354391 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354394 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354396 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354399 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354403 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354405 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354408 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354411 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354416 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354419 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354421 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354424 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.355297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354428 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354432 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354435 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354438 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354441 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354444 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354446 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354449 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354451 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354454 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354457 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354460 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354463 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354466 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354468 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354471 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354474 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354476 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354479 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354481 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.355814 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354492 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354495 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354497 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354500 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354502 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354505 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354508 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354511 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354515 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354518 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354520 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354523 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354526 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354529 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354532 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354534 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354537 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354539 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354542 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.354544 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.356297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356279 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356287 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356290 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356293 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356297 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356301 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356304 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356307 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356310 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356313 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356315 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356318 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356321 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356323 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356326 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356329 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356332 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356335 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356337 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356340 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.356797 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356342 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356345 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356348 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356350 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356353 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356356 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356360 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356364 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356367 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356369 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356372 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356374 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356377 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356380 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356383 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356386 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356389 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356392 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356395 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356398 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.357294 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356401 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356404 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356407 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356411 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356414 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356417 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356420 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356423 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356426 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356429 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356431 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356434 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356437 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356440 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356443 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356446 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356449 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356452 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356456 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.357822 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356458 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356461 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356464 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356467 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356471 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356475 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356477 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356480 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356483 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356486 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356488 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356491 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356494 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356496 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356499 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356502 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356504 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356507 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356509 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.358297 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356511 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356516 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356519 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356522 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356525 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356528 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356530 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356533 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356535 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356537 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356540 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356546 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356549 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356552 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356554 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356557 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356574 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356577 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356580 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356583 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.358798 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356585 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.356999 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357004 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357009 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357011 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357015 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357018 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357021 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357024 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357027 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357030 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357033 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357036 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357039 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357043 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357047 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357050 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357053 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357056 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.359284 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357059 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357062 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357065 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357068 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357072 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357077 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357081 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357084 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357087 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357090 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357094 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357097 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357099 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357102 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357105 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357107 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357110 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357112 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357115 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357118 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.359767 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357121 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357124 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357127 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357129 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357132 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357134 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357137 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357139 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357142 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357145 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357148 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357151 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357153 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357156 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357158 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357161 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357165 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357168 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357170 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357172 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.360371 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357175 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357178 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357180 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357183 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357185 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357188 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357190 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357193 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357196 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357198 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357202 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357204 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357207 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357210 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357212 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357214 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357217 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357220 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357222 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357225 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.360885 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357227 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357230 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357233 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357235 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357239 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357243 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357246 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357248 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357252 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357255 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357258 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357261 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357263 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357266 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357269 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357271 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357274 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357277 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357280 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357283 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.361377 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.357285 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357361 2563 flags.go:64] FLAG: --address="0.0.0.0" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357377 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357393 2563 flags.go:64] FLAG: --anonymous-auth="true" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357403 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357412 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357417 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357424 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357431 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357434 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357437 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357441 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357444 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357448 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357451 2563 flags.go:64] FLAG: --cgroup-root="" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357454 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357458 2563 flags.go:64] FLAG: --client-ca-file="" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357461 2563 flags.go:64] FLAG: --cloud-provider="external" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357464 2563 flags.go:64] FLAG: --cluster-dns="[]" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357469 2563 flags.go:64] FLAG: --cluster-domain="" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357473 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357476 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357479 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357483 2563 flags.go:64] FLAG: --container-log-max-files="5" Jun 08 13:01:21.361879 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357487 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357491 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357494 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357497 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357500 2563 flags.go:64] FLAG: --contention-profiling="false" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357503 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357506 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357510 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357513 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357517 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357520 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357523 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357526 2563 flags.go:64] FLAG: --enable-load-reader="false" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357529 2563 flags.go:64] FLAG: --enable-server="true" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357532 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357536 2563 flags.go:64] FLAG: --event-burst="100" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357540 2563 flags.go:64] FLAG: --event-qps="50" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357543 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357546 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357549 2563 flags.go:64] FLAG: --eviction-hard="" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357555 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357558 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357572 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357576 2563 flags.go:64] FLAG: --eviction-soft="" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357579 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 08 13:01:21.362457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357582 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357585 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357588 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357592 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357595 2563 flags.go:64] FLAG: --fail-swap-on="true" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357598 2563 flags.go:64] FLAG: --feature-gates="" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357602 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357605 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357608 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357611 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357615 2563 flags.go:64] FLAG: --healthz-port="10248" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357618 2563 flags.go:64] FLAG: --help="false" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357621 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357624 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357627 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357630 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357634 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357637 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357640 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357643 2563 flags.go:64] FLAG: --image-service-endpoint="" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357646 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357649 2563 flags.go:64] FLAG: --kube-api-burst="100" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357653 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357656 2563 flags.go:64] FLAG: --kube-api-qps="50" Jun 08 13:01:21.363140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357659 2563 flags.go:64] FLAG: --kube-reserved="" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357662 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357665 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357670 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357673 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357675 2563 flags.go:64] FLAG: --lock-file="" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357678 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357681 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357684 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357690 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357693 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357696 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357699 2563 flags.go:64] FLAG: --logging-format="text" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357702 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357705 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357708 2563 flags.go:64] FLAG: --manifest-url="" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357711 2563 flags.go:64] FLAG: --manifest-url-header="" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357716 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357719 2563 flags.go:64] FLAG: --max-open-files="1000000" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357724 2563 flags.go:64] FLAG: --max-pods="110" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357727 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357730 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357733 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357736 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357739 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 08 13:01:21.363748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357742 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357745 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357753 2563 flags.go:64] FLAG: --node-status-max-images="50" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357756 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357759 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357762 2563 flags.go:64] FLAG: --pod-cidr="" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357766 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357772 2563 flags.go:64] FLAG: --pod-manifest-path="" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357775 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357778 2563 flags.go:64] FLAG: --pods-per-core="0" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357781 2563 flags.go:64] FLAG: --port="10250" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357786 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357789 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-069a95ee24c9b77cc" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357792 2563 flags.go:64] FLAG: --qos-reserved="" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357796 2563 flags.go:64] FLAG: --read-only-port="10255" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357799 2563 flags.go:64] FLAG: --register-node="true" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357802 2563 flags.go:64] FLAG: --register-with-taints="" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357806 2563 flags.go:64] FLAG: --registry-burst="10" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357809 2563 flags.go:64] FLAG: --registry-qps="5" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357812 2563 flags.go:64] FLAG: --reserved-cpus="" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357815 2563 flags.go:64] FLAG: --reserved-memory="" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357819 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357822 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357825 2563 flags.go:64] FLAG: --rotate-certificates="false" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357828 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 08 13:01:21.364389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357831 2563 flags.go:64] FLAG: --runonce="false" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357835 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357838 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357841 2563 flags.go:64] FLAG: --seccomp-default="false" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357844 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357847 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357850 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357853 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357856 2563 flags.go:64] FLAG: --storage-driver-password="root" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357859 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357862 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357865 2563 flags.go:64] FLAG: --storage-driver-user="root" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357868 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357871 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357874 2563 flags.go:64] FLAG: --system-cgroups="" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357877 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357882 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357885 2563 flags.go:64] FLAG: --tls-cert-file="" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357890 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357894 2563 flags.go:64] FLAG: --tls-min-version="" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357897 2563 flags.go:64] FLAG: --tls-private-key-file="" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357900 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357903 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357906 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357911 2563 flags.go:64] FLAG: --v="2" Jun 08 13:01:21.365016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357915 2563 flags.go:64] FLAG: --version="false" Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357922 2563 flags.go:64] FLAG: --vmodule="" Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357925 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.357929 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358044 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358048 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358051 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358054 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358057 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358060 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358063 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358066 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358068 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358071 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358074 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358076 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358079 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358082 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358085 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358089 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.365648 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358092 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358095 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358099 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358101 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358105 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358109 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358112 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358115 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358117 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358120 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358122 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358126 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358129 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358132 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358135 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358137 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358141 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358144 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358147 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358150 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.366133 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358153 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358156 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358158 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358161 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358164 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358167 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358170 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358173 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358175 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358178 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358180 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358184 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358186 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358189 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358192 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358195 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358198 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358202 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358205 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.366661 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358209 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358212 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358215 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358218 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358223 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358226 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358229 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358233 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358237 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358240 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358242 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358245 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358248 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358250 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358253 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358256 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358259 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358261 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358264 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358267 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.367129 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358269 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358272 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358274 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358277 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358280 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358282 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358285 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358288 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358290 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358294 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358298 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358301 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358304 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358307 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358310 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358313 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358317 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358320 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358323 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358325 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.367667 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358328 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358330 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358333 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.358336 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.358929 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.365641 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.365772 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.366529 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.366536 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366613 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366621 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366626 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366629 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366633 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.368157 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366636 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366639 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366642 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366645 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366649 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366654 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366658 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366661 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366664 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366667 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366670 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366673 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366676 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366679 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366681 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366684 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366687 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366690 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366693 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366696 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.368498 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366698 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366701 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366704 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366706 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366710 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366713 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366716 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366718 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366721 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366725 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366729 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366733 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366738 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366740 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366743 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366746 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366748 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366751 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366753 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366756 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.368997 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366758 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366761 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366764 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366766 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366769 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366772 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366776 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366780 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366783 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366786 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366789 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366792 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366795 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366798 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366802 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366807 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366812 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366816 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366819 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.369490 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366822 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366825 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366828 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366831 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366834 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366837 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366839 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366843 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366847 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366850 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366853 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366855 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366858 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366861 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366863 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366866 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366869 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366871 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366874 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366877 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.370026 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366881 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366886 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366890 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366893 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366896 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366898 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366901 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366904 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366907 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366910 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366912 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366915 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366918 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366921 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.366923 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.370525 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.366928 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367053 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367059 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367062 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367065 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367068 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367071 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367074 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367076 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367080 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367083 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367085 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367088 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367090 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367093 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367096 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367098 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367101 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367103 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367106 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 08 13:01:21.370917 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367111 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367115 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367119 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367123 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367126 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367128 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367131 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367133 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367136 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367140 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367142 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367146 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367151 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367154 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367156 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367159 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367162 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367164 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367167 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367169 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 08 13:01:21.371420 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367173 2563 feature_gate.go:328] unrecognized feature gate: Example Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367175 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367178 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367180 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367183 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367187 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367191 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367195 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367199 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367202 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367204 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367207 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367210 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367213 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367215 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367218 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367221 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367223 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367226 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367228 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 08 13:01:21.371998 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367231 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367234 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367237 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367239 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367242 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367245 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367247 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367250 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367253 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367256 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367258 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367261 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367266 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367270 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367274 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367277 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367280 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367282 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367285 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367288 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 08 13:01:21.372869 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367290 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367292 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367296 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367298 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367302 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367306 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367309 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367313 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367316 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367319 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367322 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367325 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367328 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367330 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367333 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367336 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367340 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367344 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367349 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 08 13:01:21.373584 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:21.367353 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 08 13:01:21.374056 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.367358 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 08 13:01:21.374056 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.367472 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jun 08 13:01:21.374056 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.369644 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 08 13:01:21.374056 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.371058 2563 server.go:1019] "Starting client certificate rotation" Jun 08 13:01:21.374056 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.371168 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:01:21.374056 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.371206 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 08 13:01:21.374872 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.374855 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:01:21.376322 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.376306 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 08 13:01:21.389909 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.389887 2563 log.go:25] "Validated CRI v1 runtime API" Jun 08 13:01:21.392916 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.392897 2563 log.go:25] "Validated CRI v1 image API" Jun 08 13:01:21.393689 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.393669 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 08 13:01:21.396249 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.396229 2563 fs.go:135] Filesystem UUIDs: map[6ecc6bef-2a6b-46d5-9119-e50126d5c184:/dev/nvme0n1p4 788eb83e-c409-44f2-95f7-92cf7221e118:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 08 13:01:21.396323 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.396248 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 08 13:01:21.402958 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.402845 2563 manager.go:216] Machine: {Timestamp:2026-06-08 13:01:21.401280287 +0000 UTC m=+0.370579811 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3084314 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec276650bb08b1b888bd7285959c38fb SystemUUID:ec276650-bb08-b1b8-88bd-7285959c38fb BootID:46bcdc97-e054-4e86-ab11-c5b549d5a517 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:03:fd:ed:27:8d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:03:fd:ed:27:8d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:98:40:92:af:c0 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 08 13:01:21.402958 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.402956 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 08 13:01:21.403079 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.403039 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 08 13:01:21.405900 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.405873 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 08 13:01:21.406036 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.405903 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 08 13:01:21.406592 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.406581 2563 topology_manager.go:138] "Creating topology manager with none policy" Jun 08 13:01:21.406632 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.406594 2563 container_manager_linux.go:309] "Creating device plugin manager" Jun 08 13:01:21.406632 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.406602 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:01:21.406632 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.406617 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 08 13:01:21.407481 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.407471 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 08 13:01:21.410227 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.410213 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:01:21.410344 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.410335 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 08 13:01:21.410380 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.410364 2563 kubelet.go:486] "Attempting to sync node with API server" Jun 08 13:01:21.410411 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.410379 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 08 13:01:21.410411 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.410404 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 08 13:01:21.410469 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.410417 2563 kubelet.go:398] "Adding apiserver pod source" Jun 08 13:01:21.410469 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.410429 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 08 13:01:21.410843 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.410824 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:01:21.410901 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.410862 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:01:21.410901 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.410880 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 08 13:01:21.413000 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.412979 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 08 13:01:21.416788 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.416771 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 08 13:01:21.416871 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.416804 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 08 13:01:21.417553 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417540 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 08 13:01:21.417624 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417574 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 08 13:01:21.417624 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417586 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 08 13:01:21.417624 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417595 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 08 13:01:21.417624 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417605 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 08 13:01:21.417624 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417617 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 08 13:01:21.417753 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417627 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 08 13:01:21.417753 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417634 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 08 13:01:21.417753 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417643 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 08 13:01:21.417753 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417664 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 08 13:01:21.417753 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417687 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 08 13:01:21.417753 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.417694 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 08 13:01:21.419278 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.419261 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 08 13:01:21.419321 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.419289 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 08 13:01:21.422444 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.422428 2563 server.go:1268] "Started kubelet" Jun 08 13:01:21.422558 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.422505 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 08 13:01:21.422627 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.422537 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 08 13:01:21.422627 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.422607 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 08 13:01:21.422927 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.422902 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 08 13:01:21.423000 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.422980 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 08 13:01:21.423054 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.423036 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 08 13:01:21.423429 ip-10-0-128-189 systemd[1]: Started Kubernetes Kubelet. Jun 08 13:01:21.424467 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.424455 2563 server.go:310] "Adding debug handlers to kubelet server" Jun 08 13:01:21.424762 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.424745 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 08 13:01:21.429735 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.428693 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b71ca70b43614d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.422401869 +0000 UTC m=+0.391701392,LastTimestamp:2026-06-08 13:01:21.422401869 +0000 UTC m=+0.391701392,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 08 13:01:21.430012 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.429986 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 08 13:01:21.431687 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.431673 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 08 13:01:21.431773 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.431678 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 08 13:01:21.431818 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.431789 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:21.432493 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.432477 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 08 13:01:21.432641 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.432622 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 08 13:01:21.432734 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.432480 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 08 13:01:21.432772 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.432735 2563 factory.go:55] Registering systemd factory Jun 08 13:01:21.432772 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.432751 2563 factory.go:223] Registration of the systemd container factory successfully Jun 08 13:01:21.432772 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.432748 2563 reconstruct.go:97] "Volume reconstruction finished" Jun 08 13:01:21.432772 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.432767 2563 reconciler.go:29] "Reconciler: start to sync state" Jun 08 13:01:21.432948 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.432935 2563 factory.go:153] Registering CRI-O factory Jun 08 13:01:21.432979 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.432954 2563 factory.go:223] Registration of the crio container factory successfully Jun 08 13:01:21.433019 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.433008 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 08 13:01:21.433050 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.433038 2563 factory.go:103] Registering Raw factory Jun 08 13:01:21.433081 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.433055 2563 manager.go:1196] Started watching for new ooms in manager Jun 08 13:01:21.433458 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.433445 2563 manager.go:349] Starting recovery of all containers Jun 08 13:01:21.440789 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.440761 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 08 13:01:21.443734 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.443717 2563 manager.go:354] Recovery completed Jun 08 13:01:21.446347 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.446050 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 08 13:01:21.449533 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.449520 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.451373 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.451344 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.451464 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.451392 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.451464 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.451407 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.452033 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.452018 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 08 13:01:21.452033 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.452031 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 08 13:01:21.452166 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.452047 2563 state_mem.go:36] "Initialized new in-memory state store" Jun 08 13:01:21.452166 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.452057 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.452779 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.452761 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.452864 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.452792 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.452864 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.452807 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.453275 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.453262 2563 policy_none.go:49] "None policy: Start" Jun 08 13:01:21.453338 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.453281 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 08 13:01:21.453338 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.453294 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 08 13:01:21.454502 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.454488 2563 policy_none.go:47] "Start" Jun 08 13:01:21.458744 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.458651 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b71ca70cfd75e7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.451374055 +0000 UTC m=+0.420673581,LastTimestamp:2026-06-08 13:01:21.451374055 +0000 UTC m=+0.420673581,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 08 13:01:21.462743 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.462657 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b71ca70cfdd5c9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.451398601 +0000 UTC m=+0.420698124,LastTimestamp:2026-06-08 13:01:21.451398601 +0000 UTC m=+0.420698124,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 08 13:01:21.472448 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.472367 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b71ca70cfe0cb7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.451412663 +0000 UTC m=+0.420712186,LastTimestamp:2026-06-08 13:01:21.451412663 +0000 UTC m=+0.420712186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 08 13:01:21.482509 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.482446 2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b71ca70cfd75e7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b71ca70cfd75e7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.451374055 +0000 UTC m=+0.420673581,LastTimestamp:2026-06-08 13:01:21.452778099 +0000 UTC m=+0.422077625,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 08 13:01:21.483180 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.483168 2563 manager.go:337] "Starting Device Plugin manager" Jun 08 13:01:21.483266 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.483250 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 08 13:01:21.483323 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.483269 2563 server.go:87] "Starting device plugin registration server" Jun 08 13:01:21.483595 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.483582 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 08 13:01:21.483685 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.483596 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 08 13:01:21.483740 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.483683 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 08 13:01:21.483792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.483777 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 08 13:01:21.483792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.483786 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 08 13:01:21.484334 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.484316 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 08 13:01:21.484407 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.484373 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:21.511324 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.497811 2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b71ca70cfdd5c9\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b71ca70cfdd5c9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.451398601 +0000 UTC m=+0.420698124,LastTimestamp:2026-06-08 13:01:21.452798964 +0000 UTC m=+0.422098487,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 08 13:01:21.511324 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.505942 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 08 13:01:21.511324 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.507434 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 08 13:01:21.511324 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.507466 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 08 13:01:21.511324 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.507488 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jun 08 13:01:21.511324 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.507553 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 08 13:01:21.511609 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.511309 2563 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-189.ec2.internal.18b71ca70cfe0cb7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b71ca70cfe0cb7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-189.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.451412663 +0000 UTC m=+0.420712186,LastTimestamp:2026-06-08 13:01:21.452812026 +0000 UTC m=+0.422111548,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 08 13:01:21.511609 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.511421 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.RuntimeClass: runtimeclasses.node.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"runtimeclasses\" in API group \"node.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" Jun 08 13:01:21.537242 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.537170 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-189.ec2.internal.18b71ca70f08bb7d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-189.ec2.internal,UID:ip-10-0-128-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-128-189.ec2.internal,},FirstTimestamp:2026-06-08 13:01:21.485667197 +0000 UTC m=+0.454966711,LastTimestamp:2026-06-08 13:01:21.485667197 +0000 UTC m=+0.454966711,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-189.ec2.internal,}" Jun 08 13:01:21.537775 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.537758 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t9zvx" Jun 08 13:01:21.546460 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.546446 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-t9zvx" Jun 08 13:01:21.584236 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.584197 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.585230 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.585211 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.585301 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.585242 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.585301 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.585252 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.585301 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.585275 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.603112 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.603051 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.603112 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.603077 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-189.ec2.internal\": node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:21.608316 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.608299 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal"] Jun 08 13:01:21.608391 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.608356 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.609876 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.609861 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.609936 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.609892 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.609936 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.609906 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.611204 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.611191 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.611313 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.611290 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.611352 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.611328 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.611917 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.611894 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.611917 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.611902 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.612014 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.611923 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.612014 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.611937 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.612014 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.611923 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.612014 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.611998 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.613356 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.613341 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.613409 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.613374 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:21.614509 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.614492 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:21.614612 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.614519 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:21.614612 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.614530 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:21.618587 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.618556 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:21.637370 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.637348 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.641998 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.641980 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-189.ec2.internal\" not found" node="ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.719514 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.719480 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:21.734370 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.734341 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b822f9bdfa2fcbf7b4f9b49cbdbc240a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"b822f9bdfa2fcbf7b4f9b49cbdbc240a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.734370 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.734374 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b822f9bdfa2fcbf7b4f9b49cbdbc240a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"b822f9bdfa2fcbf7b4f9b49cbdbc240a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.734557 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.734391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9319054885e1e5afa5f2ef4b4f79adf8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-189.ec2.internal\" (UID: \"9319054885e1e5afa5f2ef4b4f79adf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.820099 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.820067 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:21.835412 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.835384 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b822f9bdfa2fcbf7b4f9b49cbdbc240a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"b822f9bdfa2fcbf7b4f9b49cbdbc240a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.835510 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.835416 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b822f9bdfa2fcbf7b4f9b49cbdbc240a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"b822f9bdfa2fcbf7b4f9b49cbdbc240a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.835510 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.835433 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9319054885e1e5afa5f2ef4b4f79adf8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-189.ec2.internal\" (UID: \"9319054885e1e5afa5f2ef4b4f79adf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.835510 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.835483 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b822f9bdfa2fcbf7b4f9b49cbdbc240a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"b822f9bdfa2fcbf7b4f9b49cbdbc240a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.835510 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.835485 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/b822f9bdfa2fcbf7b4f9b49cbdbc240a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal\" (UID: \"b822f9bdfa2fcbf7b4f9b49cbdbc240a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.835674 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.835530 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9319054885e1e5afa5f2ef4b4f79adf8-config\") pod \"kube-apiserver-proxy-ip-10-0-128-189.ec2.internal\" (UID: \"9319054885e1e5afa5f2ef4b4f79adf8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.920977 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:21.920896 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:21.941417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.941390 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 08 13:01:21.946258 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:21.946239 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 08 13:01:22.021277 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:22.021226 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:22.121790 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:22.121755 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:22.222349 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:22.222255 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:22.322811 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:22.322778 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:22.370272 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.370237 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 08 13:01:22.423755 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:22.423724 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:22.503498 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.503304 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:22.510014 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:22.509984 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9319054885e1e5afa5f2ef4b4f79adf8.slice/crio-56570c86f0eb38dcd31d055319ec60dc5e0bd3b02f2cc6a1efad977ab5d81e3a WatchSource:0}: Error finding container 56570c86f0eb38dcd31d055319ec60dc5e0bd3b02f2cc6a1efad977ab5d81e3a: Status 404 returned error can't find the container with id 56570c86f0eb38dcd31d055319ec60dc5e0bd3b02f2cc6a1efad977ab5d81e3a Jun 08 13:01:22.510455 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:22.510428 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb822f9bdfa2fcbf7b4f9b49cbdbc240a.slice/crio-6f9b7b5ed5ed5894e6361a168afaded48fae381e0451a3d15d57ddba0b619f35 WatchSource:0}: Error finding container 6f9b7b5ed5ed5894e6361a168afaded48fae381e0451a3d15d57ddba0b619f35: Status 404 returned error can't find the container with id 6f9b7b5ed5ed5894e6361a168afaded48fae381e0451a3d15d57ddba0b619f35 Jun 08 13:01:22.515754 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.515735 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:01:22.524836 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:22.524820 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:22.548193 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.548162 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-07 12:56:21 +0000 UTC" deadline="2028-01-28 23:56:58.289041535 +0000 UTC" Jun 08 13:01:22.548193 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.548190 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14386h55m35.740854441s" Jun 08 13:01:22.571379 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.571350 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 08 13:01:22.572358 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.572343 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientMemory" Jun 08 13:01:22.572460 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.572375 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasNoDiskPressure" Jun 08 13:01:22.572460 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.572389 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeHasSufficientPID" Jun 08 13:01:22.625907 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:22.625864 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:22.726370 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:22.726323 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:22.826954 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:22.826868 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-189.ec2.internal\" not found" Jun 08 13:01:22.895414 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.895380 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:22.932368 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.932340 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" Jun 08 13:01:22.951205 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.951166 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:01:22.952689 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.952662 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" Jun 08 13:01:22.964754 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:22.964650 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 08 13:01:23.026661 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.026628 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:23.096052 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.095963 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 08 13:01:23.412196 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.412118 2563 apiserver.go:52] "Watching apiserver" Jun 08 13:01:23.419067 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.419042 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 08 13:01:23.419428 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.419407 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal","openshift-multus/multus-additional-cni-plugins-wqvxc","openshift-multus/network-metrics-daemon-8wxnn","openshift-network-operator/iptables-alerter-lhgpn","openshift-ovn-kubernetes/ovnkube-node-mgn84","kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8kzzj","openshift-dns/node-resolver-qwjck","openshift-image-registry/node-ca-wk4st","openshift-multus/multus-5897v","openshift-network-diagnostics/network-check-target-nh6j9","kube-system/global-pull-secret-syncer-b4rvp","kube-system/konnectivity-agent-thf4s"] Jun 08 13:01:23.421045 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.421026 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wk4st" Jun 08 13:01:23.422118 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.422098 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:23.422233 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:23.422173 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:23.423278 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.423257 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.423728 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.423403 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 08 13:01:23.423728 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.423464 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-czqpr\"" Jun 08 13:01:23.423728 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.423473 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.423728 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.423655 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.424865 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.424845 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:23.424965 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:23.424912 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:23.425593 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.425556 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 08 13:01:23.425690 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.425669 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.425831 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.425808 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 08 13:01:23.425987 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.425940 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.425987 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.425953 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 08 13:01:23.426119 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.425995 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-99px5\"" Jun 08 13:01:23.427335 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.427321 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lhgpn" Jun 08 13:01:23.429424 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.429406 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.429829 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.429808 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-497wg\"" Jun 08 13:01:23.429934 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.429917 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.430043 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.429977 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 08 13:01:23.430129 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.430113 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.431592 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.431545 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qwjck" Jun 08 13:01:23.432078 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.432056 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 08 13:01:23.432263 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.432243 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 08 13:01:23.432767 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.432656 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9fhl7\"" Jun 08 13:01:23.432767 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.432669 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.433716 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.433698 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 08 13:01:23.434124 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.434108 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 08 13:01:23.434216 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.434174 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 08 13:01:23.434276 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.434213 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.434941 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.434912 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:23.435350 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.435331 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nfl2d\"" Jun 08 13:01:23.435683 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.435668 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.436121 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.436101 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.437664 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.437632 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 08 13:01:23.437960 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.437941 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.438341 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.438324 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 08 13:01:23.438410 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.438384 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gkrht\"" Jun 08 13:01:23.440451 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.440357 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.440451 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.440371 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.440451 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.440436 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9x4f6\"" Jun 08 13:01:23.440901 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.440885 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.442085 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.442066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5897v" Jun 08 13:01:23.442892 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.442873 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 08 13:01:23.442982 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.442913 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 08 13:01:23.443304 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.443184 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jjcmf\"" Jun 08 13:01:23.443304 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.443293 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 08 13:01:23.443745 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.443727 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:23.443820 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:23.443790 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:23.443902 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.443886 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-cnibin\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.443954 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.443918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-ovnkube-config\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.443954 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.443943 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-kubelet-config\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:23.444053 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444008 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-cni-bin\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444053 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444034 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-env-overrides\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444155 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444058 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-kubernetes\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.444155 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444091 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-host\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.444155 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444111 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e04f1b8-a81d-4bfa-87ef-91242730bb29-host\") pod \"node-ca-wk4st\" (UID: \"2e04f1b8-a81d-4bfa-87ef-91242730bb29\") " pod="openshift-image-registry/node-ca-wk4st" Jun 08 13:01:23.444155 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444125 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkj7k\" (UniqueName: \"kubernetes.io/projected/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-kube-api-access-mkj7k\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444155 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444139 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5da6b63f-b154-4354-850a-76474e8a26c9-agent-certs\") pod \"konnectivity-agent-thf4s\" (UID: \"5da6b63f-b154-4354-850a-76474e8a26c9\") " pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:23.444390 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-sysctl-conf\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.444390 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444189 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-log-socket\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444390 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444218 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:23.444390 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-systemd-units\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444390 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444253 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-ovnkube-script-lib\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444390 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-systemd\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.444390 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444308 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-dbus\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:23.444390 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-run-ovn\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444390 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-sysconfig\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444409 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x9n7\" (UniqueName: \"kubernetes.io/projected/2e04f1b8-a81d-4bfa-87ef-91242730bb29-kube-api-access-4x9n7\") pod \"node-ca-wk4st\" (UID: \"2e04f1b8-a81d-4bfa-87ef-91242730bb29\") " pod="openshift-image-registry/node-ca-wk4st" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-run-openvswitch\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444464 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444473 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-jbmvx\"" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444488 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-sysctl-d\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e04f1b8-a81d-4bfa-87ef-91242730bb29-serviceca\") pod \"node-ca-wk4st\" (UID: \"2e04f1b8-a81d-4bfa-87ef-91242730bb29\") " pod="openshift-image-registry/node-ca-wk4st" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444512 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444534 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-run-systemd\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-etc-openvswitch\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444599 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-lib-modules\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48gt7\" (UniqueName: \"kubernetes.io/projected/9f6593ad-e136-4f32-9fc5-4fedcabdebed-kube-api-access-48gt7\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-system-cni-dir\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444696 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aadf213-10e8-4357-adbb-b2c5f3ef70ca-host-slash\") pod \"iptables-alerter-lhgpn\" (UID: \"6aadf213-10e8-4357-adbb-b2c5f3ef70ca\") " pod="openshift-network-operator/iptables-alerter-lhgpn" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-kubelet\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444761 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5da6b63f-b154-4354-850a-76474e8a26c9-konnectivity-ca\") pod \"konnectivity-agent-thf4s\" (UID: \"5da6b63f-b154-4354-850a-76474e8a26c9\") " pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:23.444827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444785 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-modprobe-d\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z52z\" (UniqueName: \"kubernetes.io/projected/919f32d7-40ac-4223-a344-c3194fdcceac-kube-api-access-4z52z\") pod \"node-resolver-qwjck\" (UID: \"919f32d7-40ac-4223-a344-c3194fdcceac\") " pod="openshift-dns/node-resolver-qwjck" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444849 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db9ws\" (UniqueName: \"kubernetes.io/projected/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-kube-api-access-db9ws\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-sys\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444902 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-var-lib-kubelet\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444919 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b91bebd-25df-45f7-a612-77d363bacec6-tmp\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444943 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6bwt\" (UniqueName: \"kubernetes.io/projected/6aadf213-10e8-4357-adbb-b2c5f3ef70ca-kube-api-access-p6bwt\") pod \"iptables-alerter-lhgpn\" (UID: \"6aadf213-10e8-4357-adbb-b2c5f3ef70ca\") " pod="openshift-network-operator/iptables-alerter-lhgpn" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-node-log\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.444973 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-cni-netd\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445003 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r762d\" (UniqueName: \"kubernetes.io/projected/7b91bebd-25df-45f7-a612-77d363bacec6-kube-api-access-r762d\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445024 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-os-release\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-slash\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445110 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b91bebd-25df-45f7-a612-77d363bacec6-etc-tuned\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/919f32d7-40ac-4223-a344-c3194fdcceac-tmp-dir\") pod \"node-resolver-qwjck\" (UID: \"919f32d7-40ac-4223-a344-c3194fdcceac\") " pod="openshift-dns/node-resolver-qwjck" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.445497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445203 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.446075 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445234 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 08 13:01:23.446075 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.446075 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6aadf213-10e8-4357-adbb-b2c5f3ef70ca-iptables-alerter-script\") pod \"iptables-alerter-lhgpn\" (UID: \"6aadf213-10e8-4357-adbb-b2c5f3ef70ca\") " pod="openshift-network-operator/iptables-alerter-lhgpn" Jun 08 13:01:23.446075 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445329 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-var-lib-openvswitch\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.446075 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-run\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.446075 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445364 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/919f32d7-40ac-4223-a344-c3194fdcceac-hosts-file\") pod \"node-resolver-qwjck\" (UID: \"919f32d7-40ac-4223-a344-c3194fdcceac\") " pod="openshift-dns/node-resolver-qwjck" Jun 08 13:01:23.446075 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445381 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:23.446075 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445396 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-run-netns\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.446075 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.445414 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-ovn-node-metrics-cert\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.494696 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.494659 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-m9txz" Jun 08 13:01:23.508691 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.508658 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-m9txz" Jun 08 13:01:23.511903 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.511850 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" event={"ID":"b822f9bdfa2fcbf7b4f9b49cbdbc240a","Type":"ContainerStarted","Data":"6f9b7b5ed5ed5894e6361a168afaded48fae381e0451a3d15d57ddba0b619f35"} Jun 08 13:01:23.513242 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.513215 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" event={"ID":"9319054885e1e5afa5f2ef4b4f79adf8","Type":"ContainerStarted","Data":"56570c86f0eb38dcd31d055319ec60dc5e0bd3b02f2cc6a1efad977ab5d81e3a"} Jun 08 13:01:23.534155 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.534123 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 08 13:01:23.546634 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.546608 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-etc-openvswitch\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.546819 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.546643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-var-lib-kubelet\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.546819 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.546669 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-lib-modules\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.546819 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.546750 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48gt7\" (UniqueName: \"kubernetes.io/projected/9f6593ad-e136-4f32-9fc5-4fedcabdebed-kube-api-access-48gt7\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:23.546819 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.546744 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-etc-openvswitch\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.546819 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.546806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-system-cni-dir\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.547013 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.546855 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.547307 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-lib-modules\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.547470 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547430 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aadf213-10e8-4357-adbb-b2c5f3ef70ca-host-slash\") pod \"iptables-alerter-lhgpn\" (UID: \"6aadf213-10e8-4357-adbb-b2c5f3ef70ca\") " pod="openshift-network-operator/iptables-alerter-lhgpn" Jun 08 13:01:23.547470 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547121 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-system-cni-dir\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.547666 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547484 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-kubelet\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.547666 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547520 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6aadf213-10e8-4357-adbb-b2c5f3ef70ca-host-slash\") pod \"iptables-alerter-lhgpn\" (UID: \"6aadf213-10e8-4357-adbb-b2c5f3ef70ca\") " pod="openshift-network-operator/iptables-alerter-lhgpn" Jun 08 13:01:23.547666 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-kubelet\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.547805 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547747 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.547805 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547801 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5da6b63f-b154-4354-850a-76474e8a26c9-konnectivity-ca\") pod \"konnectivity-agent-thf4s\" (UID: \"5da6b63f-b154-4354-850a-76474e8a26c9\") " pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:23.547898 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547833 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-modprobe-d\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.547898 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z52z\" (UniqueName: \"kubernetes.io/projected/919f32d7-40ac-4223-a344-c3194fdcceac-kube-api-access-4z52z\") pod \"node-resolver-qwjck\" (UID: \"919f32d7-40ac-4223-a344-c3194fdcceac\") " pod="openshift-dns/node-resolver-qwjck" Jun 08 13:01:23.547989 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db9ws\" (UniqueName: \"kubernetes.io/projected/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-kube-api-access-db9ws\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.547989 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-socket-dir-parent\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.547989 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.547960 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-cni-binary-copy\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.548124 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548037 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-sys\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.548124 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-var-lib-kubelet\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.548124 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b91bebd-25df-45f7-a612-77d363bacec6-tmp\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.548256 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548143 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6bwt\" (UniqueName: \"kubernetes.io/projected/6aadf213-10e8-4357-adbb-b2c5f3ef70ca-kube-api-access-p6bwt\") pod \"iptables-alerter-lhgpn\" (UID: \"6aadf213-10e8-4357-adbb-b2c5f3ef70ca\") " pod="openshift-network-operator/iptables-alerter-lhgpn" Jun 08 13:01:23.548256 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548181 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-node-log\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.548256 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548218 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-cni-netd\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.548364 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548254 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-socket-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.548364 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-run-netns\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.548364 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548316 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r762d\" (UniqueName: \"kubernetes.io/projected/7b91bebd-25df-45f7-a612-77d363bacec6-kube-api-access-r762d\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.548364 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548348 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-os-release\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.548520 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548381 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.548520 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548416 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-slash\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.548520 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-etc-selinux\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.548520 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548474 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-run-multus-certs\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.548716 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548525 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54ztr\" (UniqueName: \"kubernetes.io/projected/016b368d-b894-48ce-a6f5-f4bcb39d0a81-kube-api-access-54ztr\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.548716 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548579 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b91bebd-25df-45f7-a612-77d363bacec6-etc-tuned\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.548716 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548617 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/919f32d7-40ac-4223-a344-c3194fdcceac-tmp-dir\") pod \"node-resolver-qwjck\" (UID: \"919f32d7-40ac-4223-a344-c3194fdcceac\") " pod="openshift-dns/node-resolver-qwjck" Jun 08 13:01:23.548716 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548653 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.548716 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-cnibin\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.548927 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548723 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-os-release\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.548927 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548733 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5da6b63f-b154-4354-850a-76474e8a26c9-konnectivity-ca\") pod \"konnectivity-agent-thf4s\" (UID: \"5da6b63f-b154-4354-850a-76474e8a26c9\") " pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:23.548927 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548757 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-run-k8s-cni-cncf-io\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.548927 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548794 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.548927 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.548927 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548859 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6aadf213-10e8-4357-adbb-b2c5f3ef70ca-iptables-alerter-script\") pod \"iptables-alerter-lhgpn\" (UID: \"6aadf213-10e8-4357-adbb-b2c5f3ef70ca\") " pod="openshift-network-operator/iptables-alerter-lhgpn" Jun 08 13:01:23.548927 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-var-lib-openvswitch\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.548927 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548900 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/016b368d-b894-48ce-a6f5-f4bcb39d0a81-cni-binary-copy\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.548927 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-var-lib-cni-bin\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548935 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-run\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/919f32d7-40ac-4223-a344-c3194fdcceac-hosts-file\") pod \"node-resolver-qwjck\" (UID: \"919f32d7-40ac-4223-a344-c3194fdcceac\") " pod="openshift-dns/node-resolver-qwjck" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.548982 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549004 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-run-netns\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549023 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-ovn-node-metrics-cert\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549042 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-cnibin\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549067 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-ovnkube-config\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549098 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-conf-dir\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-kubelet-config\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549160 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-cni-bin\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549190 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-env-overrides\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549235 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-kubernetes\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549265 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-host\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e04f1b8-a81d-4bfa-87ef-91242730bb29-host\") pod \"node-ca-wk4st\" (UID: \"2e04f1b8-a81d-4bfa-87ef-91242730bb29\") " pod="openshift-image-registry/node-ca-wk4st" Jun 08 13:01:23.549319 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkj7k\" (UniqueName: \"kubernetes.io/projected/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-kube-api-access-mkj7k\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549318 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-modprobe-d\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8w5x6\" (UniqueName: \"kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6\") pod \"network-check-target-nh6j9\" (UID: \"4f862e24-ab62-4209-af23-69a7e0773972\") " pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549377 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/919f32d7-40ac-4223-a344-c3194fdcceac-tmp-dir\") pod \"node-resolver-qwjck\" (UID: \"919f32d7-40ac-4223-a344-c3194fdcceac\") " pod="openshift-dns/node-resolver-qwjck" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5da6b63f-b154-4354-850a-76474e8a26c9-agent-certs\") pod \"konnectivity-agent-thf4s\" (UID: \"5da6b63f-b154-4354-850a-76474e8a26c9\") " pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549459 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-sysctl-conf\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-log-socket\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549522 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-sys\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549558 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqgm4\" (UniqueName: \"kubernetes.io/projected/2b47b934-efd8-44df-9382-209e5f10d701-kube-api-access-wqgm4\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549614 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-cni-dir\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549631 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-var-lib-kubelet\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-daemon-config\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549678 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-etc-kubernetes\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549717 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-systemd-units\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549784 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-ovnkube-script-lib\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549817 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-sys-fs\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.549980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-systemd\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.550737 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-dbus\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:23.550737 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549870 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.550737 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549917 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-run-ovn\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.550737 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-registration-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.550737 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.549997 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-sysconfig\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.550737 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.550054 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x9n7\" (UniqueName: \"kubernetes.io/projected/2e04f1b8-a81d-4bfa-87ef-91242730bb29-kube-api-access-4x9n7\") pod \"node-ca-wk4st\" (UID: \"2e04f1b8-a81d-4bfa-87ef-91242730bb29\") " pod="openshift-image-registry/node-ca-wk4st" Jun 08 13:01:23.550737 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.550092 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-run-openvswitch\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.550737 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.550124 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 08 13:01:23.550737 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.550168 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.550737 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.550233 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.550737 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.550688 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.551244 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.551171 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6aadf213-10e8-4357-adbb-b2c5f3ef70ca-iptables-alerter-script\") pod \"iptables-alerter-lhgpn\" (UID: \"6aadf213-10e8-4357-adbb-b2c5f3ef70ca\") " pod="openshift-network-operator/iptables-alerter-lhgpn" Jun 08 13:01:23.551296 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.551241 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-var-lib-openvswitch\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.551344 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.551325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-run\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.551402 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.551385 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/919f32d7-40ac-4223-a344-c3194fdcceac-hosts-file\") pod \"node-resolver-qwjck\" (UID: \"919f32d7-40ac-4223-a344-c3194fdcceac\") " pod="openshift-dns/node-resolver-qwjck" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:23.551488 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.551601 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-os-release\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:23.551616 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret podName:d3a8dcb3-1700-4cc9-a515-fcf7ac698a48 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:24.051582653 +0000 UTC m=+3.020882180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret") pod "global-pull-secret-syncer-b4rvp" (UID: "d3a8dcb3-1700-4cc9-a515-fcf7ac698a48") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.551641 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-run-netns\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.551694 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-kubelet-config\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.551716 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-kubernetes\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.550130 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-run-ovn-kubernetes\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:23.552001 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-system-cni-dir\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552091 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-sysctl-d\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552131 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e04f1b8-a81d-4bfa-87ef-91242730bb29-serviceca\") pod \"node-ca-wk4st\" (UID: \"2e04f1b8-a81d-4bfa-87ef-91242730bb29\") " pod="openshift-image-registry/node-ca-wk4st" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:23.552191 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs podName:9f6593ad-e136-4f32-9fc5-4fedcabdebed nodeName:}" failed. No retries permitted until 2026-06-08 13:01:24.052152168 +0000 UTC m=+3.021451694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs") pod "network-metrics-daemon-8wxnn" (UID: "9f6593ad-e136-4f32-9fc5-4fedcabdebed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552216 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-run-systemd\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552259 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-device-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-var-lib-cni-multus\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552299 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-cni-bin\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.552792 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-hostroot\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552442 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-sysctl-conf\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552520 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-sysconfig\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552541 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-host\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552556 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e04f1b8-a81d-4bfa-87ef-91242730bb29-serviceca\") pod \"node-ca-wk4st\" (UID: \"2e04f1b8-a81d-4bfa-87ef-91242730bb29\") " pod="openshift-image-registry/node-ca-wk4st" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552598 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-cnibin\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552706 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-sysctl-d\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552748 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-node-log\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.553007 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-env-overrides\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.552523 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-cni-netd\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.553258 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-ovnkube-config\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.553330 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-dbus\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.553383 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-run-ovn\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.553420 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7b91bebd-25df-45f7-a612-77d363bacec6-etc-systemd\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.553435 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-systemd-units\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.553715 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.553484 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e04f1b8-a81d-4bfa-87ef-91242730bb29-host\") pod \"node-ca-wk4st\" (UID: \"2e04f1b8-a81d-4bfa-87ef-91242730bb29\") " pod="openshift-image-registry/node-ca-wk4st" Jun 08 13:01:23.554400 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.553821 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-host-slash\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.554400 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.553919 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-log-socket\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.554400 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.553957 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-ovnkube-script-lib\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.554400 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.553976 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-run-systemd\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.554400 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.554030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.554400 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.554275 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-run-openvswitch\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.554933 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.554908 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b91bebd-25df-45f7-a612-77d363bacec6-tmp\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.555022 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.554946 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7b91bebd-25df-45f7-a612-77d363bacec6-etc-tuned\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.555302 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.555283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-ovn-node-metrics-cert\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.555372 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.555340 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5da6b63f-b154-4354-850a-76474e8a26c9-agent-certs\") pod \"konnectivity-agent-thf4s\" (UID: \"5da6b63f-b154-4354-850a-76474e8a26c9\") " pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:23.557392 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.557367 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48gt7\" (UniqueName: \"kubernetes.io/projected/9f6593ad-e136-4f32-9fc5-4fedcabdebed-kube-api-access-48gt7\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:23.563033 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.563009 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z52z\" (UniqueName: \"kubernetes.io/projected/919f32d7-40ac-4223-a344-c3194fdcceac-kube-api-access-4z52z\") pod \"node-resolver-qwjck\" (UID: \"919f32d7-40ac-4223-a344-c3194fdcceac\") " pod="openshift-dns/node-resolver-qwjck" Jun 08 13:01:23.565847 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.565524 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6bwt\" (UniqueName: \"kubernetes.io/projected/6aadf213-10e8-4357-adbb-b2c5f3ef70ca-kube-api-access-p6bwt\") pod \"iptables-alerter-lhgpn\" (UID: \"6aadf213-10e8-4357-adbb-b2c5f3ef70ca\") " pod="openshift-network-operator/iptables-alerter-lhgpn" Jun 08 13:01:23.565847 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.565798 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkj7k\" (UniqueName: \"kubernetes.io/projected/0e52b7d1-3feb-43f7-b83e-37a3ed9500c9-kube-api-access-mkj7k\") pod \"ovnkube-node-mgn84\" (UID: \"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9\") " pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.565847 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.565840 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x9n7\" (UniqueName: \"kubernetes.io/projected/2e04f1b8-a81d-4bfa-87ef-91242730bb29-kube-api-access-4x9n7\") pod \"node-ca-wk4st\" (UID: \"2e04f1b8-a81d-4bfa-87ef-91242730bb29\") " pod="openshift-image-registry/node-ca-wk4st" Jun 08 13:01:23.566336 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.566305 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db9ws\" (UniqueName: \"kubernetes.io/projected/fdc26cc8-331e-4431-b20c-13d3b05a7f7a-kube-api-access-db9ws\") pod \"multus-additional-cni-plugins-wqvxc\" (UID: \"fdc26cc8-331e-4431-b20c-13d3b05a7f7a\") " pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.566592 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.566557 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r762d\" (UniqueName: \"kubernetes.io/projected/7b91bebd-25df-45f7-a612-77d363bacec6-kube-api-access-r762d\") pod \"tuned-8kzzj\" (UID: \"7b91bebd-25df-45f7-a612-77d363bacec6\") " pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.653160 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653123 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-registration-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.653160 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-system-cni-dir\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653254 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-system-cni-dir\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653257 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-registration-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653285 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-device-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-var-lib-cni-multus\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653329 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-hostroot\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653353 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-var-lib-kubelet\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653353 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-device-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653380 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653388 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-var-lib-cni-multus\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653406 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-var-lib-kubelet\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653409 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-hostroot\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653407 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-socket-dir-parent\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653437 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-kubelet-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653448 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-socket-dir-parent\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653460 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-socket-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-run-netns\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-run-netns\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653583 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-etc-selinux\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653598 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-socket-dir\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653605 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-run-multus-certs\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54ztr\" (UniqueName: \"kubernetes.io/projected/016b368d-b894-48ce-a6f5-f4bcb39d0a81-kube-api-access-54ztr\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653649 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-cnibin\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653672 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-os-release\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653689 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-run-multus-certs\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653695 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-run-k8s-cni-cncf-io\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653721 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-cnibin\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653723 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-run-k8s-cni-cncf-io\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653672 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-etc-selinux\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653748 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-os-release\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.653962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653751 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/016b368d-b894-48ce-a6f5-f4bcb39d0a81-cni-binary-copy\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-var-lib-cni-bin\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653838 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-conf-dir\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653847 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-host-var-lib-cni-bin\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653870 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5x6\" (UniqueName: \"kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6\") pod \"network-check-target-nh6j9\" (UID: \"4f862e24-ab62-4209-af23-69a7e0773972\") " pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653898 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqgm4\" (UniqueName: \"kubernetes.io/projected/2b47b934-efd8-44df-9382-209e5f10d701-kube-api-access-wqgm4\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653922 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-cni-dir\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653930 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-conf-dir\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653947 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-daemon-config\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653968 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-etc-kubernetes\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.653995 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-cni-dir\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.654002 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-sys-fs\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.654035 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/016b368d-b894-48ce-a6f5-f4bcb39d0a81-etc-kubernetes\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.654089 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/2b47b934-efd8-44df-9382-209e5f10d701-sys-fs\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.654325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/016b368d-b894-48ce-a6f5-f4bcb39d0a81-cni-binary-copy\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.654755 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.654511 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/016b368d-b894-48ce-a6f5-f4bcb39d0a81-multus-daemon-config\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.662713 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:23.662651 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:23.662713 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:23.662680 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:23.662713 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:23.662695 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8w5x6 for pod openshift-network-diagnostics/network-check-target-nh6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:23.662948 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:23.662767 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6 podName:4f862e24-ab62-4209-af23-69a7e0773972 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:24.162749892 +0000 UTC m=+3.132049420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8w5x6" (UniqueName: "kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6") pod "network-check-target-nh6j9" (UID: "4f862e24-ab62-4209-af23-69a7e0773972") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:23.665392 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.665371 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54ztr\" (UniqueName: \"kubernetes.io/projected/016b368d-b894-48ce-a6f5-f4bcb39d0a81-kube-api-access-54ztr\") pod \"multus-5897v\" (UID: \"016b368d-b894-48ce-a6f5-f4bcb39d0a81\") " pod="openshift-multus/multus-5897v" Jun 08 13:01:23.666304 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.666259 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqgm4\" (UniqueName: \"kubernetes.io/projected/2b47b934-efd8-44df-9382-209e5f10d701-kube-api-access-wqgm4\") pod \"aws-ebs-csi-driver-node-28jh5\" (UID: \"2b47b934-efd8-44df-9382-209e5f10d701\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.733249 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.733211 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wk4st" Jun 08 13:01:23.744479 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.744456 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wqvxc" Jun 08 13:01:23.755242 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.755215 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lhgpn" Jun 08 13:01:23.759963 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.759938 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:23.766669 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.766640 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qwjck" Jun 08 13:01:23.773614 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.773592 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:23.780907 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.780883 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" Jun 08 13:01:23.787849 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.787826 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" Jun 08 13:01:23.792602 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:23.792584 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5897v" Jun 08 13:01:24.056804 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.056715 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:24.056804 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.056776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:24.057020 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:24.056874 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:24.057020 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:24.056934 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs podName:9f6593ad-e136-4f32-9fc5-4fedcabdebed nodeName:}" failed. No retries permitted until 2026-06-08 13:01:25.056916197 +0000 UTC m=+4.026215710 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs") pod "network-metrics-daemon-8wxnn" (UID: "9f6593ad-e136-4f32-9fc5-4fedcabdebed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:24.057020 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:24.056875 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:24.057178 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:24.057024 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret podName:d3a8dcb3-1700-4cc9-a515-fcf7ac698a48 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:25.057009757 +0000 UTC m=+4.026309270 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret") pod "global-pull-secret-syncer-b4rvp" (UID: "d3a8dcb3-1700-4cc9-a515-fcf7ac698a48") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:24.258462 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.258425 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5x6\" (UniqueName: \"kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6\") pod \"network-check-target-nh6j9\" (UID: \"4f862e24-ab62-4209-af23-69a7e0773972\") " pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:24.258660 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:24.258600 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:24.258660 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:24.258627 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:24.258660 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:24.258641 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8w5x6 for pod openshift-network-diagnostics/network-check-target-nh6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:24.258815 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:24.258700 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6 podName:4f862e24-ab62-4209-af23-69a7e0773972 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:25.258683907 +0000 UTC m=+4.227983430 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8w5x6" (UniqueName: "kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6") pod "network-check-target-nh6j9" (UID: "4f862e24-ab62-4209-af23-69a7e0773972") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:24.330092 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:24.330013 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod919f32d7_40ac_4223_a344_c3194fdcceac.slice/crio-0e4fadb72ed999447507cdf026b84ea8741ef782bb75a97aabbf98da6c28f0a0 WatchSource:0}: Error finding container 0e4fadb72ed999447507cdf026b84ea8741ef782bb75a97aabbf98da6c28f0a0: Status 404 returned error can't find the container with id 0e4fadb72ed999447507cdf026b84ea8741ef782bb75a97aabbf98da6c28f0a0 Jun 08 13:01:24.331005 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:24.330981 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e52b7d1_3feb_43f7_b83e_37a3ed9500c9.slice/crio-20f0248b6f442a0362f512cf3f6e86d7d72ce9649afcb26e8867c031c030da3d WatchSource:0}: Error finding container 20f0248b6f442a0362f512cf3f6e86d7d72ce9649afcb26e8867c031c030da3d: Status 404 returned error can't find the container with id 20f0248b6f442a0362f512cf3f6e86d7d72ce9649afcb26e8867c031c030da3d Jun 08 13:01:24.331893 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:24.331865 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b47b934_efd8_44df_9382_209e5f10d701.slice/crio-77b7f2b3af2960db340a1f96c7d385390b506b377f49aa5d23c24c22d15d7c22 WatchSource:0}: Error finding container 77b7f2b3af2960db340a1f96c7d385390b506b377f49aa5d23c24c22d15d7c22: Status 404 returned error can't find the container with id 77b7f2b3af2960db340a1f96c7d385390b506b377f49aa5d23c24c22d15d7c22 Jun 08 13:01:24.333028 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:24.333003 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b91bebd_25df_45f7_a612_77d363bacec6.slice/crio-3b180d1d323904a0088e3fac80c04bca310a7a047e6f276cffd12fc632777f5a WatchSource:0}: Error finding container 3b180d1d323904a0088e3fac80c04bca310a7a047e6f276cffd12fc632777f5a: Status 404 returned error can't find the container with id 3b180d1d323904a0088e3fac80c04bca310a7a047e6f276cffd12fc632777f5a Jun 08 13:01:24.334700 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:24.334523 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod016b368d_b894_48ce_a6f5_f4bcb39d0a81.slice/crio-074953f6fb8869c5a00b778afa6a61c470d551a1d8d6fec9e98a8233c54206aa WatchSource:0}: Error finding container 074953f6fb8869c5a00b778afa6a61c470d551a1d8d6fec9e98a8233c54206aa: Status 404 returned error can't find the container with id 074953f6fb8869c5a00b778afa6a61c470d551a1d8d6fec9e98a8233c54206aa Jun 08 13:01:24.336410 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:24.336391 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e04f1b8_a81d_4bfa_87ef_91242730bb29.slice/crio-d7f4f3e9d2d4eff4fc1f0ff70fabfbf5dd60703e19d2827a27fc15c9760e51d7 WatchSource:0}: Error finding container d7f4f3e9d2d4eff4fc1f0ff70fabfbf5dd60703e19d2827a27fc15c9760e51d7: Status 404 returned error can't find the container with id d7f4f3e9d2d4eff4fc1f0ff70fabfbf5dd60703e19d2827a27fc15c9760e51d7 Jun 08 13:01:24.337794 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:24.337770 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da6b63f_b154_4354_850a_76474e8a26c9.slice/crio-c61d614289ad22a25988bd62055d94f18e2079293026e1dbb0fd811fc9129cb9 WatchSource:0}: Error finding container c61d614289ad22a25988bd62055d94f18e2079293026e1dbb0fd811fc9129cb9: Status 404 returned error can't find the container with id c61d614289ad22a25988bd62055d94f18e2079293026e1dbb0fd811fc9129cb9 Jun 08 13:01:24.338697 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:24.338651 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aadf213_10e8_4357_adbb_b2c5f3ef70ca.slice/crio-358d2243b7de5d2b8e85626b9ef20c042694bf97e22f85153c271237670243fb WatchSource:0}: Error finding container 358d2243b7de5d2b8e85626b9ef20c042694bf97e22f85153c271237670243fb: Status 404 returned error can't find the container with id 358d2243b7de5d2b8e85626b9ef20c042694bf97e22f85153c271237670243fb Jun 08 13:01:24.339921 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:24.339504 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdc26cc8_331e_4431_b20c_13d3b05a7f7a.slice/crio-7f8b0c3e37097acca0d7330846de0b78edf49a1408aad535569413395ec38c9c WatchSource:0}: Error finding container 7f8b0c3e37097acca0d7330846de0b78edf49a1408aad535569413395ec38c9c: Status 404 returned error can't find the container with id 7f8b0c3e37097acca0d7330846de0b78edf49a1408aad535569413395ec38c9c Jun 08 13:01:24.511199 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.511145 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:56:23 +0000 UTC" deadline="2028-02-19 09:36:49.190050976 +0000 UTC" Jun 08 13:01:24.511199 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.511194 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14900h35m24.678859917s" Jun 08 13:01:24.518442 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.518409 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" event={"ID":"9319054885e1e5afa5f2ef4b4f79adf8","Type":"ContainerStarted","Data":"648fbac45444c6a38211e9c69fb790dbe80a70d2eaa4e4d615c1177e2398549f"} Jun 08 13:01:24.519635 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.519602 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqvxc" event={"ID":"fdc26cc8-331e-4431-b20c-13d3b05a7f7a","Type":"ContainerStarted","Data":"7f8b0c3e37097acca0d7330846de0b78edf49a1408aad535569413395ec38c9c"} Jun 08 13:01:24.520685 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.520666 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5897v" event={"ID":"016b368d-b894-48ce-a6f5-f4bcb39d0a81","Type":"ContainerStarted","Data":"074953f6fb8869c5a00b778afa6a61c470d551a1d8d6fec9e98a8233c54206aa"} Jun 08 13:01:24.521851 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.521827 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wk4st" event={"ID":"2e04f1b8-a81d-4bfa-87ef-91242730bb29","Type":"ContainerStarted","Data":"d7f4f3e9d2d4eff4fc1f0ff70fabfbf5dd60703e19d2827a27fc15c9760e51d7"} Jun 08 13:01:24.523888 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.523868 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" event={"ID":"2b47b934-efd8-44df-9382-209e5f10d701","Type":"ContainerStarted","Data":"77b7f2b3af2960db340a1f96c7d385390b506b377f49aa5d23c24c22d15d7c22"} Jun 08 13:01:24.526618 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.526592 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" event={"ID":"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9","Type":"ContainerStarted","Data":"20f0248b6f442a0362f512cf3f6e86d7d72ce9649afcb26e8867c031c030da3d"} Jun 08 13:01:24.527675 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.527655 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lhgpn" event={"ID":"6aadf213-10e8-4357-adbb-b2c5f3ef70ca","Type":"ContainerStarted","Data":"358d2243b7de5d2b8e85626b9ef20c042694bf97e22f85153c271237670243fb"} Jun 08 13:01:24.528765 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.528744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-thf4s" event={"ID":"5da6b63f-b154-4354-850a-76474e8a26c9","Type":"ContainerStarted","Data":"c61d614289ad22a25988bd62055d94f18e2079293026e1dbb0fd811fc9129cb9"} Jun 08 13:01:24.529728 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.529710 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" event={"ID":"7b91bebd-25df-45f7-a612-77d363bacec6","Type":"ContainerStarted","Data":"3b180d1d323904a0088e3fac80c04bca310a7a047e6f276cffd12fc632777f5a"} Jun 08 13:01:24.530759 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:24.530740 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qwjck" event={"ID":"919f32d7-40ac-4223-a344-c3194fdcceac","Type":"ContainerStarted","Data":"0e4fadb72ed999447507cdf026b84ea8741ef782bb75a97aabbf98da6c28f0a0"} Jun 08 13:01:25.072283 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:25.065117 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:25.072283 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:25.065243 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:25.072283 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:25.065656 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:25.072283 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:25.065729 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret podName:d3a8dcb3-1700-4cc9-a515-fcf7ac698a48 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:27.065705037 +0000 UTC m=+6.035004569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret") pod "global-pull-secret-syncer-b4rvp" (UID: "d3a8dcb3-1700-4cc9-a515-fcf7ac698a48") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:25.072283 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:25.065808 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:25.072283 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:25.065844 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs podName:9f6593ad-e136-4f32-9fc5-4fedcabdebed nodeName:}" failed. No retries permitted until 2026-06-08 13:01:27.065831263 +0000 UTC m=+6.035130775 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs") pod "network-metrics-daemon-8wxnn" (UID: "9f6593ad-e136-4f32-9fc5-4fedcabdebed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:25.267712 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:25.267671 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5x6\" (UniqueName: \"kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6\") pod \"network-check-target-nh6j9\" (UID: \"4f862e24-ab62-4209-af23-69a7e0773972\") " pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:25.267920 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:25.267904 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:25.268007 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:25.267932 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:25.268007 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:25.267945 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8w5x6 for pod openshift-network-diagnostics/network-check-target-nh6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:25.268007 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:25.268004 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6 podName:4f862e24-ab62-4209-af23-69a7e0773972 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:27.267985057 +0000 UTC m=+6.237284573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8w5x6" (UniqueName: "kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6") pod "network-check-target-nh6j9" (UID: "4f862e24-ab62-4209-af23-69a7e0773972") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:25.511526 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:25.510659 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:25.511526 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:25.510782 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:25.511526 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:25.511162 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:25.511526 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:25.511258 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:25.511526 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:25.511320 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:25.511526 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:25.511392 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:25.511526 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:25.511491 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-07 12:56:23 +0000 UTC" deadline="2028-03-26 12:51:23.396158418 +0000 UTC" Jun 08 13:01:25.511526 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:25.511522 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15767h49m57.884640766s" Jun 08 13:01:25.547382 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:25.547347 2563 generic.go:356] "Generic (PLEG): container finished" podID="b822f9bdfa2fcbf7b4f9b49cbdbc240a" containerID="c3f79be9d11f82fa20ea0c7a6062b327f962108273783c5346ff1fab164f5fbc" exitCode=0 Jun 08 13:01:25.548478 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:25.548229 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" event={"ID":"b822f9bdfa2fcbf7b4f9b49cbdbc240a","Type":"ContainerDied","Data":"c3f79be9d11f82fa20ea0c7a6062b327f962108273783c5346ff1fab164f5fbc"} Jun 08 13:01:25.574589 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:25.574078 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-189.ec2.internal" podStartSLOduration=3.5740580250000002 podStartE2EDuration="3.574058025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:24.541178232 +0000 UTC m=+3.510477762" watchObservedRunningTime="2026-06-08 13:01:25.574058025 +0000 UTC m=+4.543357559" Jun 08 13:01:26.568169 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:26.567459 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" event={"ID":"b822f9bdfa2fcbf7b4f9b49cbdbc240a","Type":"ContainerStarted","Data":"c70a4cab3e16fba50d357a182c6c3e12de063b642717572de2d89c63d09fef5a"} Jun 08 13:01:27.085040 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:27.085003 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:27.085235 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:27.085095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:27.085304 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:27.085238 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:27.085304 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:27.085302 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret podName:d3a8dcb3-1700-4cc9-a515-fcf7ac698a48 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:31.085283038 +0000 UTC m=+10.054582552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret") pod "global-pull-secret-syncer-b4rvp" (UID: "d3a8dcb3-1700-4cc9-a515-fcf7ac698a48") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:27.085763 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:27.085743 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:27.085863 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:27.085799 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs podName:9f6593ad-e136-4f32-9fc5-4fedcabdebed nodeName:}" failed. No retries permitted until 2026-06-08 13:01:31.085782563 +0000 UTC m=+10.055082089 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs") pod "network-metrics-daemon-8wxnn" (UID: "9f6593ad-e136-4f32-9fc5-4fedcabdebed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:27.287386 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:27.287346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5x6\" (UniqueName: \"kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6\") pod \"network-check-target-nh6j9\" (UID: \"4f862e24-ab62-4209-af23-69a7e0773972\") " pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:27.287592 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:27.287532 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:27.287592 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:27.287551 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:27.287592 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:27.287578 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8w5x6 for pod openshift-network-diagnostics/network-check-target-nh6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:27.287770 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:27.287640 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6 podName:4f862e24-ab62-4209-af23-69a7e0773972 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:31.287619228 +0000 UTC m=+10.256918740 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8w5x6" (UniqueName: "kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6") pod "network-check-target-nh6j9" (UID: "4f862e24-ab62-4209-af23-69a7e0773972") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:27.510989 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:27.508757 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:27.510989 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:27.508908 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:27.510989 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:27.508941 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:27.510989 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:27.509013 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:27.510989 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:27.509166 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:27.510989 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:27.509297 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:29.512196 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:29.512168 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:29.512691 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:29.512297 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:29.512691 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:29.512394 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:29.512691 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:29.512522 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:29.512691 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:29.512556 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:29.512691 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:29.512652 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:31.116428 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:31.116393 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:31.116868 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:31.116451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:31.116868 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:31.116543 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:31.116868 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:31.116576 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:31.116868 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:31.116614 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs podName:9f6593ad-e136-4f32-9fc5-4fedcabdebed nodeName:}" failed. No retries permitted until 2026-06-08 13:01:39.116600371 +0000 UTC m=+18.085899881 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs") pod "network-metrics-daemon-8wxnn" (UID: "9f6593ad-e136-4f32-9fc5-4fedcabdebed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:31.116868 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:31.116641 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret podName:d3a8dcb3-1700-4cc9-a515-fcf7ac698a48 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:39.116622471 +0000 UTC m=+18.085921987 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret") pod "global-pull-secret-syncer-b4rvp" (UID: "d3a8dcb3-1700-4cc9-a515-fcf7ac698a48") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:31.319181 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:31.318644 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5x6\" (UniqueName: \"kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6\") pod \"network-check-target-nh6j9\" (UID: \"4f862e24-ab62-4209-af23-69a7e0773972\") " pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:31.319181 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:31.318831 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:31.319181 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:31.318851 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:31.319181 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:31.318864 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8w5x6 for pod openshift-network-diagnostics/network-check-target-nh6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:31.319181 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:31.318918 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6 podName:4f862e24-ab62-4209-af23-69a7e0773972 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:39.318901327 +0000 UTC m=+18.288200838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8w5x6" (UniqueName: "kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6") pod "network-check-target-nh6j9" (UID: "4f862e24-ab62-4209-af23-69a7e0773972") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:31.510257 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:31.509459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:31.510257 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:31.509579 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:31.510257 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:31.509627 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:31.510257 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:31.509707 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:31.510257 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:31.510084 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:31.510257 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:31.510174 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:33.511620 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:33.511548 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:33.512091 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:33.511633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:33.512091 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:33.511761 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:33.512091 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:33.511809 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:33.512091 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:33.511895 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:33.512333 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:33.512278 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:35.511179 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:35.510984 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:35.511666 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:35.510988 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:35.511666 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:35.511294 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:35.511666 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:35.511018 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:35.511666 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:35.511383 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:35.511666 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:35.511407 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:37.508463 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:37.508433 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:37.508962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:37.508433 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:37.508962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:37.508439 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:37.508962 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:37.508555 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:37.508962 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:37.508675 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:37.508962 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:37.508763 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:39.182904 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:39.182857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:39.183312 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:39.182949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:39.183312 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:39.183019 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:39.183312 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:39.183051 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:39.183312 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:39.183086 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs podName:9f6593ad-e136-4f32-9fc5-4fedcabdebed nodeName:}" failed. No retries permitted until 2026-06-08 13:01:55.18306941 +0000 UTC m=+34.152368920 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs") pod "network-metrics-daemon-8wxnn" (UID: "9f6593ad-e136-4f32-9fc5-4fedcabdebed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:39.183312 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:39.183105 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret podName:d3a8dcb3-1700-4cc9-a515-fcf7ac698a48 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:55.183095839 +0000 UTC m=+34.152395347 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret") pod "global-pull-secret-syncer-b4rvp" (UID: "d3a8dcb3-1700-4cc9-a515-fcf7ac698a48") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:39.384194 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:39.384158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5x6\" (UniqueName: \"kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6\") pod \"network-check-target-nh6j9\" (UID: \"4f862e24-ab62-4209-af23-69a7e0773972\") " pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:39.384370 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:39.384307 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:39.384370 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:39.384323 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:39.384370 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:39.384331 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8w5x6 for pod openshift-network-diagnostics/network-check-target-nh6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:39.384492 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:39.384390 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6 podName:4f862e24-ab62-4209-af23-69a7e0773972 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:55.384374977 +0000 UTC m=+34.353674486 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8w5x6" (UniqueName: "kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6") pod "network-check-target-nh6j9" (UID: "4f862e24-ab62-4209-af23-69a7e0773972") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:39.508446 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:39.508360 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:39.508635 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:39.508360 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:39.508635 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:39.508502 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:39.508635 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:39.508360 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:39.508635 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:39.508594 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:39.508816 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:39.508655 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:41.508371 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:41.508333 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:41.508931 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:41.508450 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:41.508931 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:41.508501 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:41.508931 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:41.508631 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:41.508931 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:41.508730 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:41.508931 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:41.508841 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:43.508053 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.507871 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:43.508811 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.507875 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:43.508811 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:43.508166 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:43.508811 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.507932 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:43.508811 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:43.508203 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:43.508811 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:43.508328 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:43.605765 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.605723 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-thf4s" event={"ID":"5da6b63f-b154-4354-850a-76474e8a26c9","Type":"ContainerStarted","Data":"05441a20b80423cded9676d42d3fcc58b60d669bd79673174f44f810acbb9481"} Jun 08 13:01:43.607690 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.607638 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" event={"ID":"7b91bebd-25df-45f7-a612-77d363bacec6","Type":"ContainerStarted","Data":"fe3a91c2050bc8aeb18b744eeec30414345662ae71445ad991619b0027ed6360"} Jun 08 13:01:43.609197 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.609119 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qwjck" event={"ID":"919f32d7-40ac-4223-a344-c3194fdcceac","Type":"ContainerStarted","Data":"4f2dbcc5c3c87e23268c300614e63a9937567eae5154ef58417892cf22ccc782"} Jun 08 13:01:43.610948 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.610923 2563 generic.go:356] "Generic (PLEG): container finished" podID="fdc26cc8-331e-4431-b20c-13d3b05a7f7a" containerID="3f75f50669c8fe377a023252ba6248c4db8b56e02493a2c11ced2cc4c296831d" exitCode=0 Jun 08 13:01:43.611069 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.611000 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqvxc" event={"ID":"fdc26cc8-331e-4431-b20c-13d3b05a7f7a","Type":"ContainerDied","Data":"3f75f50669c8fe377a023252ba6248c4db8b56e02493a2c11ced2cc4c296831d"} Jun 08 13:01:43.612694 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.612667 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5897v" event={"ID":"016b368d-b894-48ce-a6f5-f4bcb39d0a81","Type":"ContainerStarted","Data":"436d27287dcf1b4dc15f7c2b09eb7f75ac1548bc7e3b742564c23ae3b5e97b13"} Jun 08 13:01:43.616522 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.616500 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wk4st" event={"ID":"2e04f1b8-a81d-4bfa-87ef-91242730bb29","Type":"ContainerStarted","Data":"17af0e370c791b3a778ebbe1a36c907457787316ea137dbffc320d359d8aedb9"} Jun 08 13:01:43.619292 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.619268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" event={"ID":"2b47b934-efd8-44df-9382-209e5f10d701","Type":"ContainerStarted","Data":"35248a64ab7d29f66eca231afa1ed0828332ee822793192e4126f7caac689431"} Jun 08 13:01:43.622607 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.622588 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:01:43.622946 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.622926 2563 generic.go:356] "Generic (PLEG): container finished" podID="0e52b7d1-3feb-43f7-b83e-37a3ed9500c9" containerID="6d5de355f4aea074902ee091bbade7dcacf8801549c0ff60dc9cc275a37ba255" exitCode=1 Jun 08 13:01:43.623028 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.622953 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" event={"ID":"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9","Type":"ContainerStarted","Data":"11fea8930e1779cc08104e9b9d53b18437fa2d7c9c86fdbc5172f2b3d6f4f54e"} Jun 08 13:01:43.623028 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.623008 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" event={"ID":"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9","Type":"ContainerStarted","Data":"c84aa47af5953c6d1248b040326827e6cc89202d9ffa9e82961b3c2019289d79"} Jun 08 13:01:43.623143 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.623038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" event={"ID":"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9","Type":"ContainerStarted","Data":"257837ed68432a251353e9041adbc51f65302e14f4b0568c07630bc1453c05df"} Jun 08 13:01:43.623143 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.623069 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" event={"ID":"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9","Type":"ContainerStarted","Data":"83f943398f3342eb796539fcf9fbcf034d63821cf255abc4f30247dde942e356"} Jun 08 13:01:43.623143 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.623100 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" event={"ID":"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9","Type":"ContainerDied","Data":"6d5de355f4aea074902ee091bbade7dcacf8801549c0ff60dc9cc275a37ba255"} Jun 08 13:01:43.623143 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.623128 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" event={"ID":"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9","Type":"ContainerStarted","Data":"46a717df522667ec69a36683f7cc38b0d4ab8b82424dda798526542d0491159c"} Jun 08 13:01:43.627228 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.627191 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-thf4s" podStartSLOduration=12.55852496 podStartE2EDuration="22.62717886s" totalImagesPullingTime="10.0686539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:43.626688322 +0000 UTC m=+22.595987865" watchObservedRunningTime="2026-06-08 13:01:43.62717886 +0000 UTC m=+22.596478391" Jun 08 13:01:43.627343 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.627325 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-189.ec2.internal" podStartSLOduration=21.62731889 podStartE2EDuration="21.62731889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:26.589403542 +0000 UTC m=+5.558703075" watchObservedRunningTime="2026-06-08 13:01:43.62731889 +0000 UTC m=+22.596618421" Jun 08 13:01:43.642382 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.642331 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qwjck" podStartSLOduration=4.130901498 podStartE2EDuration="22.642319726s" totalImagesPullingTime="18.511418228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:43.642302238 +0000 UTC m=+22.611601777" watchObservedRunningTime="2026-06-08 13:01:43.642319726 +0000 UTC m=+22.611619258" Jun 08 13:01:43.660699 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.660652 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8kzzj" podStartSLOduration=4.15275409 podStartE2EDuration="22.66063652s" totalImagesPullingTime="18.50788243s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:43.660294942 +0000 UTC m=+22.629594474" watchObservedRunningTime="2026-06-08 13:01:43.66063652 +0000 UTC m=+22.629936051" Jun 08 13:01:43.678638 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.678593 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5897v" podStartSLOduration=4.12826759 podStartE2EDuration="22.678559637s" totalImagesPullingTime="18.550292047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:43.678016387 +0000 UTC m=+22.647315906" watchObservedRunningTime="2026-06-08 13:01:43.678559637 +0000 UTC m=+22.647859167" Jun 08 13:01:43.693581 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:43.693516 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wk4st" podStartSLOduration=4.189335207 podStartE2EDuration="22.693496225s" totalImagesPullingTime="18.504161018s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:43.692973305 +0000 UTC m=+22.662272837" watchObservedRunningTime="2026-06-08 13:01:43.693496225 +0000 UTC m=+22.662795758" Jun 08 13:01:44.547469 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:44.547276 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 08 13:01:44.626524 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:44.626492 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" event={"ID":"2b47b934-efd8-44df-9382-209e5f10d701","Type":"ContainerStarted","Data":"6c88d7e674f3b48df8611daa801c682adc244be8621792285d59ed38082d8fe0"} Jun 08 13:01:44.628038 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:44.628007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lhgpn" event={"ID":"6aadf213-10e8-4357-adbb-b2c5f3ef70ca","Type":"ContainerStarted","Data":"717310cdadf0420720165fdb3423f81311ad3a520842234769612d7f98969f8d"} Jun 08 13:01:44.644374 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:44.644313 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lhgpn" podStartSLOduration=5.141922647 podStartE2EDuration="23.644293828s" totalImagesPullingTime="18.502371181s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:44.643681461 +0000 UTC m=+23.612980993" watchObservedRunningTime="2026-06-08 13:01:44.644293828 +0000 UTC m=+23.613593362" Jun 08 13:01:45.497544 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:45.497413 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-08T13:01:44.547465611Z","UUID":"032f29f3-50a5-4227-bb5d-6fe6661a3649","Handler":null,"Name":"","Endpoint":""} Jun 08 13:01:45.503289 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:45.503264 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 08 13:01:45.503428 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:45.503325 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 08 13:01:45.508786 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:45.508760 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:45.508982 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:45.508784 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:45.508982 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:45.508761 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:45.508982 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:45.508894 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:45.509124 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:45.509026 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:45.509124 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:45.509087 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:45.633383 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:45.633340 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" event={"ID":"2b47b934-efd8-44df-9382-209e5f10d701","Type":"ContainerStarted","Data":"c8412bbf515d12fa8211ca82fffe27965f07b4efa90167ca677142fd75ceb1dc"} Jun 08 13:01:45.657234 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:45.657190 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-28jh5" podStartSLOduration=3.9494724789999998 podStartE2EDuration="24.657176102s" totalImagesPullingTime="20.707703623s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:45.656702473 +0000 UTC m=+24.626002006" watchObservedRunningTime="2026-06-08 13:01:45.657176102 +0000 UTC m=+24.626475664" Jun 08 13:01:46.638255 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:46.638228 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:01:46.638819 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:46.638593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" event={"ID":"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9","Type":"ContainerStarted","Data":"91e91fcd9c08c34b9d9ffa07f318783c7d6ac8389cdf4a48fb3b8e9f58af33c9"} Jun 08 13:01:47.049643 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:47.049550 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:47.050377 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:47.050359 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:47.508418 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:47.508386 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:47.508418 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:47.508422 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:47.508675 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:47.508387 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:47.508675 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:47.508527 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:47.508675 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:47.508633 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:47.508831 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:47.508744 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:49.325961 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.325690 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:49.326462 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.326062 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 08 13:01:49.326462 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.326294 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-thf4s" Jun 08 13:01:49.508527 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.508497 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:49.508527 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.508513 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:49.508771 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.508513 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:49.508771 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:49.508603 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:49.508771 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:49.508694 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:49.508771 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:49.508749 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:49.648707 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.648681 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:01:49.649067 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.649038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" event={"ID":"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9","Type":"ContainerStarted","Data":"e3ee2a395c0960db0a72c2c72135c633e1948d3fe1b3f24d3f3c67203ed0071e"} Jun 08 13:01:49.649290 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.649271 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:49.649382 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.649339 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:49.649505 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.649487 2563 scope.go:117] "RemoveContainer" containerID="6d5de355f4aea074902ee091bbade7dcacf8801549c0ff60dc9cc275a37ba255" Jun 08 13:01:49.651050 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.651024 2563 generic.go:356] "Generic (PLEG): container finished" podID="fdc26cc8-331e-4431-b20c-13d3b05a7f7a" containerID="68fb90d4f5aaf2cc2e3135ab718db0d4f9aecb1d517db9e8290c6c94a2d6284f" exitCode=0 Jun 08 13:01:49.651132 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.651101 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqvxc" event={"ID":"fdc26cc8-331e-4431-b20c-13d3b05a7f7a","Type":"ContainerDied","Data":"68fb90d4f5aaf2cc2e3135ab718db0d4f9aecb1d517db9e8290c6c94a2d6284f"} Jun 08 13:01:49.665733 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:49.665712 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:50.656101 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.655885 2563 generic.go:356] "Generic (PLEG): container finished" podID="fdc26cc8-331e-4431-b20c-13d3b05a7f7a" containerID="820bf81638eee5378cc6f3f91f56c93401a5cc1116f049ec2a2d68b4a9a244e3" exitCode=0 Jun 08 13:01:50.656740 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.655966 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqvxc" event={"ID":"fdc26cc8-331e-4431-b20c-13d3b05a7f7a","Type":"ContainerDied","Data":"820bf81638eee5378cc6f3f91f56c93401a5cc1116f049ec2a2d68b4a9a244e3"} Jun 08 13:01:50.656975 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.656876 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8wxnn"] Jun 08 13:01:50.656975 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.656956 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:50.657077 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:50.657053 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:50.660189 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.660170 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:01:50.660516 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.660482 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" event={"ID":"0e52b7d1-3feb-43f7-b83e-37a3ed9500c9","Type":"ContainerStarted","Data":"37fb3048c623634e5206887e952b04484d01935339d41160caeec52685b703fc"} Jun 08 13:01:50.660758 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.660737 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:50.661260 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.661241 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b4rvp"] Jun 08 13:01:50.661336 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.661313 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:50.661399 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:50.661380 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:50.675320 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.675297 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:01:50.685259 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.685240 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nh6j9"] Jun 08 13:01:50.685344 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:50.685324 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:50.685417 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:50.685402 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:51.664733 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:51.664698 2563 generic.go:356] "Generic (PLEG): container finished" podID="fdc26cc8-331e-4431-b20c-13d3b05a7f7a" containerID="a7e4a12c67fc633e8050fdaee1600e5e686fec3bd7cfe36b414d82fbfc1892a6" exitCode=0 Jun 08 13:01:51.665406 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:51.664779 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqvxc" event={"ID":"fdc26cc8-331e-4431-b20c-13d3b05a7f7a","Type":"ContainerDied","Data":"a7e4a12c67fc633e8050fdaee1600e5e686fec3bd7cfe36b414d82fbfc1892a6"} Jun 08 13:01:51.696971 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:51.696186 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" podStartSLOduration=12.103990511 podStartE2EDuration="30.696166697s" totalImagesPullingTime="18.592176186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:50.764293928 +0000 UTC m=+29.733593462" watchObservedRunningTime="2026-06-08 13:01:51.696166697 +0000 UTC m=+30.665466230" Jun 08 13:01:52.508428 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:52.508348 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:52.508428 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:52.508369 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:52.508428 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:52.508382 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:52.508723 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:52.508490 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:52.508723 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:52.508632 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:52.508723 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:52.508716 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:54.508142 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:54.508107 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:54.508778 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:54.508244 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:54.508778 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:54.508260 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nh6j9" podUID="4f862e24-ab62-4209-af23-69a7e0773972" Jun 08 13:01:54.508778 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:54.508281 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:54.508778 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:54.508377 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b4rvp" podUID="d3a8dcb3-1700-4cc9-a515-fcf7ac698a48" Jun 08 13:01:54.508778 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:54.508466 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:01:55.213937 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.213724 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:55.214175 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.213985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:55.214175 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:55.213891 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:55.214175 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:55.214113 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret podName:d3a8dcb3-1700-4cc9-a515-fcf7ac698a48 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:27.214091018 +0000 UTC m=+66.183390547 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret") pod "global-pull-secret-syncer-b4rvp" (UID: "d3a8dcb3-1700-4cc9-a515-fcf7ac698a48") : object "kube-system"/"original-pull-secret" not registered Jun 08 13:01:55.214175 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:55.214139 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:55.214371 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:55.214184 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs podName:9f6593ad-e136-4f32-9fc5-4fedcabdebed nodeName:}" failed. No retries permitted until 2026-06-08 13:02:27.214169556 +0000 UTC m=+66.183469083 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs") pod "network-metrics-daemon-8wxnn" (UID: "9f6593ad-e136-4f32-9fc5-4fedcabdebed") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 08 13:01:55.415982 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.415941 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5x6\" (UniqueName: \"kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6\") pod \"network-check-target-nh6j9\" (UID: \"4f862e24-ab62-4209-af23-69a7e0773972\") " pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:55.416175 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:55.416095 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 08 13:01:55.416175 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:55.416117 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 08 13:01:55.416175 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:55.416126 2563 projected.go:196] Error preparing data for projected volume kube-api-access-8w5x6 for pod openshift-network-diagnostics/network-check-target-nh6j9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:55.416288 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:55.416185 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6 podName:4f862e24-ab62-4209-af23-69a7e0773972 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:27.416170569 +0000 UTC m=+66.385470077 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8w5x6" (UniqueName: "kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6") pod "network-check-target-nh6j9" (UID: "4f862e24-ab62-4209-af23-69a7e0773972") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 08 13:01:55.881240 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.881214 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-189.ec2.internal" event="NodeReady" Jun 08 13:01:55.881693 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.881345 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 08 13:01:55.941320 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.941277 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-pw4f9"] Jun 08 13:01:55.961261 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.961221 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-h8d68"] Jun 08 13:01:55.961425 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.961365 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:55.963930 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.963906 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 08 13:01:55.964079 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.964065 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 08 13:01:55.964150 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.964141 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8gt5m\"" Jun 08 13:01:55.983368 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.983345 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h8d68"] Jun 08 13:01:55.983488 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.983374 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pw4f9"] Jun 08 13:01:55.983488 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.983470 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h8d68" Jun 08 13:01:55.986322 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.986296 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 08 13:01:55.986448 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.986418 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 08 13:01:55.986652 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.986494 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-b76ln\"" Jun 08 13:01:55.986652 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:55.986523 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 08 13:01:56.120693 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.120670 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.120826 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.120701 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qrk7\" (UniqueName: \"kubernetes.io/projected/52584272-7c62-4cfc-8430-f6556b92a686-kube-api-access-9qrk7\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.120826 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.120762 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52584272-7c62-4cfc-8430-f6556b92a686-config-volume\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.120933 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.120815 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52584272-7c62-4cfc-8430-f6556b92a686-tmp-dir\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.120933 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.120877 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fh2g9\" (UniqueName: \"kubernetes.io/projected/d3019b3f-b998-4ff6-a9db-23882da23487-kube-api-access-fh2g9\") pod \"ingress-canary-h8d68\" (UID: \"d3019b3f-b998-4ff6-a9db-23882da23487\") " pod="openshift-ingress-canary/ingress-canary-h8d68" Jun 08 13:01:56.120933 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.120924 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3019b3f-b998-4ff6-a9db-23882da23487-cert\") pod \"ingress-canary-h8d68\" (UID: \"d3019b3f-b998-4ff6-a9db-23882da23487\") " pod="openshift-ingress-canary/ingress-canary-h8d68" Jun 08 13:01:56.221852 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.221802 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52584272-7c62-4cfc-8430-f6556b92a686-config-volume\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.221852 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.221846 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52584272-7c62-4cfc-8430-f6556b92a686-tmp-dir\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.222137 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.221867 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fh2g9\" (UniqueName: \"kubernetes.io/projected/d3019b3f-b998-4ff6-a9db-23882da23487-kube-api-access-fh2g9\") pod \"ingress-canary-h8d68\" (UID: \"d3019b3f-b998-4ff6-a9db-23882da23487\") " pod="openshift-ingress-canary/ingress-canary-h8d68" Jun 08 13:01:56.222137 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.221885 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3019b3f-b998-4ff6-a9db-23882da23487-cert\") pod \"ingress-canary-h8d68\" (UID: \"d3019b3f-b998-4ff6-a9db-23882da23487\") " pod="openshift-ingress-canary/ingress-canary-h8d68" Jun 08 13:01:56.222137 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.221911 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.222137 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.221925 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qrk7\" (UniqueName: \"kubernetes.io/projected/52584272-7c62-4cfc-8430-f6556b92a686-kube-api-access-9qrk7\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.222137 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:56.222056 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:56.222137 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:56.222134 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls podName:52584272-7c62-4cfc-8430-f6556b92a686 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:56.722112473 +0000 UTC m=+35.691411986 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls") pod "dns-default-pw4f9" (UID: "52584272-7c62-4cfc-8430-f6556b92a686") : secret "dns-default-metrics-tls" not found Jun 08 13:01:56.222417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.222231 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/52584272-7c62-4cfc-8430-f6556b92a686-tmp-dir\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.222585 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.222537 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/52584272-7c62-4cfc-8430-f6556b92a686-config-volume\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.226410 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.226391 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d3019b3f-b998-4ff6-a9db-23882da23487-cert\") pod \"ingress-canary-h8d68\" (UID: \"d3019b3f-b998-4ff6-a9db-23882da23487\") " pod="openshift-ingress-canary/ingress-canary-h8d68" Jun 08 13:01:56.237633 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.237577 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qrk7\" (UniqueName: \"kubernetes.io/projected/52584272-7c62-4cfc-8430-f6556b92a686-kube-api-access-9qrk7\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.242309 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.242259 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fh2g9\" (UniqueName: \"kubernetes.io/projected/d3019b3f-b998-4ff6-a9db-23882da23487-kube-api-access-fh2g9\") pod \"ingress-canary-h8d68\" (UID: \"d3019b3f-b998-4ff6-a9db-23882da23487\") " pod="openshift-ingress-canary/ingress-canary-h8d68" Jun 08 13:01:56.292170 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.292125 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-h8d68" Jun 08 13:01:56.465545 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.465513 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-h8d68"] Jun 08 13:01:56.469311 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:01:56.469284 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3019b3f_b998_4ff6_a9db_23882da23487.slice/crio-7005a6bd8e4737847c760ec5624ad28fe9f61fd9951b18adfe0f6792c1ea0bc2 WatchSource:0}: Error finding container 7005a6bd8e4737847c760ec5624ad28fe9f61fd9951b18adfe0f6792c1ea0bc2: Status 404 returned error can't find the container with id 7005a6bd8e4737847c760ec5624ad28fe9f61fd9951b18adfe0f6792c1ea0bc2 Jun 08 13:01:56.508668 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.508640 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:01:56.508668 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.508668 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:01:56.508863 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.508640 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:01:56.513867 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.513847 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:01:56.514010 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.513945 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 13:01:56.514103 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.514086 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:01:56.514206 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.514190 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4dhf\"" Jun 08 13:01:56.514809 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.514794 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 13:01:56.514855 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.514794 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wn2mf\"" Jun 08 13:01:56.677193 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.677105 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h8d68" event={"ID":"d3019b3f-b998-4ff6-a9db-23882da23487","Type":"ContainerStarted","Data":"7005a6bd8e4737847c760ec5624ad28fe9f61fd9951b18adfe0f6792c1ea0bc2"} Jun 08 13:01:56.679913 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.679889 2563 generic.go:356] "Generic (PLEG): container finished" podID="fdc26cc8-331e-4431-b20c-13d3b05a7f7a" containerID="0cb3347786d1d5140648b00f29235d780dd9fb388d89dfe81046f73bc02bcfe9" exitCode=0 Jun 08 13:01:56.680094 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.679944 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqvxc" event={"ID":"fdc26cc8-331e-4431-b20c-13d3b05a7f7a","Type":"ContainerDied","Data":"0cb3347786d1d5140648b00f29235d780dd9fb388d89dfe81046f73bc02bcfe9"} Jun 08 13:01:56.725781 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:56.725584 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:56.725883 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:56.725667 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:56.725883 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:56.725870 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls podName:52584272-7c62-4cfc-8430-f6556b92a686 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:57.725853718 +0000 UTC m=+36.695153231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls") pod "dns-default-pw4f9" (UID: "52584272-7c62-4cfc-8430-f6556b92a686") : secret "dns-default-metrics-tls" not found Jun 08 13:01:57.685853 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:57.685819 2563 generic.go:356] "Generic (PLEG): container finished" podID="fdc26cc8-331e-4431-b20c-13d3b05a7f7a" containerID="58de804b8b40d15c7b7095ff25c23aecca06b3a86be02b7fb227bd69701dce0c" exitCode=0 Jun 08 13:01:57.686279 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:57.685878 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqvxc" event={"ID":"fdc26cc8-331e-4431-b20c-13d3b05a7f7a","Type":"ContainerDied","Data":"58de804b8b40d15c7b7095ff25c23aecca06b3a86be02b7fb227bd69701dce0c"} Jun 08 13:01:57.733029 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:57.732996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:57.733144 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:57.733123 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:57.733203 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:57.733189 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls podName:52584272-7c62-4cfc-8430-f6556b92a686 nodeName:}" failed. No retries permitted until 2026-06-08 13:01:59.733170264 +0000 UTC m=+38.702469797 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls") pod "dns-default-pw4f9" (UID: "52584272-7c62-4cfc-8430-f6556b92a686") : secret "dns-default-metrics-tls" not found Jun 08 13:01:58.692283 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:58.692248 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wqvxc" event={"ID":"fdc26cc8-331e-4431-b20c-13d3b05a7f7a","Type":"ContainerStarted","Data":"ceb481493b48e91392906d1e9da944c280b441bc2cc7906f290e15dc17955a95"} Jun 08 13:01:58.717603 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:58.717532 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wqvxc" podStartSLOduration=8.34265349 podStartE2EDuration="37.717515216s" totalImagesPullingTime="29.374861726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:58.71714213 +0000 UTC m=+37.686441685" watchObservedRunningTime="2026-06-08 13:01:58.717515216 +0000 UTC m=+37.686814724" Jun 08 13:01:59.695748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:59.695709 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-h8d68" event={"ID":"d3019b3f-b998-4ff6-a9db-23882da23487","Type":"ContainerStarted","Data":"aaf310958939079a95e6963f99c90f871405be5aff1c5d281f1ca43ef6cf030c"} Jun 08 13:01:59.714071 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:59.714021 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-h8d68" podStartSLOduration=2.065065214 podStartE2EDuration="4.714005186s" totalImagesPullingTime="2.648939972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:01:59.712879447 +0000 UTC m=+38.682178990" watchObservedRunningTime="2026-06-08 13:01:59.714005186 +0000 UTC m=+38.683304694" Jun 08 13:01:59.748718 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:01:59.748685 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:01:59.748875 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:59.748841 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:01:59.748917 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:01:59.748904 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls podName:52584272-7c62-4cfc-8430-f6556b92a686 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:03.748889121 +0000 UTC m=+42.718188631 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls") pod "dns-default-pw4f9" (UID: "52584272-7c62-4cfc-8430-f6556b92a686") : secret "dns-default-metrics-tls" not found Jun 08 13:02:02.977767 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:02.977738 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj"] Jun 08 13:02:03.008922 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.008893 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj"] Jun 08 13:02:03.008922 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.008926 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z"] Jun 08 13:02:03.009116 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.009026 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" Jun 08 13:02:03.011353 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.011320 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 08 13:02:03.011482 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.011402 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 08 13:02:03.011482 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.011413 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 08 13:02:03.011596 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.011576 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 08 13:02:03.012219 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.012203 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-8f2dv\"" Jun 08 13:02:03.022371 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.022352 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z"] Jun 08 13:02:03.022495 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.022459 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.024948 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.024929 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 08 13:02:03.025032 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.024971 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 08 13:02:03.025081 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.025028 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 08 13:02:03.025208 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.025195 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 08 13:02:03.174173 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.174133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfa20476-0d82-4323-b2d7-f760652fe25f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.174357 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.174188 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-ca\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.174357 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.174249 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.174357 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.174286 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw7j7\" (UniqueName: \"kubernetes.io/projected/3cedba23-6666-47f2-a343-3ceefdbd6244-kube-api-access-vw7j7\") pod \"managed-serviceaccount-addon-agent-5b765f9f84-gwwsj\" (UID: \"3cedba23-6666-47f2-a343-3ceefdbd6244\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" Jun 08 13:02:03.174499 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.174360 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-hub\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.174499 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.174378 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.174499 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.174403 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cedba23-6666-47f2-a343-3ceefdbd6244-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b765f9f84-gwwsj\" (UID: \"3cedba23-6666-47f2-a343-3ceefdbd6244\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" Jun 08 13:02:03.174499 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.174465 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxfmv\" (UniqueName: \"kubernetes.io/projected/cfa20476-0d82-4323-b2d7-f760652fe25f-kube-api-access-pxfmv\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.275587 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.275490 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.275587 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.275527 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw7j7\" (UniqueName: \"kubernetes.io/projected/3cedba23-6666-47f2-a343-3ceefdbd6244-kube-api-access-vw7j7\") pod \"managed-serviceaccount-addon-agent-5b765f9f84-gwwsj\" (UID: \"3cedba23-6666-47f2-a343-3ceefdbd6244\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" Jun 08 13:02:03.275769 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.275712 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-hub\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.275769 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.275748 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.275867 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.275768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cedba23-6666-47f2-a343-3ceefdbd6244-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b765f9f84-gwwsj\" (UID: \"3cedba23-6666-47f2-a343-3ceefdbd6244\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" Jun 08 13:02:03.275949 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.275934 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxfmv\" (UniqueName: \"kubernetes.io/projected/cfa20476-0d82-4323-b2d7-f760652fe25f-kube-api-access-pxfmv\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.275995 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.275959 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfa20476-0d82-4323-b2d7-f760652fe25f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.275995 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.275983 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-ca\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.276669 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.276642 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfa20476-0d82-4323-b2d7-f760652fe25f-additional-service-ca\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.279402 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.279376 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-ca\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.279511 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.279444 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.279511 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.279468 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.279511 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.279446 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cfa20476-0d82-4323-b2d7-f760652fe25f-hub\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.279644 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.279612 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3cedba23-6666-47f2-a343-3ceefdbd6244-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5b765f9f84-gwwsj\" (UID: \"3cedba23-6666-47f2-a343-3ceefdbd6244\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" Jun 08 13:02:03.283770 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.283745 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxfmv\" (UniqueName: \"kubernetes.io/projected/cfa20476-0d82-4323-b2d7-f760652fe25f-kube-api-access-pxfmv\") pod \"cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z\" (UID: \"cfa20476-0d82-4323-b2d7-f760652fe25f\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.284044 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.284026 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw7j7\" (UniqueName: \"kubernetes.io/projected/3cedba23-6666-47f2-a343-3ceefdbd6244-kube-api-access-vw7j7\") pod \"managed-serviceaccount-addon-agent-5b765f9f84-gwwsj\" (UID: \"3cedba23-6666-47f2-a343-3ceefdbd6244\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" Jun 08 13:02:03.328934 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.328896 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" Jun 08 13:02:03.339078 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.339052 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:02:03.485788 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.485745 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj"] Jun 08 13:02:03.490355 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:02:03.490325 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cedba23_6666_47f2_a343_3ceefdbd6244.slice/crio-acb50e9b327b953438c3dfc83a43ad428f5235ac9992555d5eda13995d2c4b7b WatchSource:0}: Error finding container acb50e9b327b953438c3dfc83a43ad428f5235ac9992555d5eda13995d2c4b7b: Status 404 returned error can't find the container with id acb50e9b327b953438c3dfc83a43ad428f5235ac9992555d5eda13995d2c4b7b Jun 08 13:02:03.534376 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.534307 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z"] Jun 08 13:02:03.537252 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:02:03.537228 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcfa20476_0d82_4323_b2d7_f760652fe25f.slice/crio-162183cceb33182660c418ead9f3f3f8319fdf5247e66e88c742e4228a1a2fb5 WatchSource:0}: Error finding container 162183cceb33182660c418ead9f3f3f8319fdf5247e66e88c742e4228a1a2fb5: Status 404 returned error can't find the container with id 162183cceb33182660c418ead9f3f3f8319fdf5247e66e88c742e4228a1a2fb5 Jun 08 13:02:03.706645 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.706608 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" event={"ID":"cfa20476-0d82-4323-b2d7-f760652fe25f","Type":"ContainerStarted","Data":"162183cceb33182660c418ead9f3f3f8319fdf5247e66e88c742e4228a1a2fb5"} Jun 08 13:02:03.707517 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.707494 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" event={"ID":"3cedba23-6666-47f2-a343-3ceefdbd6244","Type":"ContainerStarted","Data":"acb50e9b327b953438c3dfc83a43ad428f5235ac9992555d5eda13995d2c4b7b"} Jun 08 13:02:03.779472 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:03.779448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:02:03.779608 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:02:03.779599 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:02:03.779666 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:02:03.779656 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls podName:52584272-7c62-4cfc-8430-f6556b92a686 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:11.779640398 +0000 UTC m=+50.748939918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls") pod "dns-default-pw4f9" (UID: "52584272-7c62-4cfc-8430-f6556b92a686") : secret "dns-default-metrics-tls" not found Jun 08 13:02:07.719994 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:07.719956 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" event={"ID":"cfa20476-0d82-4323-b2d7-f760652fe25f","Type":"ContainerStarted","Data":"b9139fbc17849f49cc4cfa5902466b8e7348ac123c6594bedb091d25ed68f861"} Jun 08 13:02:07.720353 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:07.720003 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" event={"ID":"cfa20476-0d82-4323-b2d7-f760652fe25f","Type":"ContainerStarted","Data":"573effe0d748a146e83fd5a7f828c522844891d30c5515eb8ed2e5f8291f1ed2"} Jun 08 13:02:07.720353 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:07.720015 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" event={"ID":"cfa20476-0d82-4323-b2d7-f760652fe25f","Type":"ContainerStarted","Data":"74a33593f79f018ad5001a49a82ea3c70669461230397c989a80f84d9b96be43"} Jun 08 13:02:07.741313 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:07.741266 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" podStartSLOduration=1.955000494 podStartE2EDuration="5.741252144s" totalImagesPullingTime="3.78625165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:07.740797177 +0000 UTC m=+46.710096709" watchObservedRunningTime="2026-06-08 13:02:07.741252144 +0000 UTC m=+46.710551674" Jun 08 13:02:11.835412 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:11.835371 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:02:11.835950 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:02:11.835513 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:02:11.835950 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:02:11.835605 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls podName:52584272-7c62-4cfc-8430-f6556b92a686 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:27.835584854 +0000 UTC m=+66.804884383 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls") pod "dns-default-pw4f9" (UID: "52584272-7c62-4cfc-8430-f6556b92a686") : secret "dns-default-metrics-tls" not found Jun 08 13:02:14.738154 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:14.738062 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" event={"ID":"3cedba23-6666-47f2-a343-3ceefdbd6244","Type":"ContainerStarted","Data":"32800a93ea4b6458e2897ebb5abec56eefed4d5c69aa7f2a94ff4902ec4acc29"} Jun 08 13:02:14.754442 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:14.754395 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" podStartSLOduration=1.7847414860000002 podStartE2EDuration="12.754381439s" totalImagesPullingTime="10.969639953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:14.753893933 +0000 UTC m=+53.723193462" watchObservedRunningTime="2026-06-08 13:02:14.754381439 +0000 UTC m=+53.723680969" Jun 08 13:02:22.678054 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:22.678019 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mgn84" Jun 08 13:02:27.243137 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.243095 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:02:27.243590 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.243187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:02:27.245687 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.245672 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 08 13:02:27.245745 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.245714 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 08 13:02:27.253864 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:02:27.253846 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 13:02:27.253923 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:02:27.253914 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs podName:9f6593ad-e136-4f32-9fc5-4fedcabdebed nodeName:}" failed. No retries permitted until 2026-06-08 13:03:31.253898486 +0000 UTC m=+130.223197995 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs") pod "network-metrics-daemon-8wxnn" (UID: "9f6593ad-e136-4f32-9fc5-4fedcabdebed") : secret "metrics-daemon-secret" not found Jun 08 13:02:27.255883 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.255860 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d3a8dcb3-1700-4cc9-a515-fcf7ac698a48-original-pull-secret\") pod \"global-pull-secret-syncer-b4rvp\" (UID: \"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48\") " pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:02:27.424267 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.424232 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b4rvp" Jun 08 13:02:27.444914 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.444879 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8w5x6\" (UniqueName: \"kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6\") pod \"network-check-target-nh6j9\" (UID: \"4f862e24-ab62-4209-af23-69a7e0773972\") " pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:02:27.447638 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.447620 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 08 13:02:27.458223 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.458198 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 08 13:02:27.468636 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.468614 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8w5x6\" (UniqueName: \"kubernetes.io/projected/4f862e24-ab62-4209-af23-69a7e0773972-kube-api-access-8w5x6\") pod \"network-check-target-nh6j9\" (UID: \"4f862e24-ab62-4209-af23-69a7e0773972\") " pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:02:27.567773 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.567744 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b4rvp"] Jun 08 13:02:27.571134 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:02:27.571100 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3a8dcb3_1700_4cc9_a515_fcf7ac698a48.slice/crio-110a1e97d522826d61d7328559e07d025351c5c0e4115cec2e4da86834116415 WatchSource:0}: Error finding container 110a1e97d522826d61d7328559e07d025351c5c0e4115cec2e4da86834116415: Status 404 returned error can't find the container with id 110a1e97d522826d61d7328559e07d025351c5c0e4115cec2e4da86834116415 Jun 08 13:02:27.733714 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.731006 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-g4dhf\"" Jun 08 13:02:27.738496 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.738469 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:02:27.770074 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.770045 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b4rvp" event={"ID":"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48","Type":"ContainerStarted","Data":"110a1e97d522826d61d7328559e07d025351c5c0e4115cec2e4da86834116415"} Jun 08 13:02:27.848163 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.848128 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:02:27.848318 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:02:27.848285 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:02:27.848365 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:02:27.848352 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls podName:52584272-7c62-4cfc-8430-f6556b92a686 nodeName:}" failed. No retries permitted until 2026-06-08 13:02:59.848334994 +0000 UTC m=+98.817634523 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls") pod "dns-default-pw4f9" (UID: "52584272-7c62-4cfc-8430-f6556b92a686") : secret "dns-default-metrics-tls" not found Jun 08 13:02:27.858775 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:27.858747 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nh6j9"] Jun 08 13:02:27.861638 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:02:27.861618 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f862e24_ab62_4209_af23_69a7e0773972.slice/crio-b85fd5c1972fc1f26e31f75f1d05fa34e994c02a8888e0a9b187c60e02e994bb WatchSource:0}: Error finding container b85fd5c1972fc1f26e31f75f1d05fa34e994c02a8888e0a9b187c60e02e994bb: Status 404 returned error can't find the container with id b85fd5c1972fc1f26e31f75f1d05fa34e994c02a8888e0a9b187c60e02e994bb Jun 08 13:02:28.776134 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:28.776087 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nh6j9" event={"ID":"4f862e24-ab62-4209-af23-69a7e0773972","Type":"ContainerStarted","Data":"b85fd5c1972fc1f26e31f75f1d05fa34e994c02a8888e0a9b187c60e02e994bb"} Jun 08 13:02:32.788489 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:32.788452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b4rvp" event={"ID":"d3a8dcb3-1700-4cc9-a515-fcf7ac698a48","Type":"ContainerStarted","Data":"806a977c5bb59b881ed9860fb9882bba2a99b56eead4b7a6be877067d0614538"} Jun 08 13:02:32.789945 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:32.789921 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nh6j9" event={"ID":"4f862e24-ab62-4209-af23-69a7e0773972","Type":"ContainerStarted","Data":"152c7f7e756d71494436344da8b38db07415394cbce2fa840a25a52154ded779"} Jun 08 13:02:32.790065 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:32.790048 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:02:32.807000 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:32.806953 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b4rvp" podStartSLOduration=67.298778774 podStartE2EDuration="1m11.806938926s" totalImagesPullingTime="4.508160152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:32.806410611 +0000 UTC m=+71.775710143" watchObservedRunningTime="2026-06-08 13:02:32.806938926 +0000 UTC m=+71.776238456" Jun 08 13:02:32.823788 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:32.823740 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nh6j9" podStartSLOduration=67.608755266 podStartE2EDuration="1m11.823725833s" totalImagesPullingTime="4.214970567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:02:32.82354135 +0000 UTC m=+71.792840882" watchObservedRunningTime="2026-06-08 13:02:32.823725833 +0000 UTC m=+71.793025394" Jun 08 13:02:59.880816 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:02:59.880694 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:02:59.881319 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:02:59.880823 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:02:59.881319 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:02:59.880876 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls podName:52584272-7c62-4cfc-8430-f6556b92a686 nodeName:}" failed. No retries permitted until 2026-06-08 13:04:03.880861581 +0000 UTC m=+162.850161090 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls") pod "dns-default-pw4f9" (UID: "52584272-7c62-4cfc-8430-f6556b92a686") : secret "dns-default-metrics-tls" not found Jun 08 13:03:03.796473 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:03:03.796438 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nh6j9" Jun 08 13:03:31.299238 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:03:31.299191 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:03:31.299790 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:03:31.299347 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 13:03:31.299790 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:03:31.299413 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs podName:9f6593ad-e136-4f32-9fc5-4fedcabdebed nodeName:}" failed. No retries permitted until 2026-06-08 13:05:33.299396842 +0000 UTC m=+252.268696351 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs") pod "network-metrics-daemon-8wxnn" (UID: "9f6593ad-e136-4f32-9fc5-4fedcabdebed") : secret "metrics-daemon-secret" not found Jun 08 13:03:58.971884 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:03:58.971840 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pw4f9" podUID="52584272-7c62-4cfc-8430-f6556b92a686" Jun 08 13:03:59.034990 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:03:59.034956 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pw4f9" Jun 08 13:03:59.517947 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:03:59.517913 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:04:03.926003 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:04:03.925953 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:04:03.926420 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:04:03.926107 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 08 13:04:03.926420 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:04:03.926191 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls podName:52584272-7c62-4cfc-8430-f6556b92a686 nodeName:}" failed. No retries permitted until 2026-06-08 13:06:05.926173034 +0000 UTC m=+284.895472546 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls") pod "dns-default-pw4f9" (UID: "52584272-7c62-4cfc-8430-f6556b92a686") : secret "dns-default-metrics-tls" not found Jun 08 13:04:12.508759 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:04:12.508669 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:04:15.079736 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:04:15.079635 2563 generic.go:356] "Generic (PLEG): container finished" podID="3cedba23-6666-47f2-a343-3ceefdbd6244" containerID="32800a93ea4b6458e2897ebb5abec56eefed4d5c69aa7f2a94ff4902ec4acc29" exitCode=255 Jun 08 13:04:15.079736 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:04:15.079703 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" event={"ID":"3cedba23-6666-47f2-a343-3ceefdbd6244","Type":"ContainerDied","Data":"32800a93ea4b6458e2897ebb5abec56eefed4d5c69aa7f2a94ff4902ec4acc29"} Jun 08 13:04:15.080243 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:04:15.080072 2563 scope.go:117] "RemoveContainer" containerID="32800a93ea4b6458e2897ebb5abec56eefed4d5c69aa7f2a94ff4902ec4acc29" Jun 08 13:04:16.084510 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:04:16.084475 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5b765f9f84-gwwsj" event={"ID":"3cedba23-6666-47f2-a343-3ceefdbd6244","Type":"ContainerStarted","Data":"4f3fc0a086529fe4a50744904f3e44b41558534a9578be5edeb6589d12df011f"} Jun 08 13:05:26.163318 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:26.163287 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qwjck_919f32d7-40ac-4223-a344-c3194fdcceac/dns-node-resolver/0.log" Jun 08 13:05:26.965872 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:26.965844 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wk4st_2e04f1b8-a81d-4bfa-87ef-91242730bb29/node-ca/0.log" Jun 08 13:05:27.767738 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:27.767712 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h8d68_d3019b3f-b998-4ff6-a9db-23882da23487/serve-healthcheck-canary/0.log" Jun 08 13:05:33.358312 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:33.358277 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:05:33.358776 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:05:33.358397 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 08 13:05:33.358776 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:05:33.358452 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs podName:9f6593ad-e136-4f32-9fc5-4fedcabdebed nodeName:}" failed. No retries permitted until 2026-06-08 13:07:35.358434932 +0000 UTC m=+374.327734442 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs") pod "network-metrics-daemon-8wxnn" (UID: "9f6593ad-e136-4f32-9fc5-4fedcabdebed") : secret "metrics-daemon-secret" not found Jun 08 13:05:47.457444 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.457366 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2qjhd"] Jun 08 13:05:47.459418 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.459403 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.462971 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.462948 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 08 13:05:47.462971 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.462961 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h74dt\"" Jun 08 13:05:47.463147 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.462961 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 08 13:05:47.463147 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.462978 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 08 13:05:47.463147 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.462995 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 08 13:05:47.475366 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.475297 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2qjhd"] Jun 08 13:05:47.553614 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.553581 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43306606-03c4-42f2-84f1-809f998eb0cd-crio-socket\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.553614 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.553617 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43306606-03c4-42f2-84f1-809f998eb0cd-data-volume\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.553829 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.553708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43306606-03c4-42f2-84f1-809f998eb0cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.553829 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.553738 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43306606-03c4-42f2-84f1-809f998eb0cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.553829 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.553781 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm6v5\" (UniqueName: \"kubernetes.io/projected/43306606-03c4-42f2-84f1-809f998eb0cd-kube-api-access-wm6v5\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.654889 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.654854 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43306606-03c4-42f2-84f1-809f998eb0cd-crio-socket\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.654889 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.654889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43306606-03c4-42f2-84f1-809f998eb0cd-data-volume\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.655128 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.654929 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43306606-03c4-42f2-84f1-809f998eb0cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.655128 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.654952 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43306606-03c4-42f2-84f1-809f998eb0cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.655128 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.654974 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm6v5\" (UniqueName: \"kubernetes.io/projected/43306606-03c4-42f2-84f1-809f998eb0cd-kube-api-access-wm6v5\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.655128 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.655013 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43306606-03c4-42f2-84f1-809f998eb0cd-crio-socket\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.655264 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.655236 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43306606-03c4-42f2-84f1-809f998eb0cd-data-volume\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.655490 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.655467 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43306606-03c4-42f2-84f1-809f998eb0cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.657345 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.657326 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43306606-03c4-42f2-84f1-809f998eb0cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.670192 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.670171 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm6v5\" (UniqueName: \"kubernetes.io/projected/43306606-03c4-42f2-84f1-809f998eb0cd-kube-api-access-wm6v5\") pod \"insights-runtime-extractor-2qjhd\" (UID: \"43306606-03c4-42f2-84f1-809f998eb0cd\") " pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.767910 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.767832 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2qjhd" Jun 08 13:05:47.893683 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:47.893652 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2qjhd"] Jun 08 13:05:47.896887 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:05:47.896858 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43306606_03c4_42f2_84f1_809f998eb0cd.slice/crio-d81d5140e67e95105c8741f9752c283ce247988e0d541790ddadbd95810f1353 WatchSource:0}: Error finding container d81d5140e67e95105c8741f9752c283ce247988e0d541790ddadbd95810f1353: Status 404 returned error can't find the container with id d81d5140e67e95105c8741f9752c283ce247988e0d541790ddadbd95810f1353 Jun 08 13:05:48.336459 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:48.336421 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qjhd" event={"ID":"43306606-03c4-42f2-84f1-809f998eb0cd","Type":"ContainerStarted","Data":"58174e1656fedaf99ea99c67ae4b2835b5a9fcef9f767e3fd5175ab065ad6676"} Jun 08 13:05:48.336653 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:48.336477 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qjhd" event={"ID":"43306606-03c4-42f2-84f1-809f998eb0cd","Type":"ContainerStarted","Data":"d81d5140e67e95105c8741f9752c283ce247988e0d541790ddadbd95810f1353"} Jun 08 13:05:49.340956 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:49.340921 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qjhd" event={"ID":"43306606-03c4-42f2-84f1-809f998eb0cd","Type":"ContainerStarted","Data":"520f5caab334483fa7f12d5d72c4252981c2a5747f69cd3a4513f46b1f41e02b"} Jun 08 13:05:51.349426 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:51.349385 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2qjhd" event={"ID":"43306606-03c4-42f2-84f1-809f998eb0cd","Type":"ContainerStarted","Data":"c8aa35b0a9aaccf5701693ce26eb244f92d3135ba1b4389db436f8c9e6a74fa1"} Jun 08 13:05:51.379883 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:51.379834 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2qjhd" podStartSLOduration=1.848981793 podStartE2EDuration="4.379818269s" totalImagesPullingTime="2.530836476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:05:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:51.3791934 +0000 UTC m=+270.348492931" watchObservedRunningTime="2026-06-08 13:05:51.379818269 +0000 UTC m=+270.349117800" Jun 08 13:05:51.952466 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:51.952436 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr"] Jun 08 13:05:51.954227 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:51.954211 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr" Jun 08 13:05:51.960394 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:51.960370 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 08 13:05:51.960837 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:51.960819 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jl96p\"" Jun 08 13:05:51.981309 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:51.981281 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr"] Jun 08 13:05:51.986454 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:51.986430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97355ff4-2350-4e8c-b163-9f2a99594b31-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-qkljr\" (UID: \"97355ff4-2350-4e8c-b163-9f2a99594b31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr" Jun 08 13:05:52.087422 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:52.087370 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97355ff4-2350-4e8c-b163-9f2a99594b31-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-qkljr\" (UID: \"97355ff4-2350-4e8c-b163-9f2a99594b31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr" Jun 08 13:05:52.087631 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:05:52.087508 2563 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 08 13:05:52.087631 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:05:52.087588 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97355ff4-2350-4e8c-b163-9f2a99594b31-tls-certificates podName:97355ff4-2350-4e8c-b163-9f2a99594b31 nodeName:}" failed. No retries permitted until 2026-06-08 13:05:52.587556235 +0000 UTC m=+271.556855744 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/97355ff4-2350-4e8c-b163-9f2a99594b31-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-qkljr" (UID: "97355ff4-2350-4e8c-b163-9f2a99594b31") : secret "prometheus-operator-admission-webhook-tls" not found Jun 08 13:05:52.592291 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:52.592247 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97355ff4-2350-4e8c-b163-9f2a99594b31-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-qkljr\" (UID: \"97355ff4-2350-4e8c-b163-9f2a99594b31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr" Jun 08 13:05:52.594858 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:52.594835 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/97355ff4-2350-4e8c-b163-9f2a99594b31-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-qkljr\" (UID: \"97355ff4-2350-4e8c-b163-9f2a99594b31\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr" Jun 08 13:05:52.862430 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:52.862393 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr" Jun 08 13:05:52.991846 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:52.991821 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr"] Jun 08 13:05:52.993342 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:05:52.993310 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97355ff4_2350_4e8c_b163_9f2a99594b31.slice/crio-b9f83fd91c0e6b48ef5acb938fed360d9f2062c419a85620c047212343c6fef9 WatchSource:0}: Error finding container b9f83fd91c0e6b48ef5acb938fed360d9f2062c419a85620c047212343c6fef9: Status 404 returned error can't find the container with id b9f83fd91c0e6b48ef5acb938fed360d9f2062c419a85620c047212343c6fef9 Jun 08 13:05:53.356432 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:53.356342 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr" event={"ID":"97355ff4-2350-4e8c-b163-9f2a99594b31","Type":"ContainerStarted","Data":"b9f83fd91c0e6b48ef5acb938fed360d9f2062c419a85620c047212343c6fef9"} Jun 08 13:05:54.361685 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:54.361649 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr" event={"ID":"97355ff4-2350-4e8c-b163-9f2a99594b31","Type":"ContainerStarted","Data":"c28ceca50c559529956a4a4a1febe15e3c60e73935deef41bebbea6b96c85324"} Jun 08 13:05:54.362102 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:54.361835 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr" Jun 08 13:05:54.366480 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:54.366453 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr" Jun 08 13:05:54.393501 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:54.393452 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-qkljr" podStartSLOduration=2.32882785 podStartE2EDuration="3.393436179s" totalImagesPullingTime="1.064608329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:54.391763865 +0000 UTC m=+273.361063396" watchObservedRunningTime="2026-06-08 13:05:54.393436179 +0000 UTC m=+273.362735710" Jun 08 13:05:55.216431 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.216398 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2"] Jun 08 13:05:55.218217 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.218201 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.227407 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.227390 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 08 13:05:55.228018 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.227998 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 08 13:05:55.228532 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.228506 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 08 13:05:55.228642 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.228607 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fd6xv\"" Jun 08 13:05:55.228764 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.228741 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 08 13:05:55.229692 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.229672 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 08 13:05:55.302262 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.302226 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2"] Jun 08 13:05:55.312477 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.312449 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.312670 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.312502 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.312670 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.312520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.312670 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.312607 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfqcm\" (UniqueName: \"kubernetes.io/projected/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-kube-api-access-wfqcm\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.413887 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.413847 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.414363 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.413906 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.414363 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.413925 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.414363 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.413953 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfqcm\" (UniqueName: \"kubernetes.io/projected/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-kube-api-access-wfqcm\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.414675 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.414655 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.416262 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.416237 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.416774 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.416751 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.428400 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.428377 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfqcm\" (UniqueName: \"kubernetes.io/projected/fd0a7c16-f310-49cf-80fa-f90fbdbe1c23-kube-api-access-wfqcm\") pod \"prometheus-operator-7f7d445d84-xfgv2\" (UID: \"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.526271 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.526180 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" Jun 08 13:05:55.660474 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:55.660438 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2"] Jun 08 13:05:55.668244 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:05:55.668223 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd0a7c16_f310_49cf_80fa_f90fbdbe1c23.slice/crio-0aff76eae26641e9ca23e7d57634a8815c4022914defb42985667709fc272a0d WatchSource:0}: Error finding container 0aff76eae26641e9ca23e7d57634a8815c4022914defb42985667709fc272a0d: Status 404 returned error can't find the container with id 0aff76eae26641e9ca23e7d57634a8815c4022914defb42985667709fc272a0d Jun 08 13:05:56.369607 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:56.369556 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" event={"ID":"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23","Type":"ContainerStarted","Data":"0aff76eae26641e9ca23e7d57634a8815c4022914defb42985667709fc272a0d"} Jun 08 13:05:57.375085 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:57.374984 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" event={"ID":"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23","Type":"ContainerStarted","Data":"9b3290fc416531cf400beb797ba0ab9b8da5aadc30054e56c1c95aed7201ee92"} Jun 08 13:05:57.375085 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:57.375038 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" event={"ID":"fd0a7c16-f310-49cf-80fa-f90fbdbe1c23","Type":"ContainerStarted","Data":"a5acb77e79a31d227629fd19ab9c32d727a7a9670fc0a42bd0d7525e7eca9bb1"} Jun 08 13:05:57.417802 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:05:57.417735 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xfgv2" podStartSLOduration=0.97118384 podStartE2EDuration="2.417712769s" totalImagesPullingTime="1.446528929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:05:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:05:57.416644132 +0000 UTC m=+276.385943666" watchObservedRunningTime="2026-06-08 13:05:57.417712769 +0000 UTC m=+276.387012303" Jun 08 13:06:00.150553 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.150516 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-zbq6m"] Jun 08 13:06:00.153025 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.153009 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.158376 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.158354 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 08 13:06:00.160591 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.160554 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-c4gz5\"" Jun 08 13:06:00.163283 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.163267 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 08 13:06:00.163447 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.163434 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 08 13:06:00.249166 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.249130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcjbt\" (UniqueName: \"kubernetes.io/projected/011db15e-ae01-4064-a29e-fbc1b83cf6ee-kube-api-access-lcjbt\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.249315 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.249176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.249315 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.249225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/011db15e-ae01-4064-a29e-fbc1b83cf6ee-root\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.249315 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.249255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-tls\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.249315 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.249277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-wtmp\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.249467 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.249327 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/011db15e-ae01-4064-a29e-fbc1b83cf6ee-sys\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.249467 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.249345 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-textfile\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.249467 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.249395 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.249467 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.249424 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/011db15e-ae01-4064-a29e-fbc1b83cf6ee-metrics-client-ca\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.350197 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.350157 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/011db15e-ae01-4064-a29e-fbc1b83cf6ee-metrics-client-ca\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.350197 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.350201 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcjbt\" (UniqueName: \"kubernetes.io/projected/011db15e-ae01-4064-a29e-fbc1b83cf6ee-kube-api-access-lcjbt\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.350423 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.350228 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.350423 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.350401 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/011db15e-ae01-4064-a29e-fbc1b83cf6ee-root\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.353823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.350771 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-tls\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.353823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.350787 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/011db15e-ae01-4064-a29e-fbc1b83cf6ee-root\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.353823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.350824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-wtmp\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.353823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.350891 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/011db15e-ae01-4064-a29e-fbc1b83cf6ee-sys\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.353823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.350952 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/011db15e-ae01-4064-a29e-fbc1b83cf6ee-sys\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.353823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.350967 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-textfile\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.353823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.351084 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-wtmp\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.353823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.351053 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.353823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.351447 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/011db15e-ae01-4064-a29e-fbc1b83cf6ee-metrics-client-ca\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.353823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.351510 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-textfile\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.353823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.352092 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-accelerators-collector-config\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.356052 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.356031 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.356149 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.356060 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/011db15e-ae01-4064-a29e-fbc1b83cf6ee-node-exporter-tls\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.359898 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.359864 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcjbt\" (UniqueName: \"kubernetes.io/projected/011db15e-ae01-4064-a29e-fbc1b83cf6ee-kube-api-access-lcjbt\") pod \"node-exporter-zbq6m\" (UID: \"011db15e-ae01-4064-a29e-fbc1b83cf6ee\") " pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.461676 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:00.461583 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-zbq6m" Jun 08 13:06:00.472074 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:06:00.472035 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011db15e_ae01_4064_a29e_fbc1b83cf6ee.slice/crio-3892d3a4d0950770beabd27b98f3d46dd38939e740e8d086d083cd767b30918d WatchSource:0}: Error finding container 3892d3a4d0950770beabd27b98f3d46dd38939e740e8d086d083cd767b30918d: Status 404 returned error can't find the container with id 3892d3a4d0950770beabd27b98f3d46dd38939e740e8d086d083cd767b30918d Jun 08 13:06:01.391624 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:01.391585 2563 generic.go:356] "Generic (PLEG): container finished" podID="011db15e-ae01-4064-a29e-fbc1b83cf6ee" containerID="e62cf23427dffdd3a746f49934895dc49d116dd1d7adfe03e65785c0eace671b" exitCode=0 Jun 08 13:06:01.391624 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:01.391595 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbq6m" event={"ID":"011db15e-ae01-4064-a29e-fbc1b83cf6ee","Type":"ContainerDied","Data":"e62cf23427dffdd3a746f49934895dc49d116dd1d7adfe03e65785c0eace671b"} Jun 08 13:06:01.392118 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:01.391690 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbq6m" event={"ID":"011db15e-ae01-4064-a29e-fbc1b83cf6ee","Type":"ContainerStarted","Data":"3892d3a4d0950770beabd27b98f3d46dd38939e740e8d086d083cd767b30918d"} Jun 08 13:06:02.036072 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:06:02.036026 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-pw4f9" podUID="52584272-7c62-4cfc-8430-f6556b92a686" Jun 08 13:06:02.245349 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.245317 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-vjz6f"] Jun 08 13:06:02.247535 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.247519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-vjz6f" Jun 08 13:06:02.263443 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.263414 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6q8c5\"" Jun 08 13:06:02.263652 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.263455 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 08 13:06:02.263652 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.263484 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 08 13:06:02.277210 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.277180 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-vjz6f"] Jun 08 13:06:02.366881 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.366843 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvvmg\" (UniqueName: \"kubernetes.io/projected/25da9b0a-2924-4175-b5b6-7d1561814e6e-kube-api-access-jvvmg\") pod \"downloads-6657875f97-vjz6f\" (UID: \"25da9b0a-2924-4175-b5b6-7d1561814e6e\") " pod="openshift-console/downloads-6657875f97-vjz6f" Jun 08 13:06:02.396690 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.396662 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pw4f9" Jun 08 13:06:02.396690 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.396685 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbq6m" event={"ID":"011db15e-ae01-4064-a29e-fbc1b83cf6ee","Type":"ContainerStarted","Data":"21fb17f466e0fa19381223bef0a36b56311103730eba6f61cf3cd76a8b0a920e"} Jun 08 13:06:02.397081 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.396738 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-zbq6m" event={"ID":"011db15e-ae01-4064-a29e-fbc1b83cf6ee","Type":"ContainerStarted","Data":"630fe37775c4b986449555fb998aa0137f1aea3ca97629e0699ca08e6185aace"} Jun 08 13:06:02.468214 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.468167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvvmg\" (UniqueName: \"kubernetes.io/projected/25da9b0a-2924-4175-b5b6-7d1561814e6e-kube-api-access-jvvmg\") pod \"downloads-6657875f97-vjz6f\" (UID: \"25da9b0a-2924-4175-b5b6-7d1561814e6e\") " pod="openshift-console/downloads-6657875f97-vjz6f" Jun 08 13:06:02.483977 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.483943 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvvmg\" (UniqueName: \"kubernetes.io/projected/25da9b0a-2924-4175-b5b6-7d1561814e6e-kube-api-access-jvvmg\") pod \"downloads-6657875f97-vjz6f\" (UID: \"25da9b0a-2924-4175-b5b6-7d1561814e6e\") " pod="openshift-console/downloads-6657875f97-vjz6f" Jun 08 13:06:02.556039 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.556000 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-vjz6f" Jun 08 13:06:02.698032 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.697883 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-zbq6m" podStartSLOduration=1.881444456 podStartE2EDuration="2.697861852s" totalImagesPullingTime="749.794637ms" totalInitContainerRuntime="66.622759ms" isStatefulPod=true podCreationTimestamp="2026-06-08 13:06:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:02.444817992 +0000 UTC m=+281.414117522" watchObservedRunningTime="2026-06-08 13:06:02.697861852 +0000 UTC m=+281.667161413" Jun 08 13:06:02.698581 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:02.698548 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-vjz6f"] Jun 08 13:06:02.701551 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:06:02.701525 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25da9b0a_2924_4175_b5b6_7d1561814e6e.slice/crio-a1c798f57c2ec09f5e8fe225b4541340e753c639e76c18a218ef52182f181870 WatchSource:0}: Error finding container a1c798f57c2ec09f5e8fe225b4541340e753c639e76c18a218ef52182f181870: Status 404 returned error can't find the container with id a1c798f57c2ec09f5e8fe225b4541340e753c639e76c18a218ef52182f181870 Jun 08 13:06:03.211719 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.211683 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-64ff47f944-xw6j6"] Jun 08 13:06:03.215668 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.215633 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.222547 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.222519 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 08 13:06:03.222723 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.222600 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 08 13:06:03.222783 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.222770 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-x4fdz\"" Jun 08 13:06:03.223348 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.223330 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 08 13:06:03.223348 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.223346 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 08 13:06:03.223485 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.223328 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7418qgc2dq5j7\"" Jun 08 13:06:03.242972 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.242937 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 08 13:06:03.243173 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.243154 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64ff47f944-xw6j6"] Jun 08 13:06:03.275007 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.274962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.275196 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.275022 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-grpc-tls\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.275196 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.275056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.275196 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.275093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-tls\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.275196 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.275180 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.275360 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.275243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fjqq\" (UniqueName: \"kubernetes.io/projected/805c378e-3574-4769-a3c3-01c6ef2f60c0-kube-api-access-6fjqq\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.275360 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.275290 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.275360 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.275315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/805c378e-3574-4769-a3c3-01c6ef2f60c0-metrics-client-ca\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.340926 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.340875 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" podUID="cfa20476-0d82-4323-b2d7-f760652fe25f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 13:06:03.376158 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.376121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.376158 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.376159 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/805c378e-3574-4769-a3c3-01c6ef2f60c0-metrics-client-ca\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.376438 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.376182 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.376438 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.376205 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-grpc-tls\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.376438 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.376224 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.376438 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.376255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-tls\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.376438 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.376315 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.376438 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.376365 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fjqq\" (UniqueName: \"kubernetes.io/projected/805c378e-3574-4769-a3c3-01c6ef2f60c0-kube-api-access-6fjqq\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.377221 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.377188 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/805c378e-3574-4769-a3c3-01c6ef2f60c0-metrics-client-ca\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.379108 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.379078 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.379237 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.379215 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.379382 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.379359 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.379428 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.379395 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-tls\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.379467 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.379438 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.379658 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.379636 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/805c378e-3574-4769-a3c3-01c6ef2f60c0-secret-grpc-tls\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.391912 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.391887 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fjqq\" (UniqueName: \"kubernetes.io/projected/805c378e-3574-4769-a3c3-01c6ef2f60c0-kube-api-access-6fjqq\") pod \"thanos-querier-64ff47f944-xw6j6\" (UID: \"805c378e-3574-4769-a3c3-01c6ef2f60c0\") " pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.401409 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.401374 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-vjz6f" event={"ID":"25da9b0a-2924-4175-b5b6-7d1561814e6e","Type":"ContainerStarted","Data":"a1c798f57c2ec09f5e8fe225b4541340e753c639e76c18a218ef52182f181870"} Jun 08 13:06:03.525551 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.525457 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:03.683026 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:03.682990 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-64ff47f944-xw6j6"] Jun 08 13:06:03.687695 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:06:03.687670 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805c378e_3574_4769_a3c3_01c6ef2f60c0.slice/crio-e4b5ef456b0ab4feeaf3bb9b9a6b9e0532ed008e2a72b02e1281f47f44818631 WatchSource:0}: Error finding container e4b5ef456b0ab4feeaf3bb9b9a6b9e0532ed008e2a72b02e1281f47f44818631: Status 404 returned error can't find the container with id e4b5ef456b0ab4feeaf3bb9b9a6b9e0532ed008e2a72b02e1281f47f44818631 Jun 08 13:06:04.405689 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:04.405647 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" event={"ID":"805c378e-3574-4769-a3c3-01c6ef2f60c0","Type":"ContainerStarted","Data":"e4b5ef456b0ab4feeaf3bb9b9a6b9e0532ed008e2a72b02e1281f47f44818631"} Jun 08 13:06:05.997684 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:05.997648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:06:06.000066 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:06.000042 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/52584272-7c62-4cfc-8430-f6556b92a686-metrics-tls\") pod \"dns-default-pw4f9\" (UID: \"52584272-7c62-4cfc-8430-f6556b92a686\") " pod="openshift-dns/dns-default-pw4f9" Jun 08 13:06:06.301758 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:06.301477 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-8gt5m\"" Jun 08 13:06:06.308582 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:06.308542 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-pw4f9" Jun 08 13:06:06.419490 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:06.419452 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" event={"ID":"805c378e-3574-4769-a3c3-01c6ef2f60c0","Type":"ContainerStarted","Data":"74d8a5f94312ccb18a46e36da2080ac7cb53c758c32b8f252e0cc86cdd8de5b0"} Jun 08 13:06:06.419639 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:06.419545 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" event={"ID":"805c378e-3574-4769-a3c3-01c6ef2f60c0","Type":"ContainerStarted","Data":"e199019d96244f8368d28707c8496f5e4dd4b84de1173c1fa7c90de60c8af8e1"} Jun 08 13:06:06.419639 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:06.419617 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" event={"ID":"805c378e-3574-4769-a3c3-01c6ef2f60c0","Type":"ContainerStarted","Data":"9085303a94f67190aa5e16b819dfc72c589c0288a97619f6bb5e47b6198221b4"} Jun 08 13:06:06.505822 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:06.505552 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-pw4f9"] Jun 08 13:06:06.508696 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:06:06.508665 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52584272_7c62_4cfc_8430_f6556b92a686.slice/crio-d58d4add1939be53f0c6a822ec012fc4b53e1ba12176a49b65df8317ab99f897 WatchSource:0}: Error finding container d58d4add1939be53f0c6a822ec012fc4b53e1ba12176a49b65df8317ab99f897: Status 404 returned error can't find the container with id d58d4add1939be53f0c6a822ec012fc4b53e1ba12176a49b65df8317ab99f897 Jun 08 13:06:07.427321 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:07.427284 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pw4f9" event={"ID":"52584272-7c62-4cfc-8430-f6556b92a686","Type":"ContainerStarted","Data":"d58d4add1939be53f0c6a822ec012fc4b53e1ba12176a49b65df8317ab99f897"} Jun 08 13:06:07.429910 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:07.429884 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" event={"ID":"805c378e-3574-4769-a3c3-01c6ef2f60c0","Type":"ContainerStarted","Data":"9f4b35f08461b00619dc76a3c8d3bf6ad852174d093d44450b39a454e09a1687"} Jun 08 13:06:07.430013 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:07.429950 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" event={"ID":"805c378e-3574-4769-a3c3-01c6ef2f60c0","Type":"ContainerStarted","Data":"c95f0fce57117716bb064d2c8d2e8221792c759a4e38860ab5dca2efa0ddcaba"} Jun 08 13:06:07.430013 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:07.429999 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" event={"ID":"805c378e-3574-4769-a3c3-01c6ef2f60c0","Type":"ContainerStarted","Data":"e6f4e8833134741ed0378953866df27c8dafe4e9e6badb2171bc80e6391d54d2"} Jun 08 13:06:07.430135 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:07.430119 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:07.461988 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:07.461932 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" podStartSLOduration=1.523203658 podStartE2EDuration="4.461911658s" totalImagesPullingTime="2.938708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:06:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:07.459730838 +0000 UTC m=+286.429030371" watchObservedRunningTime="2026-06-08 13:06:07.461911658 +0000 UTC m=+286.431211190" Jun 08 13:06:09.438361 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:09.438326 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pw4f9" event={"ID":"52584272-7c62-4cfc-8430-f6556b92a686","Type":"ContainerStarted","Data":"861dc44ee10b655be91186cc84d324626a20ab73aee99a4a0d561c4bcac89454"} Jun 08 13:06:09.438870 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:09.438383 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-pw4f9" event={"ID":"52584272-7c62-4cfc-8430-f6556b92a686","Type":"ContainerStarted","Data":"8045297bf60e8bcce18384ab592bc01614745080877c6445539fb77cef815d67"} Jun 08 13:06:09.438870 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:09.438422 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-pw4f9" Jun 08 13:06:09.464866 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:09.464822 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-pw4f9" podStartSLOduration=252.625749455 podStartE2EDuration="4m14.464806854s" totalImagesPullingTime="1.839057399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:09.463460702 +0000 UTC m=+288.432760232" watchObservedRunningTime="2026-06-08 13:06:09.464806854 +0000 UTC m=+288.434106386" Jun 08 13:06:13.340637 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:13.340593 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" podUID="cfa20476-0d82-4323-b2d7-f760652fe25f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 13:06:13.440413 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:13.440382 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-64ff47f944-xw6j6" Jun 08 13:06:15.509481 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:06:15.509438 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8wxnn" podUID="9f6593ad-e136-4f32-9fc5-4fedcabdebed" Jun 08 13:06:19.444190 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:19.444163 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-pw4f9" Jun 08 13:06:23.340268 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:23.340218 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" podUID="cfa20476-0d82-4323-b2d7-f760652fe25f" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 08 13:06:23.342676 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:23.340306 2563 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" Jun 08 13:06:23.342676 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:23.340849 2563 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"b9139fbc17849f49cc4cfa5902466b8e7348ac123c6594bedb091d25ed68f861"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 08 13:06:23.342676 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:23.340910 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" podUID="cfa20476-0d82-4323-b2d7-f760652fe25f" containerName="service-proxy" containerID="cri-o://b9139fbc17849f49cc4cfa5902466b8e7348ac123c6594bedb091d25ed68f861" gracePeriod=30 Jun 08 13:06:25.956137 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:25.956103 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:06:25.956461 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:25.956246 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:06:25.958816 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:25.958795 2563 kubelet.go:1648] "Image garbage collection succeeded" Jun 08 13:06:26.508955 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:26.508915 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-vjz6f" event={"ID":"25da9b0a-2924-4175-b5b6-7d1561814e6e","Type":"ContainerStarted","Data":"62dfe5d032d3ad53d0756123797e7ac359c6723f06a011d46e4fc96d143c1ef2"} Jun 08 13:06:26.509185 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:26.509049 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-vjz6f" Jun 08 13:06:26.512174 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:26.512140 2563 generic.go:356] "Generic (PLEG): container finished" podID="cfa20476-0d82-4323-b2d7-f760652fe25f" containerID="b9139fbc17849f49cc4cfa5902466b8e7348ac123c6594bedb091d25ed68f861" exitCode=2 Jun 08 13:06:26.512282 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:26.512206 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" event={"ID":"cfa20476-0d82-4323-b2d7-f760652fe25f","Type":"ContainerDied","Data":"b9139fbc17849f49cc4cfa5902466b8e7348ac123c6594bedb091d25ed68f861"} Jun 08 13:06:26.512282 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:26.512237 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-68bbf8fc6d-nhl7z" event={"ID":"cfa20476-0d82-4323-b2d7-f760652fe25f","Type":"ContainerStarted","Data":"a7721ba71573872b57590fd3059e2aba106dc20614d0dea06522f4e13c0a1ac5"} Jun 08 13:06:26.525575 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:26.525532 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-vjz6f" Jun 08 13:06:26.532772 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:26.532719 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-vjz6f" podStartSLOduration=1.213860807 podStartE2EDuration="24.532702707s" totalImagesPullingTime="23.3188419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:06:26.531176799 +0000 UTC m=+305.500476331" watchObservedRunningTime="2026-06-08 13:06:26.532702707 +0000 UTC m=+305.502002239" Jun 08 13:06:27.508329 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:27.508289 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:06:29.029392 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:29.029359 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pw4f9_52584272-7c62-4cfc-8430-f6556b92a686/dns/0.log" Jun 08 13:06:29.229015 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:29.228984 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pw4f9_52584272-7c62-4cfc-8430-f6556b92a686/kube-rbac-proxy/0.log" Jun 08 13:06:30.229175 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:30.229142 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qwjck_919f32d7-40ac-4223-a344-c3194fdcceac/dns-node-resolver/0.log" Jun 08 13:06:30.826940 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:06:30.826913 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h8d68_d3019b3f-b998-4ff6-a9db-23882da23487/serve-healthcheck-canary/0.log" Jun 08 13:07:35.448372 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:07:35.448329 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:07:35.450697 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:07:35.450676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f6593ad-e136-4f32-9fc5-4fedcabdebed-metrics-certs\") pod \"network-metrics-daemon-8wxnn\" (UID: \"9f6593ad-e136-4f32-9fc5-4fedcabdebed\") " pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:07:35.611764 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:07:35.611729 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wn2mf\"" Jun 08 13:07:35.619623 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:07:35.619594 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8wxnn" Jun 08 13:07:35.747289 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:07:35.747253 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8wxnn"] Jun 08 13:07:35.751964 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:07:35.751936 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f6593ad_e136_4f32_9fc5_4fedcabdebed.slice/crio-61ab4bcc41f1407311c23d7b9516d6da24b041263bffd63136bf2c2c8d4ef3f6 WatchSource:0}: Error finding container 61ab4bcc41f1407311c23d7b9516d6da24b041263bffd63136bf2c2c8d4ef3f6: Status 404 returned error can't find the container with id 61ab4bcc41f1407311c23d7b9516d6da24b041263bffd63136bf2c2c8d4ef3f6 Jun 08 13:07:35.753907 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:07:35.753889 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:07:36.759811 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:07:36.759780 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wxnn" event={"ID":"9f6593ad-e136-4f32-9fc5-4fedcabdebed","Type":"ContainerStarted","Data":"dd332cce0b0c0f1bf86438c70e52ca6804c3e0d12fd270b0099413588f134378"} Jun 08 13:07:36.760159 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:07:36.759842 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wxnn" event={"ID":"9f6593ad-e136-4f32-9fc5-4fedcabdebed","Type":"ContainerStarted","Data":"61ab4bcc41f1407311c23d7b9516d6da24b041263bffd63136bf2c2c8d4ef3f6"} Jun 08 13:07:37.765475 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:07:37.765439 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8wxnn" event={"ID":"9f6593ad-e136-4f32-9fc5-4fedcabdebed","Type":"ContainerStarted","Data":"1f7692a14f6a6d99af1bc1c56d859f11e8456f0a48ed11a95b9b0c9c6d0d84ff"} Jun 08 13:11:06.861753 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:06.861692 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8wxnn" podStartSLOduration=584.988402286 podStartE2EDuration="9m45.861674846s" totalImagesPullingTime="873.27256ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:01:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:07:37.783985908 +0000 UTC m=+376.753285440" watchObservedRunningTime="2026-06-08 13:11:06.861674846 +0000 UTC m=+585.830974400" Jun 08 13:11:06.862225 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:06.862151 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw"] Jun 08 13:11:06.864289 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:06.864273 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw" Jun 08 13:11:06.866753 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:06.866731 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 08 13:11:06.866872 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:06.866763 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 08 13:11:06.867480 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:06.867465 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-lfc7p\"" Jun 08 13:11:06.876782 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:06.876759 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw"] Jun 08 13:11:07.028199 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:07.028159 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzt8j\" (UniqueName: \"kubernetes.io/projected/e60597eb-5ca5-48a3-a6d5-fb1613f23c19-kube-api-access-wzt8j\") pod \"openshift-lws-operator-fd8ccff4c-csqkw\" (UID: \"e60597eb-5ca5-48a3-a6d5-fb1613f23c19\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw" Jun 08 13:11:07.028379 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:07.028222 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e60597eb-5ca5-48a3-a6d5-fb1613f23c19-tmp\") pod \"openshift-lws-operator-fd8ccff4c-csqkw\" (UID: \"e60597eb-5ca5-48a3-a6d5-fb1613f23c19\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw" Jun 08 13:11:07.128624 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:07.128525 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e60597eb-5ca5-48a3-a6d5-fb1613f23c19-tmp\") pod \"openshift-lws-operator-fd8ccff4c-csqkw\" (UID: \"e60597eb-5ca5-48a3-a6d5-fb1613f23c19\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw" Jun 08 13:11:07.128752 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:07.128631 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzt8j\" (UniqueName: \"kubernetes.io/projected/e60597eb-5ca5-48a3-a6d5-fb1613f23c19-kube-api-access-wzt8j\") pod \"openshift-lws-operator-fd8ccff4c-csqkw\" (UID: \"e60597eb-5ca5-48a3-a6d5-fb1613f23c19\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw" Jun 08 13:11:07.128941 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:07.128909 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e60597eb-5ca5-48a3-a6d5-fb1613f23c19-tmp\") pod \"openshift-lws-operator-fd8ccff4c-csqkw\" (UID: \"e60597eb-5ca5-48a3-a6d5-fb1613f23c19\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw" Jun 08 13:11:07.137878 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:07.137856 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzt8j\" (UniqueName: \"kubernetes.io/projected/e60597eb-5ca5-48a3-a6d5-fb1613f23c19-kube-api-access-wzt8j\") pod \"openshift-lws-operator-fd8ccff4c-csqkw\" (UID: \"e60597eb-5ca5-48a3-a6d5-fb1613f23c19\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw" Jun 08 13:11:07.172864 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:07.172826 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw" Jun 08 13:11:07.305797 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:07.305760 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw"] Jun 08 13:11:07.309056 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:11:07.309023 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode60597eb_5ca5_48a3_a6d5_fb1613f23c19.slice/crio-c6715a4a0ef4231c750ed2ab5a8508efaef80262e5305c802dc23815d8782f5c WatchSource:0}: Error finding container c6715a4a0ef4231c750ed2ab5a8508efaef80262e5305c802dc23815d8782f5c: Status 404 returned error can't find the container with id c6715a4a0ef4231c750ed2ab5a8508efaef80262e5305c802dc23815d8782f5c Jun 08 13:11:07.486041 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:07.485951 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw" event={"ID":"e60597eb-5ca5-48a3-a6d5-fb1613f23c19","Type":"ContainerStarted","Data":"c6715a4a0ef4231c750ed2ab5a8508efaef80262e5305c802dc23815d8782f5c"} Jun 08 13:11:10.500012 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:10.499974 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw" event={"ID":"e60597eb-5ca5-48a3-a6d5-fb1613f23c19","Type":"ContainerStarted","Data":"e206251c28bd59607c7cf1b5865fb79298891d7d89f04c3cd59d9a1c31ab0424"} Jun 08 13:11:10.520851 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:10.520803 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-csqkw" podStartSLOduration=1.928286209 podStartE2EDuration="4.520785214s" totalImagesPullingTime="2.592499005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:11:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:11:10.519693341 +0000 UTC m=+589.488992873" watchObservedRunningTime="2026-06-08 13:11:10.520785214 +0000 UTC m=+589.490084744" Jun 08 13:11:25.978410 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:25.978381 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:11:25.980962 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:25.978868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:11:30.280637 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.280601 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8"] Jun 08 13:11:30.283790 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.283774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.288258 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.288221 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 08 13:11:30.288451 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.288322 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 08 13:11:30.288451 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.288374 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 08 13:11:30.288451 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.288430 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pt5pq\"" Jun 08 13:11:30.288839 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.288823 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 08 13:11:30.296619 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.296595 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc6077e4-2bb1-42f6-84ff-443e50317735-webhook-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.296743 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.296630 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc6077e4-2bb1-42f6-84ff-443e50317735-manifests\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.296743 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.296693 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc6077e4-2bb1-42f6-84ff-443e50317735-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.296743 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.296718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc6077e4-2bb1-42f6-84ff-443e50317735-tmp\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.296743 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.296737 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prbsp\" (UniqueName: \"kubernetes.io/projected/fc6077e4-2bb1-42f6-84ff-443e50317735-kube-api-access-prbsp\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.301548 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.301522 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8"] Jun 08 13:11:30.397412 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.397354 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc6077e4-2bb1-42f6-84ff-443e50317735-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.397412 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.397415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc6077e4-2bb1-42f6-84ff-443e50317735-tmp\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.397729 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.397438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prbsp\" (UniqueName: \"kubernetes.io/projected/fc6077e4-2bb1-42f6-84ff-443e50317735-kube-api-access-prbsp\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.397729 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.397480 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc6077e4-2bb1-42f6-84ff-443e50317735-webhook-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.397729 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.397593 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc6077e4-2bb1-42f6-84ff-443e50317735-manifests\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.397987 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.397965 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/fc6077e4-2bb1-42f6-84ff-443e50317735-manifests\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.399845 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.399821 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc6077e4-2bb1-42f6-84ff-443e50317735-tmp\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.399991 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.399973 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/fc6077e4-2bb1-42f6-84ff-443e50317735-webhook-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.400033 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.399993 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/fc6077e4-2bb1-42f6-84ff-443e50317735-apiservice-cert\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.408518 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.408497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prbsp\" (UniqueName: \"kubernetes.io/projected/fc6077e4-2bb1-42f6-84ff-443e50317735-kube-api-access-prbsp\") pod \"opendatahub-operator-controller-manager-677cd7f45-4z6p8\" (UID: \"fc6077e4-2bb1-42f6-84ff-443e50317735\") " pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.594051 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.593951 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:30.733930 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:30.733904 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8"] Jun 08 13:11:30.736686 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:11:30.736648 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6077e4_2bb1_42f6_84ff_443e50317735.slice/crio-074eb09bf79f8dfa04689b62fb7e65945ab07601fb8c2394ca2c783a12d52dab WatchSource:0}: Error finding container 074eb09bf79f8dfa04689b62fb7e65945ab07601fb8c2394ca2c783a12d52dab: Status 404 returned error can't find the container with id 074eb09bf79f8dfa04689b62fb7e65945ab07601fb8c2394ca2c783a12d52dab Jun 08 13:11:31.579146 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:31.579073 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" event={"ID":"fc6077e4-2bb1-42f6-84ff-443e50317735","Type":"ContainerStarted","Data":"074eb09bf79f8dfa04689b62fb7e65945ab07601fb8c2394ca2c783a12d52dab"} Jun 08 13:11:33.588443 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:33.588413 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" event={"ID":"fc6077e4-2bb1-42f6-84ff-443e50317735","Type":"ContainerStarted","Data":"660c060c02a353090f537304f057b9e560ac24261e8afa8c6ecb1891f578e34a"} Jun 08 13:11:34.594378 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:34.594336 2563 generic.go:356] "Generic (PLEG): container finished" podID="fc6077e4-2bb1-42f6-84ff-443e50317735" containerID="660c060c02a353090f537304f057b9e560ac24261e8afa8c6ecb1891f578e34a" exitCode=0 Jun 08 13:11:34.594848 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:34.594427 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" event={"ID":"fc6077e4-2bb1-42f6-84ff-443e50317735","Type":"ContainerDied","Data":"660c060c02a353090f537304f057b9e560ac24261e8afa8c6ecb1891f578e34a"} Jun 08 13:11:35.601651 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:35.601607 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" event={"ID":"fc6077e4-2bb1-42f6-84ff-443e50317735","Type":"ContainerStarted","Data":"8dfed8b9ac5915fd4b9786c813e474180330a56c58d52c219ad9e3b47ae4aee4"} Jun 08 13:11:35.602050 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:35.601762 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:35.629179 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:35.629113 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" podStartSLOduration=1.599588196 podStartE2EDuration="5.629092204s" totalImagesPullingTime="3.117533282s" totalInitContainerRuntime="911.970726ms" isStatefulPod=false podCreationTimestamp="2026-06-08 13:11:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:11:35.628814952 +0000 UTC m=+614.598114506" watchObservedRunningTime="2026-06-08 13:11:35.629092204 +0000 UTC m=+614.598391737" Jun 08 13:11:46.607633 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:46.607536 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-677cd7f45-4z6p8" Jun 08 13:11:50.013439 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.013389 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dzrxg"] Jun 08 13:11:50.017706 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.017677 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" Jun 08 13:11:50.023256 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.023227 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-dl8kp\"" Jun 08 13:11:50.024045 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.024018 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 08 13:11:50.053424 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.053375 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc2d943d-342c-474b-a9d5-3d4c495f1dfc-cert\") pod \"odh-model-controller-6dc94f689f-dzrxg\" (UID: \"bc2d943d-342c-474b-a9d5-3d4c495f1dfc\") " pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" Jun 08 13:11:50.053660 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.053637 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txzcd\" (UniqueName: \"kubernetes.io/projected/bc2d943d-342c-474b-a9d5-3d4c495f1dfc-kube-api-access-txzcd\") pod \"odh-model-controller-6dc94f689f-dzrxg\" (UID: \"bc2d943d-342c-474b-a9d5-3d4c495f1dfc\") " pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" Jun 08 13:11:50.110758 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.110718 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dzrxg"] Jun 08 13:11:50.154837 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.154799 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc2d943d-342c-474b-a9d5-3d4c495f1dfc-cert\") pod \"odh-model-controller-6dc94f689f-dzrxg\" (UID: \"bc2d943d-342c-474b-a9d5-3d4c495f1dfc\") " pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" Jun 08 13:11:50.154999 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.154909 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txzcd\" (UniqueName: \"kubernetes.io/projected/bc2d943d-342c-474b-a9d5-3d4c495f1dfc-kube-api-access-txzcd\") pod \"odh-model-controller-6dc94f689f-dzrxg\" (UID: \"bc2d943d-342c-474b-a9d5-3d4c495f1dfc\") " pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" Jun 08 13:11:50.154999 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:11:50.154954 2563 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 08 13:11:50.155078 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:11:50.155037 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc2d943d-342c-474b-a9d5-3d4c495f1dfc-cert podName:bc2d943d-342c-474b-a9d5-3d4c495f1dfc nodeName:}" failed. No retries permitted until 2026-06-08 13:11:50.655017424 +0000 UTC m=+629.624316943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bc2d943d-342c-474b-a9d5-3d4c495f1dfc-cert") pod "odh-model-controller-6dc94f689f-dzrxg" (UID: "bc2d943d-342c-474b-a9d5-3d4c495f1dfc") : secret "odh-model-controller-webhook-cert" not found Jun 08 13:11:50.167504 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.167476 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txzcd\" (UniqueName: \"kubernetes.io/projected/bc2d943d-342c-474b-a9d5-3d4c495f1dfc-kube-api-access-txzcd\") pod \"odh-model-controller-6dc94f689f-dzrxg\" (UID: \"bc2d943d-342c-474b-a9d5-3d4c495f1dfc\") " pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" Jun 08 13:11:50.658727 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.658689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc2d943d-342c-474b-a9d5-3d4c495f1dfc-cert\") pod \"odh-model-controller-6dc94f689f-dzrxg\" (UID: \"bc2d943d-342c-474b-a9d5-3d4c495f1dfc\") " pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" Jun 08 13:11:50.661721 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.661681 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bc2d943d-342c-474b-a9d5-3d4c495f1dfc-cert\") pod \"odh-model-controller-6dc94f689f-dzrxg\" (UID: \"bc2d943d-342c-474b-a9d5-3d4c495f1dfc\") " pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" Jun 08 13:11:50.927917 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:50.927820 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" Jun 08 13:11:51.084317 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.084211 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-dzrxg"] Jun 08 13:11:51.087019 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:11:51.086991 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2d943d_342c_474b_a9d5_3d4c495f1dfc.slice/crio-b38f8cdc8954b5a503234f590e6ea8833690ae6389b9dddcb6d3122d80602a8b WatchSource:0}: Error finding container b38f8cdc8954b5a503234f590e6ea8833690ae6389b9dddcb6d3122d80602a8b: Status 404 returned error can't find the container with id b38f8cdc8954b5a503234f590e6ea8833690ae6389b9dddcb6d3122d80602a8b Jun 08 13:11:51.640393 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.640362 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd"] Jun 08 13:11:51.644666 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.644643 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" Jun 08 13:11:51.647697 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.647669 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 08 13:11:51.648496 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.648465 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 08 13:11:51.648622 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.648537 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 08 13:11:51.648622 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.648595 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 08 13:11:51.648864 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.648848 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6pvl2\"" Jun 08 13:11:51.657661 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.657628 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd"] Jun 08 13:11:51.668012 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.667980 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" event={"ID":"bc2d943d-342c-474b-a9d5-3d4c495f1dfc","Type":"ContainerStarted","Data":"b38f8cdc8954b5a503234f590e6ea8833690ae6389b9dddcb6d3122d80602a8b"} Jun 08 13:11:51.768178 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.768141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkntx\" (UniqueName: \"kubernetes.io/projected/4c8fe8dd-2f4d-4d8e-88e2-157189c2161d-kube-api-access-qkntx\") pod \"kube-auth-proxy-7cd48f9f86-lgfjd\" (UID: \"4c8fe8dd-2f4d-4d8e-88e2-157189c2161d\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" Jun 08 13:11:51.768370 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.768204 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c8fe8dd-2f4d-4d8e-88e2-157189c2161d-tls-certs\") pod \"kube-auth-proxy-7cd48f9f86-lgfjd\" (UID: \"4c8fe8dd-2f4d-4d8e-88e2-157189c2161d\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" Jun 08 13:11:51.768370 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.768287 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c8fe8dd-2f4d-4d8e-88e2-157189c2161d-tmp\") pod \"kube-auth-proxy-7cd48f9f86-lgfjd\" (UID: \"4c8fe8dd-2f4d-4d8e-88e2-157189c2161d\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" Jun 08 13:11:51.869647 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.869608 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkntx\" (UniqueName: \"kubernetes.io/projected/4c8fe8dd-2f4d-4d8e-88e2-157189c2161d-kube-api-access-qkntx\") pod \"kube-auth-proxy-7cd48f9f86-lgfjd\" (UID: \"4c8fe8dd-2f4d-4d8e-88e2-157189c2161d\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" Jun 08 13:11:51.869824 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.869670 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c8fe8dd-2f4d-4d8e-88e2-157189c2161d-tls-certs\") pod \"kube-auth-proxy-7cd48f9f86-lgfjd\" (UID: \"4c8fe8dd-2f4d-4d8e-88e2-157189c2161d\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" Jun 08 13:11:51.869824 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.869697 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c8fe8dd-2f4d-4d8e-88e2-157189c2161d-tmp\") pod \"kube-auth-proxy-7cd48f9f86-lgfjd\" (UID: \"4c8fe8dd-2f4d-4d8e-88e2-157189c2161d\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" Jun 08 13:11:51.871915 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.871889 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c8fe8dd-2f4d-4d8e-88e2-157189c2161d-tmp\") pod \"kube-auth-proxy-7cd48f9f86-lgfjd\" (UID: \"4c8fe8dd-2f4d-4d8e-88e2-157189c2161d\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" Jun 08 13:11:51.872113 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.872094 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4c8fe8dd-2f4d-4d8e-88e2-157189c2161d-tls-certs\") pod \"kube-auth-proxy-7cd48f9f86-lgfjd\" (UID: \"4c8fe8dd-2f4d-4d8e-88e2-157189c2161d\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" Jun 08 13:11:51.887757 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.887733 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkntx\" (UniqueName: \"kubernetes.io/projected/4c8fe8dd-2f4d-4d8e-88e2-157189c2161d-kube-api-access-qkntx\") pod \"kube-auth-proxy-7cd48f9f86-lgfjd\" (UID: \"4c8fe8dd-2f4d-4d8e-88e2-157189c2161d\") " pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" Jun 08 13:11:51.955000 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:51.954921 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" Jun 08 13:11:52.118878 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:52.117829 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd"] Jun 08 13:11:52.122376 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:11:52.122338 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c8fe8dd_2f4d_4d8e_88e2_157189c2161d.slice/crio-859238cd21219674d4a0b0ba504c753e9924579642cc5e79fba634ba45e4459a WatchSource:0}: Error finding container 859238cd21219674d4a0b0ba504c753e9924579642cc5e79fba634ba45e4459a: Status 404 returned error can't find the container with id 859238cd21219674d4a0b0ba504c753e9924579642cc5e79fba634ba45e4459a Jun 08 13:11:52.675096 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:52.675059 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" event={"ID":"4c8fe8dd-2f4d-4d8e-88e2-157189c2161d","Type":"ContainerStarted","Data":"859238cd21219674d4a0b0ba504c753e9924579642cc5e79fba634ba45e4459a"} Jun 08 13:11:56.695179 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:56.695136 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" event={"ID":"bc2d943d-342c-474b-a9d5-3d4c495f1dfc","Type":"ContainerStarted","Data":"35fdb7ceb368a1370aedb983dce4d22dc7cdc84b696f53c8d94cfeaa3c227563"} Jun 08 13:11:56.695694 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:56.695225 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" Jun 08 13:11:56.696704 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:56.696672 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" event={"ID":"4c8fe8dd-2f4d-4d8e-88e2-157189c2161d","Type":"ContainerStarted","Data":"4a02746290c140143ed0685f917a2c22d0e5e3172766c10542d02a40e66187ec"} Jun 08 13:11:56.713286 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:56.713235 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" podStartSLOduration=2.856912901 podStartE2EDuration="7.713221031s" totalImagesPullingTime="4.85630813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:11:56.711768058 +0000 UTC m=+635.681067590" watchObservedRunningTime="2026-06-08 13:11:56.713221031 +0000 UTC m=+635.682520561" Jun 08 13:11:56.729641 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:11:56.729588 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cd48f9f86-lgfjd" podStartSLOduration=1.869972237 podStartE2EDuration="5.729547689s" totalImagesPullingTime="3.859575452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:11:56.728898211 +0000 UTC m=+635.698197754" watchObservedRunningTime="2026-06-08 13:11:56.729547689 +0000 UTC m=+635.698847281" Jun 08 13:12:01.095733 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.095686 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-wl4hl"] Jun 08 13:12:01.099327 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.099305 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" Jun 08 13:12:01.101965 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.101939 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 08 13:12:01.102070 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.102043 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-jx6qm\"" Jun 08 13:12:01.106302 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.106178 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z"] Jun 08 13:12:01.109164 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.109147 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" Jun 08 13:12:01.112580 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.112548 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 08 13:12:01.112688 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.112559 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-8z2g5\"" Jun 08 13:12:01.113753 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.113721 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-wl4hl"] Jun 08 13:12:01.122671 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.122640 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z"] Jun 08 13:12:01.250471 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.250433 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n9kr\" (UniqueName: \"kubernetes.io/projected/c1c849fd-d492-47c9-b834-93884502bc21-kube-api-access-4n9kr\") pod \"kserve-controller-manager-69fc866d76-wl4hl\" (UID: \"c1c849fd-d492-47c9-b834-93884502bc21\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" Jun 08 13:12:01.250671 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.250528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1c849fd-d492-47c9-b834-93884502bc21-cert\") pod \"kserve-controller-manager-69fc866d76-wl4hl\" (UID: \"c1c849fd-d492-47c9-b834-93884502bc21\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" Jun 08 13:12:01.250671 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.250547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b392d6cf-cd89-43a4-8cff-f6137e4dd435-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-l679z\" (UID: \"b392d6cf-cd89-43a4-8cff-f6137e4dd435\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" Jun 08 13:12:01.250671 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.250593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crkn8\" (UniqueName: \"kubernetes.io/projected/b392d6cf-cd89-43a4-8cff-f6137e4dd435-kube-api-access-crkn8\") pod \"llmisvc-controller-manager-864bfd7bc9-l679z\" (UID: \"b392d6cf-cd89-43a4-8cff-f6137e4dd435\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" Jun 08 13:12:01.351827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.351740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4n9kr\" (UniqueName: \"kubernetes.io/projected/c1c849fd-d492-47c9-b834-93884502bc21-kube-api-access-4n9kr\") pod \"kserve-controller-manager-69fc866d76-wl4hl\" (UID: \"c1c849fd-d492-47c9-b834-93884502bc21\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" Jun 08 13:12:01.351827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.351789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1c849fd-d492-47c9-b834-93884502bc21-cert\") pod \"kserve-controller-manager-69fc866d76-wl4hl\" (UID: \"c1c849fd-d492-47c9-b834-93884502bc21\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" Jun 08 13:12:01.351827 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.351817 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b392d6cf-cd89-43a4-8cff-f6137e4dd435-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-l679z\" (UID: \"b392d6cf-cd89-43a4-8cff-f6137e4dd435\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" Jun 08 13:12:01.352049 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.351860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crkn8\" (UniqueName: \"kubernetes.io/projected/b392d6cf-cd89-43a4-8cff-f6137e4dd435-kube-api-access-crkn8\") pod \"llmisvc-controller-manager-864bfd7bc9-l679z\" (UID: \"b392d6cf-cd89-43a4-8cff-f6137e4dd435\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" Jun 08 13:12:01.354279 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.354253 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c1c849fd-d492-47c9-b834-93884502bc21-cert\") pod \"kserve-controller-manager-69fc866d76-wl4hl\" (UID: \"c1c849fd-d492-47c9-b834-93884502bc21\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" Jun 08 13:12:01.354417 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.354281 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b392d6cf-cd89-43a4-8cff-f6137e4dd435-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-l679z\" (UID: \"b392d6cf-cd89-43a4-8cff-f6137e4dd435\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" Jun 08 13:12:01.363357 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.363333 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crkn8\" (UniqueName: \"kubernetes.io/projected/b392d6cf-cd89-43a4-8cff-f6137e4dd435-kube-api-access-crkn8\") pod \"llmisvc-controller-manager-864bfd7bc9-l679z\" (UID: \"b392d6cf-cd89-43a4-8cff-f6137e4dd435\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" Jun 08 13:12:01.368340 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.368304 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n9kr\" (UniqueName: \"kubernetes.io/projected/c1c849fd-d492-47c9-b834-93884502bc21-kube-api-access-4n9kr\") pod \"kserve-controller-manager-69fc866d76-wl4hl\" (UID: \"c1c849fd-d492-47c9-b834-93884502bc21\") " pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" Jun 08 13:12:01.409850 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.409817 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" Jun 08 13:12:01.420019 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.419997 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" Jun 08 13:12:01.586671 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.586587 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-wl4hl"] Jun 08 13:12:01.591307 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:12:01.591279 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c849fd_d492_47c9_b834_93884502bc21.slice/crio-0417dbe5237da1d2466bc9ade1648a29fcdf9b818cce9fb92dbdaa7071036522 WatchSource:0}: Error finding container 0417dbe5237da1d2466bc9ade1648a29fcdf9b818cce9fb92dbdaa7071036522: Status 404 returned error can't find the container with id 0417dbe5237da1d2466bc9ade1648a29fcdf9b818cce9fb92dbdaa7071036522 Jun 08 13:12:01.612037 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.612002 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z"] Jun 08 13:12:01.614813 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:12:01.614787 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb392d6cf_cd89_43a4_8cff_f6137e4dd435.slice/crio-84bac8073a3a1d7fb1e58fd043cb51591396ef0a3fccff997dd262921d17f708 WatchSource:0}: Error finding container 84bac8073a3a1d7fb1e58fd043cb51591396ef0a3fccff997dd262921d17f708: Status 404 returned error can't find the container with id 84bac8073a3a1d7fb1e58fd043cb51591396ef0a3fccff997dd262921d17f708 Jun 08 13:12:01.717021 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.716986 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" event={"ID":"c1c849fd-d492-47c9-b834-93884502bc21","Type":"ContainerStarted","Data":"0417dbe5237da1d2466bc9ade1648a29fcdf9b818cce9fb92dbdaa7071036522"} Jun 08 13:12:01.718134 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:01.718109 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" event={"ID":"b392d6cf-cd89-43a4-8cff-f6137e4dd435","Type":"ContainerStarted","Data":"84bac8073a3a1d7fb1e58fd043cb51591396ef0a3fccff997dd262921d17f708"} Jun 08 13:12:05.740640 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:05.740547 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" event={"ID":"b392d6cf-cd89-43a4-8cff-f6137e4dd435","Type":"ContainerStarted","Data":"51dc1c0322189d7e646a174dacaff183e282fa516a583f0be2c2776d32577c8d"} Jun 08 13:12:05.741101 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:05.740669 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" Jun 08 13:12:05.742046 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:05.742020 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" event={"ID":"c1c849fd-d492-47c9-b834-93884502bc21","Type":"ContainerStarted","Data":"eebfe4f150545855be90ab8a04b344d2acb95e53cb28fb1fabda4b18e67ca680"} Jun 08 13:12:05.742188 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:05.742146 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" Jun 08 13:12:05.787512 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:05.787456 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" podStartSLOduration=1.545467742 podStartE2EDuration="4.787439131s" totalImagesPullingTime="3.241971389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:12:05.785920585 +0000 UTC m=+644.755220118" watchObservedRunningTime="2026-06-08 13:12:05.787439131 +0000 UTC m=+644.756738662" Jun 08 13:12:05.816965 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:05.816912 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" podStartSLOduration=1.557626213 podStartE2EDuration="4.816895574s" totalImagesPullingTime="3.259269361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:12:05.816489356 +0000 UTC m=+644.785788910" watchObservedRunningTime="2026-06-08 13:12:05.816895574 +0000 UTC m=+644.786195105" Jun 08 13:12:07.703770 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:07.703737 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-dzrxg" Jun 08 13:12:09.009362 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.009328 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8xskd"] Jun 08 13:12:09.016412 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.016385 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" Jun 08 13:12:09.019847 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.019820 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-8gfss\"" Jun 08 13:12:09.020263 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.020247 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 08 13:12:09.020985 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.020965 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 08 13:12:09.046088 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.046046 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8xskd"] Jun 08 13:12:09.116955 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.116909 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0a37e5e3-fd50-4962-9f77-f2714a91eef8-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8xskd\" (UID: \"0a37e5e3-fd50-4962-9f77-f2714a91eef8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" Jun 08 13:12:09.116955 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.116955 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skzzx\" (UniqueName: \"kubernetes.io/projected/0a37e5e3-fd50-4962-9f77-f2714a91eef8-kube-api-access-skzzx\") pod \"servicemesh-operator3-57f65f65fb-8xskd\" (UID: \"0a37e5e3-fd50-4962-9f77-f2714a91eef8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" Jun 08 13:12:09.217835 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.217798 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skzzx\" (UniqueName: \"kubernetes.io/projected/0a37e5e3-fd50-4962-9f77-f2714a91eef8-kube-api-access-skzzx\") pod \"servicemesh-operator3-57f65f65fb-8xskd\" (UID: \"0a37e5e3-fd50-4962-9f77-f2714a91eef8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" Jun 08 13:12:09.218040 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.217880 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0a37e5e3-fd50-4962-9f77-f2714a91eef8-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8xskd\" (UID: \"0a37e5e3-fd50-4962-9f77-f2714a91eef8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" Jun 08 13:12:09.220532 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.220503 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/0a37e5e3-fd50-4962-9f77-f2714a91eef8-operator-config\") pod \"servicemesh-operator3-57f65f65fb-8xskd\" (UID: \"0a37e5e3-fd50-4962-9f77-f2714a91eef8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" Jun 08 13:12:09.231951 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.231922 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-skzzx\" (UniqueName: \"kubernetes.io/projected/0a37e5e3-fd50-4962-9f77-f2714a91eef8-kube-api-access-skzzx\") pod \"servicemesh-operator3-57f65f65fb-8xskd\" (UID: \"0a37e5e3-fd50-4962-9f77-f2714a91eef8\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" Jun 08 13:12:09.325802 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.325705 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" Jun 08 13:12:09.480042 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.479995 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-8xskd"] Jun 08 13:12:09.483181 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:12:09.483156 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a37e5e3_fd50_4962_9f77_f2714a91eef8.slice/crio-f71a1dfac9c984b36d03ca3f4ce353e4281496b2b90d62255538f08b0f25f3b1 WatchSource:0}: Error finding container f71a1dfac9c984b36d03ca3f4ce353e4281496b2b90d62255538f08b0f25f3b1: Status 404 returned error can't find the container with id f71a1dfac9c984b36d03ca3f4ce353e4281496b2b90d62255538f08b0f25f3b1 Jun 08 13:12:09.759069 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:09.759031 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" event={"ID":"0a37e5e3-fd50-4962-9f77-f2714a91eef8","Type":"ContainerStarted","Data":"f71a1dfac9c984b36d03ca3f4ce353e4281496b2b90d62255538f08b0f25f3b1"} Jun 08 13:12:11.771701 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:11.771660 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" event={"ID":"0a37e5e3-fd50-4962-9f77-f2714a91eef8","Type":"ContainerStarted","Data":"ef8de1ea24f099c56357769746a1c2a5078851095bfa5f443d33eb3497de85c5"} Jun 08 13:12:11.772162 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:11.771745 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" Jun 08 13:12:11.797016 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:11.796630 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" podStartSLOduration=1.6267900979999999 podStartE2EDuration="3.796606904s" totalImagesPullingTime="2.169816806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:12:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:12:11.795011616 +0000 UTC m=+650.764311147" watchObservedRunningTime="2026-06-08 13:12:11.796606904 +0000 UTC m=+650.765906437" Jun 08 13:12:22.451108 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.451070 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c"] Jun 08 13:12:22.455923 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.455902 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.458339 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.458314 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 08 13:12:22.458339 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.458332 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 08 13:12:22.458580 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.458331 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 08 13:12:22.458580 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.458323 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-h9bkm\"" Jun 08 13:12:22.458580 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.458408 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 08 13:12:22.467941 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.467921 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c"] Jun 08 13:12:22.635472 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.635430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9798dc0-f33a-402f-9f58-c6b1c66c2596-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.635704 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.635492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.635704 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.635548 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.635704 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.635621 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hkdm\" (UniqueName: \"kubernetes.io/projected/b9798dc0-f33a-402f-9f58-c6b1c66c2596-kube-api-access-6hkdm\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.635704 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.635672 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9798dc0-f33a-402f-9f58-c6b1c66c2596-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.635704 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.635692 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.635918 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.635714 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.736261 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.736165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hkdm\" (UniqueName: \"kubernetes.io/projected/b9798dc0-f33a-402f-9f58-c6b1c66c2596-kube-api-access-6hkdm\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.736261 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.736230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9798dc0-f33a-402f-9f58-c6b1c66c2596-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.736261 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.736257 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.736552 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.736284 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.736552 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.736346 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9798dc0-f33a-402f-9f58-c6b1c66c2596-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.736552 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.736446 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.736552 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.736502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.737047 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.737022 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.738713 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.738682 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b9798dc0-f33a-402f-9f58-c6b1c66c2596-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.738944 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.738922 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.739162 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.739140 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.739200 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.739162 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b9798dc0-f33a-402f-9f58-c6b1c66c2596-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.744482 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.744459 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b9798dc0-f33a-402f-9f58-c6b1c66c2596-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.744590 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.744457 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hkdm\" (UniqueName: \"kubernetes.io/projected/b9798dc0-f33a-402f-9f58-c6b1c66c2596-kube-api-access-6hkdm\") pod \"istiod-openshift-gateway-75c67f8887-wt58c\" (UID: \"b9798dc0-f33a-402f-9f58-c6b1c66c2596\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.765428 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.765387 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:22.778536 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.778501 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-8xskd" Jun 08 13:12:22.920687 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:22.920657 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c"] Jun 08 13:12:22.924134 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:12:22.924095 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9798dc0_f33a_402f_9f58_c6b1c66c2596.slice/crio-d9b96d349cd20d1f52f5b9e92cfe51736b451b37534a641b8c90bfe63061345c WatchSource:0}: Error finding container d9b96d349cd20d1f52f5b9e92cfe51736b451b37534a641b8c90bfe63061345c: Status 404 returned error can't find the container with id d9b96d349cd20d1f52f5b9e92cfe51736b451b37534a641b8c90bfe63061345c Jun 08 13:12:23.827371 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:23.827295 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" event={"ID":"b9798dc0-f33a-402f-9f58-c6b1c66c2596","Type":"ContainerStarted","Data":"d9b96d349cd20d1f52f5b9e92cfe51736b451b37534a641b8c90bfe63061345c"} Jun 08 13:12:25.562421 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:25.562376 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 13:12:25.562798 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:25.562451 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 08 13:12:25.838537 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:25.838429 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" event={"ID":"b9798dc0-f33a-402f-9f58-c6b1c66c2596","Type":"ContainerStarted","Data":"84ac02b8997fad0f46728235b9d7d819a23c3b9c701fe24bb6a4bdfb82c4274d"} Jun 08 13:12:25.838944 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:25.838552 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:25.862366 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:25.862309 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" podStartSLOduration=1.2264727340000001 podStartE2EDuration="3.862290136s" totalImagesPullingTime="2.635817402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:12:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:12:25.861439083 +0000 UTC m=+664.830738613" watchObservedRunningTime="2026-06-08 13:12:25.862290136 +0000 UTC m=+664.831589668" Jun 08 13:12:26.845034 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:26.845000 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-wt58c" Jun 08 13:12:30.824461 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:30.824424 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-7bc4849f48-df7p6"] Jun 08 13:12:30.875786 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:30.875735 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7bc4849f48-df7p6"] Jun 08 13:12:30.875980 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:30.875866 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7bc4849f48-df7p6" Jun 08 13:12:30.878491 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:30.878462 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xxxqt\"" Jun 08 13:12:30.878656 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:30.878462 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 08 13:12:30.906216 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:30.906178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-md664\" (UniqueName: \"kubernetes.io/projected/00d793dd-7e1f-48d2-a2f8-6512fffc2117-kube-api-access-md664\") pod \"dashboard-redirect-7bc4849f48-df7p6\" (UID: \"00d793dd-7e1f-48d2-a2f8-6512fffc2117\") " pod="opendatahub/dashboard-redirect-7bc4849f48-df7p6" Jun 08 13:12:30.906382 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:30.906239 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/00d793dd-7e1f-48d2-a2f8-6512fffc2117-redirect-config\") pod \"dashboard-redirect-7bc4849f48-df7p6\" (UID: \"00d793dd-7e1f-48d2-a2f8-6512fffc2117\") " pod="opendatahub/dashboard-redirect-7bc4849f48-df7p6" Jun 08 13:12:31.006902 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:31.006862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-md664\" (UniqueName: \"kubernetes.io/projected/00d793dd-7e1f-48d2-a2f8-6512fffc2117-kube-api-access-md664\") pod \"dashboard-redirect-7bc4849f48-df7p6\" (UID: \"00d793dd-7e1f-48d2-a2f8-6512fffc2117\") " pod="opendatahub/dashboard-redirect-7bc4849f48-df7p6" Jun 08 13:12:31.007063 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:31.006942 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/00d793dd-7e1f-48d2-a2f8-6512fffc2117-redirect-config\") pod \"dashboard-redirect-7bc4849f48-df7p6\" (UID: \"00d793dd-7e1f-48d2-a2f8-6512fffc2117\") " pod="opendatahub/dashboard-redirect-7bc4849f48-df7p6" Jun 08 13:12:31.007683 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:31.007661 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/00d793dd-7e1f-48d2-a2f8-6512fffc2117-redirect-config\") pod \"dashboard-redirect-7bc4849f48-df7p6\" (UID: \"00d793dd-7e1f-48d2-a2f8-6512fffc2117\") " pod="opendatahub/dashboard-redirect-7bc4849f48-df7p6" Jun 08 13:12:31.015698 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:31.015661 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-md664\" (UniqueName: \"kubernetes.io/projected/00d793dd-7e1f-48d2-a2f8-6512fffc2117-kube-api-access-md664\") pod \"dashboard-redirect-7bc4849f48-df7p6\" (UID: \"00d793dd-7e1f-48d2-a2f8-6512fffc2117\") " pod="opendatahub/dashboard-redirect-7bc4849f48-df7p6" Jun 08 13:12:31.185831 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:31.185792 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-7bc4849f48-df7p6" Jun 08 13:12:31.332109 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:31.332085 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-7bc4849f48-df7p6"] Jun 08 13:12:31.334384 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:12:31.334352 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00d793dd_7e1f_48d2_a2f8_6512fffc2117.slice/crio-bd597ac8ad750f78d52c6028b38e1cd645005331d054e9986a87a8d1d245d880 WatchSource:0}: Error finding container bd597ac8ad750f78d52c6028b38e1cd645005331d054e9986a87a8d1d245d880: Status 404 returned error can't find the container with id bd597ac8ad750f78d52c6028b38e1cd645005331d054e9986a87a8d1d245d880 Jun 08 13:12:31.865399 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:31.865361 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7bc4849f48-df7p6" event={"ID":"00d793dd-7e1f-48d2-a2f8-6512fffc2117","Type":"ContainerStarted","Data":"bd597ac8ad750f78d52c6028b38e1cd645005331d054e9986a87a8d1d245d880"} Jun 08 13:12:33.876943 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:33.876908 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-7bc4849f48-df7p6" event={"ID":"00d793dd-7e1f-48d2-a2f8-6512fffc2117","Type":"ContainerStarted","Data":"e4327d59ec0c2f9dd306062340ddf69055fb807d8fd980a23aae74986c403648"} Jun 08 13:12:33.894312 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:33.894207 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-7bc4849f48-df7p6" podStartSLOduration=1.600034228 podStartE2EDuration="3.894191693s" totalImagesPullingTime="2.294157465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:12:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:12:33.893385725 +0000 UTC m=+672.862685257" watchObservedRunningTime="2026-06-08 13:12:33.894191693 +0000 UTC m=+672.863491223" Jun 08 13:12:36.747993 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:36.747964 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-l679z" Jun 08 13:12:36.751087 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:12:36.751065 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-wl4hl" Jun 08 13:13:28.088877 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.088796 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2x967"] Jun 08 13:13:28.091307 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.091290 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2x967" Jun 08 13:13:28.095284 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.095263 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 08 13:13:28.095396 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.095334 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xswqr\"" Jun 08 13:13:28.095910 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.095895 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 08 13:13:28.124350 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.124323 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2x967"] Jun 08 13:13:28.181274 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.181233 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlszh\" (UniqueName: \"kubernetes.io/projected/217f082f-5544-4ea3-8a22-07e6e8f6df74-kube-api-access-wlszh\") pod \"authorino-operator-75cc8d5cb7-2x967\" (UID: \"217f082f-5544-4ea3-8a22-07e6e8f6df74\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2x967" Jun 08 13:13:28.281880 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.281845 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlszh\" (UniqueName: \"kubernetes.io/projected/217f082f-5544-4ea3-8a22-07e6e8f6df74-kube-api-access-wlszh\") pod \"authorino-operator-75cc8d5cb7-2x967\" (UID: \"217f082f-5544-4ea3-8a22-07e6e8f6df74\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2x967" Jun 08 13:13:28.316095 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.316063 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlszh\" (UniqueName: \"kubernetes.io/projected/217f082f-5544-4ea3-8a22-07e6e8f6df74-kube-api-access-wlszh\") pod \"authorino-operator-75cc8d5cb7-2x967\" (UID: \"217f082f-5544-4ea3-8a22-07e6e8f6df74\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2x967" Jun 08 13:13:28.401033 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.400997 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2x967" Jun 08 13:13:28.540975 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.540943 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2x967"] Jun 08 13:13:28.545211 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:13:28.545175 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod217f082f_5544_4ea3_8a22_07e6e8f6df74.slice/crio-eeb1caa903c1077df5f17252c65a7163197f7a2081095b283b6143cada992839 WatchSource:0}: Error finding container eeb1caa903c1077df5f17252c65a7163197f7a2081095b283b6143cada992839: Status 404 returned error can't find the container with id eeb1caa903c1077df5f17252c65a7163197f7a2081095b283b6143cada992839 Jun 08 13:13:28.547670 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:28.547650 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 08 13:13:29.123545 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:29.123511 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2x967" event={"ID":"217f082f-5544-4ea3-8a22-07e6e8f6df74","Type":"ContainerStarted","Data":"eeb1caa903c1077df5f17252c65a7163197f7a2081095b283b6143cada992839"} Jun 08 13:13:31.134977 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:31.134944 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2x967" event={"ID":"217f082f-5544-4ea3-8a22-07e6e8f6df74","Type":"ContainerStarted","Data":"461e68243efb4a9d3c4645088f1e6e845dda192e4209fd2839f4dca07ec2de13"} Jun 08 13:13:31.135354 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:31.135076 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2x967" Jun 08 13:13:42.142037 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:42.141998 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2x967" Jun 08 13:13:42.170757 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:13:42.170600 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2x967" podStartSLOduration=12.045116234 podStartE2EDuration="14.170585821s" totalImagesPullingTime="2.125469587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:13:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:13:31.174303008 +0000 UTC m=+730.143602538" watchObservedRunningTime="2026-06-08 13:13:42.170585821 +0000 UTC m=+741.139885343" Jun 08 13:14:23.526171 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.526131 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4g9vq"] Jun 08 13:14:23.529532 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.529513 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:23.531925 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.531895 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 08 13:14:23.532050 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.531933 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vgs9d\"" Jun 08 13:14:23.539532 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.539508 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4g9vq"] Jun 08 13:14:23.619299 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.619263 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4g9vq"] Jun 08 13:14:23.636051 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.636015 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/504525bc-e0c9-46fa-87b4-1db088010b61-config-file\") pod \"limitador-limitador-64c94fd64f-4g9vq\" (UID: \"504525bc-e0c9-46fa-87b4-1db088010b61\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:23.636231 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.636132 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlplf\" (UniqueName: \"kubernetes.io/projected/504525bc-e0c9-46fa-87b4-1db088010b61-kube-api-access-vlplf\") pod \"limitador-limitador-64c94fd64f-4g9vq\" (UID: \"504525bc-e0c9-46fa-87b4-1db088010b61\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:23.737031 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.736992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/504525bc-e0c9-46fa-87b4-1db088010b61-config-file\") pod \"limitador-limitador-64c94fd64f-4g9vq\" (UID: \"504525bc-e0c9-46fa-87b4-1db088010b61\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:23.737323 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.737294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlplf\" (UniqueName: \"kubernetes.io/projected/504525bc-e0c9-46fa-87b4-1db088010b61-kube-api-access-vlplf\") pod \"limitador-limitador-64c94fd64f-4g9vq\" (UID: \"504525bc-e0c9-46fa-87b4-1db088010b61\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:23.737803 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.737781 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/504525bc-e0c9-46fa-87b4-1db088010b61-config-file\") pod \"limitador-limitador-64c94fd64f-4g9vq\" (UID: \"504525bc-e0c9-46fa-87b4-1db088010b61\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:23.750215 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.750181 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlplf\" (UniqueName: \"kubernetes.io/projected/504525bc-e0c9-46fa-87b4-1db088010b61-kube-api-access-vlplf\") pod \"limitador-limitador-64c94fd64f-4g9vq\" (UID: \"504525bc-e0c9-46fa-87b4-1db088010b61\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:23.840076 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.839986 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:23.987515 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:23.987483 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4g9vq"] Jun 08 13:14:23.991059 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:14:23.991026 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod504525bc_e0c9_46fa_87b4_1db088010b61.slice/crio-7ad4f73e8d41d204c77a07e535f81cad5ba59d8f6d8ade9697b53e9812763e70 WatchSource:0}: Error finding container 7ad4f73e8d41d204c77a07e535f81cad5ba59d8f6d8ade9697b53e9812763e70: Status 404 returned error can't find the container with id 7ad4f73e8d41d204c77a07e535f81cad5ba59d8f6d8ade9697b53e9812763e70 Jun 08 13:14:24.378842 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:24.378806 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" event={"ID":"504525bc-e0c9-46fa-87b4-1db088010b61","Type":"ContainerStarted","Data":"7ad4f73e8d41d204c77a07e535f81cad5ba59d8f6d8ade9697b53e9812763e70"} Jun 08 13:14:27.393891 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:27.393851 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" event={"ID":"504525bc-e0c9-46fa-87b4-1db088010b61","Type":"ContainerStarted","Data":"3b452ca3fbfe98614b9d810d13666d5ef6b90ba9fd9c5b423e0f884ea368d8ba"} Jun 08 13:14:27.394371 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:27.393978 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:27.416394 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:27.416341 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" podStartSLOduration=1.7197058859999999 podStartE2EDuration="4.416327922s" totalImagesPullingTime="2.696622036s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:14:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:14:27.414250472 +0000 UTC m=+786.383550016" watchObservedRunningTime="2026-06-08 13:14:27.416327922 +0000 UTC m=+786.385627452" Jun 08 13:14:38.399804 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:38.399770 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:40.929585 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:40.929531 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4g9vq"] Jun 08 13:14:40.930039 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:40.929764 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" podUID="504525bc-e0c9-46fa-87b4-1db088010b61" containerName="limitador" containerID="cri-o://3b452ca3fbfe98614b9d810d13666d5ef6b90ba9fd9c5b423e0f884ea368d8ba" gracePeriod=30 Jun 08 13:14:41.456130 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:41.456091 2563 generic.go:356] "Generic (PLEG): container finished" podID="504525bc-e0c9-46fa-87b4-1db088010b61" containerID="3b452ca3fbfe98614b9d810d13666d5ef6b90ba9fd9c5b423e0f884ea368d8ba" exitCode=0 Jun 08 13:14:41.456275 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:41.456136 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" event={"ID":"504525bc-e0c9-46fa-87b4-1db088010b61","Type":"ContainerDied","Data":"3b452ca3fbfe98614b9d810d13666d5ef6b90ba9fd9c5b423e0f884ea368d8ba"} Jun 08 13:14:41.475041 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:41.475018 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:41.579721 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:41.579638 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/504525bc-e0c9-46fa-87b4-1db088010b61-config-file\") pod \"504525bc-e0c9-46fa-87b4-1db088010b61\" (UID: \"504525bc-e0c9-46fa-87b4-1db088010b61\") " Jun 08 13:14:41.579721 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:41.579722 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlplf\" (UniqueName: \"kubernetes.io/projected/504525bc-e0c9-46fa-87b4-1db088010b61-kube-api-access-vlplf\") pod \"504525bc-e0c9-46fa-87b4-1db088010b61\" (UID: \"504525bc-e0c9-46fa-87b4-1db088010b61\") " Jun 08 13:14:41.580003 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:41.579969 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/504525bc-e0c9-46fa-87b4-1db088010b61-config-file" (OuterVolumeSpecName: "config-file") pod "504525bc-e0c9-46fa-87b4-1db088010b61" (UID: "504525bc-e0c9-46fa-87b4-1db088010b61"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 08 13:14:41.581842 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:41.581820 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/504525bc-e0c9-46fa-87b4-1db088010b61-kube-api-access-vlplf" (OuterVolumeSpecName: "kube-api-access-vlplf") pod "504525bc-e0c9-46fa-87b4-1db088010b61" (UID: "504525bc-e0c9-46fa-87b4-1db088010b61"). InnerVolumeSpecName "kube-api-access-vlplf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:14:41.680266 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:41.680229 2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/504525bc-e0c9-46fa-87b4-1db088010b61-config-file\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 08 13:14:41.680266 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:41.680255 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlplf\" (UniqueName: \"kubernetes.io/projected/504525bc-e0c9-46fa-87b4-1db088010b61-kube-api-access-vlplf\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 08 13:14:42.462203 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:42.462166 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" event={"ID":"504525bc-e0c9-46fa-87b4-1db088010b61","Type":"ContainerDied","Data":"7ad4f73e8d41d204c77a07e535f81cad5ba59d8f6d8ade9697b53e9812763e70"} Jun 08 13:14:42.462628 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:42.462184 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-4g9vq" Jun 08 13:14:42.463194 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:42.463179 2563 scope.go:117] "RemoveContainer" containerID="3b452ca3fbfe98614b9d810d13666d5ef6b90ba9fd9c5b423e0f884ea368d8ba" Jun 08 13:14:42.486458 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:42.486434 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4g9vq"] Jun 08 13:14:42.490836 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:42.490811 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-4g9vq"] Jun 08 13:14:43.513409 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:43.513377 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="504525bc-e0c9-46fa-87b4-1db088010b61" path="/var/lib/kubelet/pods/504525bc-e0c9-46fa-87b4-1db088010b61/volumes" Jun 08 13:14:44.690021 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.689989 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-tm5t8"] Jun 08 13:14:44.690496 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.690468 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="504525bc-e0c9-46fa-87b4-1db088010b61" containerName="limitador" Jun 08 13:14:44.690496 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.690483 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="504525bc-e0c9-46fa-87b4-1db088010b61" containerName="limitador" Jun 08 13:14:44.690631 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.690596 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="504525bc-e0c9-46fa-87b4-1db088010b61" containerName="limitador" Jun 08 13:14:44.695329 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.695250 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-tm5t8" Jun 08 13:14:44.697763 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.697746 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 08 13:14:44.705407 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.705377 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-tm5t8"] Jun 08 13:14:44.806376 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.806339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhlm2\" (UniqueName: \"kubernetes.io/projected/2b4f2629-fe32-41e8-9522-ab846fac2d48-kube-api-access-rhlm2\") pod \"postgres-69fb4594cf-tm5t8\" (UID: \"2b4f2629-fe32-41e8-9522-ab846fac2d48\") " pod="opendatahub/postgres-69fb4594cf-tm5t8" Jun 08 13:14:44.806537 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.806385 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2b4f2629-fe32-41e8-9522-ab846fac2d48-data\") pod \"postgres-69fb4594cf-tm5t8\" (UID: \"2b4f2629-fe32-41e8-9522-ab846fac2d48\") " pod="opendatahub/postgres-69fb4594cf-tm5t8" Jun 08 13:14:44.907446 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.907403 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhlm2\" (UniqueName: \"kubernetes.io/projected/2b4f2629-fe32-41e8-9522-ab846fac2d48-kube-api-access-rhlm2\") pod \"postgres-69fb4594cf-tm5t8\" (UID: \"2b4f2629-fe32-41e8-9522-ab846fac2d48\") " pod="opendatahub/postgres-69fb4594cf-tm5t8" Jun 08 13:14:44.907641 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.907453 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2b4f2629-fe32-41e8-9522-ab846fac2d48-data\") pod \"postgres-69fb4594cf-tm5t8\" (UID: \"2b4f2629-fe32-41e8-9522-ab846fac2d48\") " pod="opendatahub/postgres-69fb4594cf-tm5t8" Jun 08 13:14:44.907864 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.907848 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/2b4f2629-fe32-41e8-9522-ab846fac2d48-data\") pod \"postgres-69fb4594cf-tm5t8\" (UID: \"2b4f2629-fe32-41e8-9522-ab846fac2d48\") " pod="opendatahub/postgres-69fb4594cf-tm5t8" Jun 08 13:14:44.916765 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:44.916747 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhlm2\" (UniqueName: \"kubernetes.io/projected/2b4f2629-fe32-41e8-9522-ab846fac2d48-kube-api-access-rhlm2\") pod \"postgres-69fb4594cf-tm5t8\" (UID: \"2b4f2629-fe32-41e8-9522-ab846fac2d48\") " pod="opendatahub/postgres-69fb4594cf-tm5t8" Jun 08 13:14:45.008154 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:45.008050 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-tm5t8" Jun 08 13:14:45.138024 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:45.138000 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-tm5t8"] Jun 08 13:14:45.140074 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:14:45.140044 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4f2629_fe32_41e8_9522_ab846fac2d48.slice/crio-d78b51afa8f179991d98d1ca19560097ffb081863a4c56c52e9f51d9781da2cb WatchSource:0}: Error finding container d78b51afa8f179991d98d1ca19560097ffb081863a4c56c52e9f51d9781da2cb: Status 404 returned error can't find the container with id d78b51afa8f179991d98d1ca19560097ffb081863a4c56c52e9f51d9781da2cb Jun 08 13:14:45.477444 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:45.477410 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-tm5t8" event={"ID":"2b4f2629-fe32-41e8-9522-ab846fac2d48","Type":"ContainerStarted","Data":"d78b51afa8f179991d98d1ca19560097ffb081863a4c56c52e9f51d9781da2cb"} Jun 08 13:14:48.494904 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:48.494867 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-tm5t8" event={"ID":"2b4f2629-fe32-41e8-9522-ab846fac2d48","Type":"ContainerStarted","Data":"494f96c404e625016dae55a540f5cd29553ac5dcd6259f29274b1fc9f5dd9851"} Jun 08 13:14:48.495372 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:48.494973 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-tm5t8" Jun 08 13:14:48.514957 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:48.514890 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-tm5t8" podStartSLOduration=1.6273386319999998 podStartE2EDuration="4.514870263s" totalImagesPullingTime="2.887531631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:14:48.513126987 +0000 UTC m=+807.482426519" watchObservedRunningTime="2026-06-08 13:14:48.514870263 +0000 UTC m=+807.484169793" Jun 08 13:14:54.532619 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:14:54.532574 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-tm5t8" Jun 08 13:15:19.688543 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:19.688498 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:15:19.691930 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:19.691905 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:15:19.695210 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:19.695189 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 13:15:19.695413 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:19.695397 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tfn46\"" Jun 08 13:15:19.695479 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:19.695411 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 13:15:19.695479 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:19.695412 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 13:15:19.702531 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:19.702511 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:15:19.810964 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:19.810930 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdcvn\" (UniqueName: \"kubernetes.io/projected/17b31e20-ea56-4be6-9ea3-0842eb4ec2e4-kube-api-access-jdcvn\") pod \"maas-keycloak-0\" (UID: \"17b31e20-ea56-4be6-9ea3-0842eb4ec2e4\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:15:19.911490 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:19.911451 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdcvn\" (UniqueName: \"kubernetes.io/projected/17b31e20-ea56-4be6-9ea3-0842eb4ec2e4-kube-api-access-jdcvn\") pod \"maas-keycloak-0\" (UID: \"17b31e20-ea56-4be6-9ea3-0842eb4ec2e4\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:15:19.924554 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:19.924524 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdcvn\" (UniqueName: \"kubernetes.io/projected/17b31e20-ea56-4be6-9ea3-0842eb4ec2e4-kube-api-access-jdcvn\") pod \"maas-keycloak-0\" (UID: \"17b31e20-ea56-4be6-9ea3-0842eb4ec2e4\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:15:20.002159 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:20.002066 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:15:20.136645 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:20.136588 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:15:20.138982 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:15:20.138955 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17b31e20_ea56_4be6_9ea3_0842eb4ec2e4.slice/crio-39c6e20033957345feae4e5d3f5707740dc02de1fbc7a5b48e0368994f29cb6e WatchSource:0}: Error finding container 39c6e20033957345feae4e5d3f5707740dc02de1fbc7a5b48e0368994f29cb6e: Status 404 returned error can't find the container with id 39c6e20033957345feae4e5d3f5707740dc02de1fbc7a5b48e0368994f29cb6e Jun 08 13:15:20.644061 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:20.643911 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"17b31e20-ea56-4be6-9ea3-0842eb4ec2e4","Type":"ContainerStarted","Data":"39c6e20033957345feae4e5d3f5707740dc02de1fbc7a5b48e0368994f29cb6e"} Jun 08 13:15:24.784698 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:24.784674 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 13:15:25.676771 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:25.676720 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"17b31e20-ea56-4be6-9ea3-0842eb4ec2e4","Type":"ContainerStarted","Data":"a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8"} Jun 08 13:15:25.700601 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:25.700500 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.058931625 podStartE2EDuration="6.700476326s" totalImagesPullingTime="4.641544701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:15:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:15:25.699124879 +0000 UTC m=+844.668424411" watchObservedRunningTime="2026-06-08 13:15:25.700476326 +0000 UTC m=+844.669775866" Jun 08 13:15:26.003071 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:26.002968 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 13:15:26.004686 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:26.004650 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:27.003290 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:27.003236 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:28.003430 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:28.003379 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:29.003453 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:29.003407 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:30.003082 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:30.003036 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:15:30.003415 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:30.003375 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:31.003439 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:31.003329 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:32.002825 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:32.002769 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:33.003140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:33.003097 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:34.003085 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:34.003026 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:35.003623 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:35.003549 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:36.002987 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:36.002935 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:37.003278 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:37.003237 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.27:9000/health/started\": dial tcp 10.133.0.27:9000: connect: connection refused" Jun 08 13:15:38.111515 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:38.111476 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 13:15:38.126753 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:38.126714 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:15:48.118782 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:15:48.118747 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:26.009625 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:26.009505 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:16:26.013067 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:26.010253 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:16:31.897029 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:31.896996 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-844b6c964f-7l4mj"] Jun 08 13:16:31.899207 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:31.899189 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-844b6c964f-7l4mj" Jun 08 13:16:31.902414 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:31.902389 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 08 13:16:31.902537 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:31.902467 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-9gsbd\"" Jun 08 13:16:31.921738 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:31.921708 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-844b6c964f-7l4mj"] Jun 08 13:16:31.955044 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:31.955009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3a28e1a-cc40-4e52-b38a-a3000d751ad0-maas-api-tls\") pod \"maas-api-844b6c964f-7l4mj\" (UID: \"c3a28e1a-cc40-4e52-b38a-a3000d751ad0\") " pod="opendatahub/maas-api-844b6c964f-7l4mj" Jun 08 13:16:31.955198 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:31.955079 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tkfg\" (UniqueName: \"kubernetes.io/projected/c3a28e1a-cc40-4e52-b38a-a3000d751ad0-kube-api-access-9tkfg\") pod \"maas-api-844b6c964f-7l4mj\" (UID: \"c3a28e1a-cc40-4e52-b38a-a3000d751ad0\") " pod="opendatahub/maas-api-844b6c964f-7l4mj" Jun 08 13:16:32.056314 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.056272 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3a28e1a-cc40-4e52-b38a-a3000d751ad0-maas-api-tls\") pod \"maas-api-844b6c964f-7l4mj\" (UID: \"c3a28e1a-cc40-4e52-b38a-a3000d751ad0\") " pod="opendatahub/maas-api-844b6c964f-7l4mj" Jun 08 13:16:32.056494 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.056345 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tkfg\" (UniqueName: \"kubernetes.io/projected/c3a28e1a-cc40-4e52-b38a-a3000d751ad0-kube-api-access-9tkfg\") pod \"maas-api-844b6c964f-7l4mj\" (UID: \"c3a28e1a-cc40-4e52-b38a-a3000d751ad0\") " pod="opendatahub/maas-api-844b6c964f-7l4mj" Jun 08 13:16:32.056494 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:16:32.056413 2563 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 08 13:16:32.056494 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:16:32.056479 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3a28e1a-cc40-4e52-b38a-a3000d751ad0-maas-api-tls podName:c3a28e1a-cc40-4e52-b38a-a3000d751ad0 nodeName:}" failed. No retries permitted until 2026-06-08 13:16:32.556462937 +0000 UTC m=+911.525762449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c3a28e1a-cc40-4e52-b38a-a3000d751ad0-maas-api-tls") pod "maas-api-844b6c964f-7l4mj" (UID: "c3a28e1a-cc40-4e52-b38a-a3000d751ad0") : secret "maas-api-serving-cert" not found Jun 08 13:16:32.074689 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.074656 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tkfg\" (UniqueName: \"kubernetes.io/projected/c3a28e1a-cc40-4e52-b38a-a3000d751ad0-kube-api-access-9tkfg\") pod \"maas-api-844b6c964f-7l4mj\" (UID: \"c3a28e1a-cc40-4e52-b38a-a3000d751ad0\") " pod="opendatahub/maas-api-844b6c964f-7l4mj" Jun 08 13:16:32.561484 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.561444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3a28e1a-cc40-4e52-b38a-a3000d751ad0-maas-api-tls\") pod \"maas-api-844b6c964f-7l4mj\" (UID: \"c3a28e1a-cc40-4e52-b38a-a3000d751ad0\") " pod="opendatahub/maas-api-844b6c964f-7l4mj" Jun 08 13:16:32.564521 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.564493 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3a28e1a-cc40-4e52-b38a-a3000d751ad0-maas-api-tls\") pod \"maas-api-844b6c964f-7l4mj\" (UID: \"c3a28e1a-cc40-4e52-b38a-a3000d751ad0\") " pod="opendatahub/maas-api-844b6c964f-7l4mj" Jun 08 13:16:32.653554 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.653517 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-h95rl"] Jun 08 13:16:32.655851 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.655829 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-h95rl" Jun 08 13:16:32.661194 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.661172 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-8qhc4\"" Jun 08 13:16:32.664915 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.664893 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 08 13:16:32.682108 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.682064 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-h95rl"] Jun 08 13:16:32.763389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.763350 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9cwv\" (UniqueName: \"kubernetes.io/projected/598fc797-c404-459d-b8f7-682c4d83501a-kube-api-access-s9cwv\") pod \"payload-pre-processing-67d7689b65-h95rl\" (UID: \"598fc797-c404-459d-b8f7-682c4d83501a\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-h95rl" Jun 08 13:16:32.805294 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.805263 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qq8j4"] Jun 08 13:16:32.807706 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.807686 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-qq8j4" Jun 08 13:16:32.809975 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.809948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-844b6c964f-7l4mj" Jun 08 13:16:32.839601 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.839553 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qq8j4"] Jun 08 13:16:32.863899 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.863864 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btgn8\" (UniqueName: \"kubernetes.io/projected/2703338c-7e6d-444e-bf16-fb84cafd7eac-kube-api-access-btgn8\") pod \"payload-processing-7c6c859784-qq8j4\" (UID: \"2703338c-7e6d-444e-bf16-fb84cafd7eac\") " pod="openshift-ingress/payload-processing-7c6c859784-qq8j4" Jun 08 13:16:32.864047 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.863921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9cwv\" (UniqueName: \"kubernetes.io/projected/598fc797-c404-459d-b8f7-682c4d83501a-kube-api-access-s9cwv\") pod \"payload-pre-processing-67d7689b65-h95rl\" (UID: \"598fc797-c404-459d-b8f7-682c4d83501a\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-h95rl" Jun 08 13:16:32.886707 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.886676 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9cwv\" (UniqueName: \"kubernetes.io/projected/598fc797-c404-459d-b8f7-682c4d83501a-kube-api-access-s9cwv\") pod \"payload-pre-processing-67d7689b65-h95rl\" (UID: \"598fc797-c404-459d-b8f7-682c4d83501a\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-h95rl" Jun 08 13:16:32.964198 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.964161 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-844b6c964f-7l4mj"] Jun 08 13:16:32.964598 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.964442 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btgn8\" (UniqueName: \"kubernetes.io/projected/2703338c-7e6d-444e-bf16-fb84cafd7eac-kube-api-access-btgn8\") pod \"payload-processing-7c6c859784-qq8j4\" (UID: \"2703338c-7e6d-444e-bf16-fb84cafd7eac\") " pod="openshift-ingress/payload-processing-7c6c859784-qq8j4" Jun 08 13:16:32.966606 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.966519 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-h95rl" Jun 08 13:16:32.971212 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:16:32.971188 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a28e1a_cc40_4e52_b38a_a3000d751ad0.slice/crio-d3572d81453af835fb3a58deefd317c169fed7c7f28498ddf18988fc6dd2061f WatchSource:0}: Error finding container d3572d81453af835fb3a58deefd317c169fed7c7f28498ddf18988fc6dd2061f: Status 404 returned error can't find the container with id d3572d81453af835fb3a58deefd317c169fed7c7f28498ddf18988fc6dd2061f Jun 08 13:16:32.998489 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:32.998458 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btgn8\" (UniqueName: \"kubernetes.io/projected/2703338c-7e6d-444e-bf16-fb84cafd7eac-kube-api-access-btgn8\") pod \"payload-processing-7c6c859784-qq8j4\" (UID: \"2703338c-7e6d-444e-bf16-fb84cafd7eac\") " pod="openshift-ingress/payload-processing-7c6c859784-qq8j4" Jun 08 13:16:33.026771 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:33.026241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-844b6c964f-7l4mj" event={"ID":"c3a28e1a-cc40-4e52-b38a-a3000d751ad0","Type":"ContainerStarted","Data":"d3572d81453af835fb3a58deefd317c169fed7c7f28498ddf18988fc6dd2061f"} Jun 08 13:16:33.113416 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:33.113391 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-h95rl"] Jun 08 13:16:33.115259 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:16:33.115228 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod598fc797_c404_459d_b8f7_682c4d83501a.slice/crio-95152458cea362c6de8faea39be054f35ca57dc6a04f44ba9b2543f2dcad6bad WatchSource:0}: Error finding container 95152458cea362c6de8faea39be054f35ca57dc6a04f44ba9b2543f2dcad6bad: Status 404 returned error can't find the container with id 95152458cea362c6de8faea39be054f35ca57dc6a04f44ba9b2543f2dcad6bad Jun 08 13:16:33.122509 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:33.122488 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7c6c859784-qq8j4" Jun 08 13:16:33.257831 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:33.257806 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7c6c859784-qq8j4"] Jun 08 13:16:33.259980 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:16:33.259954 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2703338c_7e6d_444e_bf16_fb84cafd7eac.slice/crio-fe1e46598b48eca3663492237b9765e3ca46884948542b61f4ea265acd082e4b WatchSource:0}: Error finding container fe1e46598b48eca3663492237b9765e3ca46884948542b61f4ea265acd082e4b: Status 404 returned error can't find the container with id fe1e46598b48eca3663492237b9765e3ca46884948542b61f4ea265acd082e4b Jun 08 13:16:34.034993 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:34.034954 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-h95rl" event={"ID":"598fc797-c404-459d-b8f7-682c4d83501a","Type":"ContainerStarted","Data":"95152458cea362c6de8faea39be054f35ca57dc6a04f44ba9b2543f2dcad6bad"} Jun 08 13:16:34.036600 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:34.036552 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qq8j4" event={"ID":"2703338c-7e6d-444e-bf16-fb84cafd7eac","Type":"ContainerStarted","Data":"fe1e46598b48eca3663492237b9765e3ca46884948542b61f4ea265acd082e4b"} Jun 08 13:16:36.047995 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:36.047956 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-h95rl" event={"ID":"598fc797-c404-459d-b8f7-682c4d83501a","Type":"ContainerStarted","Data":"211878c19ed19a518dd2a82e620e6fd869eb2e29b0b60e52b0d212869785a8c4"} Jun 08 13:16:36.048457 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:36.048053 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-h95rl" Jun 08 13:16:36.049470 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:36.049446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7c6c859784-qq8j4" event={"ID":"2703338c-7e6d-444e-bf16-fb84cafd7eac","Type":"ContainerStarted","Data":"da8fd9b9857ba5987fa40e609405bdc174dad6bea56e51ec9e8f5f7d85e32bac"} Jun 08 13:16:36.049614 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:36.049594 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7c6c859784-qq8j4" Jun 08 13:16:36.050812 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:36.050793 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-844b6c964f-7l4mj" event={"ID":"c3a28e1a-cc40-4e52-b38a-a3000d751ad0","Type":"ContainerStarted","Data":"abb729ec6750de4a955f53ffb963c6f9d9025c245ca19ba7ad027065f2407069"} Jun 08 13:16:36.050941 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:36.050928 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-844b6c964f-7l4mj" Jun 08 13:16:36.068960 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:36.068896 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-h95rl" podStartSLOduration=1.310685581 podStartE2EDuration="4.068880557s" totalImagesPullingTime="2.758194976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:16:36.068466869 +0000 UTC m=+915.037766401" watchObservedRunningTime="2026-06-08 13:16:36.068880557 +0000 UTC m=+915.038180087" Jun 08 13:16:36.085280 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:36.085231 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-844b6c964f-7l4mj" podStartSLOduration=2.182612456 podStartE2EDuration="5.085216075s" totalImagesPullingTime="2.902603619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:16:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:16:36.084858038 +0000 UTC m=+915.054157570" watchObservedRunningTime="2026-06-08 13:16:36.085216075 +0000 UTC m=+915.054515605" Jun 08 13:16:36.103321 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:36.103260 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7c6c859784-qq8j4" podStartSLOduration=1.483855146 podStartE2EDuration="4.103242174s" totalImagesPullingTime="2.619387028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:16:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:16:36.100803883 +0000 UTC m=+915.070103441" watchObservedRunningTime="2026-06-08 13:16:36.103242174 +0000 UTC m=+915.072541705" Jun 08 13:16:42.061871 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:42.061844 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-844b6c964f-7l4mj" Jun 08 13:16:43.876376 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:43.876343 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:16:43.876779 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:43.876579 2563 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" containerID="cri-o://a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8" gracePeriod=30 Jun 08 13:16:45.520669 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:45.520642 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:45.676372 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:45.676339 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdcvn\" (UniqueName: \"kubernetes.io/projected/17b31e20-ea56-4be6-9ea3-0842eb4ec2e4-kube-api-access-jdcvn\") pod \"17b31e20-ea56-4be6-9ea3-0842eb4ec2e4\" (UID: \"17b31e20-ea56-4be6-9ea3-0842eb4ec2e4\") " Jun 08 13:16:45.678549 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:45.678515 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17b31e20-ea56-4be6-9ea3-0842eb4ec2e4-kube-api-access-jdcvn" (OuterVolumeSpecName: "kube-api-access-jdcvn") pod "17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" (UID: "17b31e20-ea56-4be6-9ea3-0842eb4ec2e4"). InnerVolumeSpecName "kube-api-access-jdcvn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 08 13:16:45.777376 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:45.777339 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdcvn\" (UniqueName: \"kubernetes.io/projected/17b31e20-ea56-4be6-9ea3-0842eb4ec2e4-kube-api-access-jdcvn\") on node \"ip-10-0-128-189.ec2.internal\" DevicePath \"\"" Jun 08 13:16:46.100900 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.100810 2563 generic.go:356] "Generic (PLEG): container finished" podID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerID="a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8" exitCode=143 Jun 08 13:16:46.100900 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.100860 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:46.100900 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.100892 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"17b31e20-ea56-4be6-9ea3-0842eb4ec2e4","Type":"ContainerDied","Data":"a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8"} Jun 08 13:16:46.101111 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.100934 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"17b31e20-ea56-4be6-9ea3-0842eb4ec2e4","Type":"ContainerDied","Data":"39c6e20033957345feae4e5d3f5707740dc02de1fbc7a5b48e0368994f29cb6e"} Jun 08 13:16:46.101111 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.100956 2563 scope.go:117] "RemoveContainer" containerID="a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8" Jun 08 13:16:46.110769 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.110751 2563 scope.go:117] "RemoveContainer" containerID="a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8" Jun 08 13:16:46.111074 ip-10-0-128-189 kubenswrapper[2563]: E0608 13:16:46.111053 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8\": container with ID starting with a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8 not found: ID does not exist" containerID="a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8" Jun 08 13:16:46.111140 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.111082 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8"} err="failed to get container status \"a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8\": rpc error: code = NotFound desc = could not find container \"a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8\": container with ID starting with a7bca75c5207e8405f13083e1f4227102cc3a0c20a28653160a7442ae6ee78f8 not found: ID does not exist" Jun 08 13:16:46.124583 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.124541 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:16:46.130501 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.130477 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:16:46.156706 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.156680 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:16:46.157029 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.157017 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" Jun 08 13:16:46.157079 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.157031 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" Jun 08 13:16:46.157117 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.157093 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" containerName="keycloak" Jun 08 13:16:46.161306 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.161289 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:46.167855 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.163999 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tfn46\"" Jun 08 13:16:46.167855 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.164185 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 08 13:16:46.167855 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.164284 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 08 13:16:46.167855 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.164191 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 08 13:16:46.167855 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.164643 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 08 13:16:46.171454 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.171428 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:16:46.281114 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.281074 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/15b5b5b5-a1a1-4ae6-a27b-c07054b7b317-test-realms\") pod \"maas-keycloak-0\" (UID: \"15b5b5b5-a1a1-4ae6-a27b-c07054b7b317\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:46.281301 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.281196 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn2ws\" (UniqueName: \"kubernetes.io/projected/15b5b5b5-a1a1-4ae6-a27b-c07054b7b317-kube-api-access-dn2ws\") pod \"maas-keycloak-0\" (UID: \"15b5b5b5-a1a1-4ae6-a27b-c07054b7b317\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:46.382514 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.382478 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn2ws\" (UniqueName: \"kubernetes.io/projected/15b5b5b5-a1a1-4ae6-a27b-c07054b7b317-kube-api-access-dn2ws\") pod \"maas-keycloak-0\" (UID: \"15b5b5b5-a1a1-4ae6-a27b-c07054b7b317\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:46.382695 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.382533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/15b5b5b5-a1a1-4ae6-a27b-c07054b7b317-test-realms\") pod \"maas-keycloak-0\" (UID: \"15b5b5b5-a1a1-4ae6-a27b-c07054b7b317\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:46.383263 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.383242 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/15b5b5b5-a1a1-4ae6-a27b-c07054b7b317-test-realms\") pod \"maas-keycloak-0\" (UID: \"15b5b5b5-a1a1-4ae6-a27b-c07054b7b317\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:46.391661 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.391629 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn2ws\" (UniqueName: \"kubernetes.io/projected/15b5b5b5-a1a1-4ae6-a27b-c07054b7b317-kube-api-access-dn2ws\") pod \"maas-keycloak-0\" (UID: \"15b5b5b5-a1a1-4ae6-a27b-c07054b7b317\") " pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:46.478155 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.478111 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:46.610603 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:46.610578 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 08 13:16:46.613158 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:16:46.613130 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15b5b5b5_a1a1_4ae6_a27b_c07054b7b317.slice/crio-a9ff62a4fc1d9dd55b0b2a4e3db15064c50d2b1d8342fb9a64735d12d5cb5a81 WatchSource:0}: Error finding container a9ff62a4fc1d9dd55b0b2a4e3db15064c50d2b1d8342fb9a64735d12d5cb5a81: Status 404 returned error can't find the container with id a9ff62a4fc1d9dd55b0b2a4e3db15064c50d2b1d8342fb9a64735d12d5cb5a81 Jun 08 13:16:47.058676 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:47.058634 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-67d7689b65-h95rl" podUID="598fc797-c404-459d-b8f7-682c4d83501a" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.29:9004: connect: connection refused" Jun 08 13:16:47.059138 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:47.059117 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7c6c859784-qq8j4" Jun 08 13:16:47.108853 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:47.108821 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"15b5b5b5-a1a1-4ae6-a27b-c07054b7b317","Type":"ContainerStarted","Data":"d6978dd54d20cc8b7a10b019bfb7bd478cea5300452dd6df01f18542bac9e2dc"} Jun 08 13:16:47.109052 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:47.108870 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"15b5b5b5-a1a1-4ae6-a27b-c07054b7b317","Type":"ContainerStarted","Data":"a9ff62a4fc1d9dd55b0b2a4e3db15064c50d2b1d8342fb9a64735d12d5cb5a81"} Jun 08 13:16:47.159605 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:47.159522 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.831482269 podStartE2EDuration="1.159497595s" totalImagesPullingTime="328.015326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:16:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:16:47.155081187 +0000 UTC m=+926.124380719" watchObservedRunningTime="2026-06-08 13:16:47.159497595 +0000 UTC m=+926.128797127" Jun 08 13:16:47.479103 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:47.479056 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:47.480793 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:47.480751 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:47.515739 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:47.515702 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17b31e20-ea56-4be6-9ea3-0842eb4ec2e4" path="/var/lib/kubelet/pods/17b31e20-ea56-4be6-9ea3-0842eb4ec2e4/volumes" Jun 08 13:16:48.479034 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:48.478987 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:49.478580 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:49.478526 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:50.479365 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:50.479312 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:51.479432 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:51.479385 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:52.479157 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:52.479082 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:53.479190 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:53.479132 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:54.478990 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:54.478941 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:55.479278 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:55.479218 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:56.478535 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:56.478489 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:16:56.479087 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:56.479046 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:57.058064 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:57.058018 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-h95rl" Jun 08 13:16:57.479048 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:57.478998 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:58.479586 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:58.479517 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:16:59.478957 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:16:59.478915 2563 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.31:9000/health/started\": dial tcp 10.133.0.31:9000: connect: connection refused" Jun 08 13:17:00.571952 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:00.571896 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 08 13:17:00.586990 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:00.586932 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="15b5b5b5-a1a1-4ae6-a27b-c07054b7b317" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 08 13:17:10.577923 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:10.577886 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 08 13:17:31.659852 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.659814 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk"] Jun 08 13:17:31.664749 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.664728 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.667267 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.667241 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 08 13:17:31.668159 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.668137 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 08 13:17:31.668257 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.668138 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-46d5k\"" Jun 08 13:17:31.668257 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.668149 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 08 13:17:31.675299 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.675272 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk"] Jun 08 13:17:31.797442 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.797406 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.797628 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.797475 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.797628 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.797509 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.797628 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.797530 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.797743 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.797624 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1acc4598-80e2-4ab6-8703-3f48cace89ed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.797743 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.797650 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkvj4\" (UniqueName: \"kubernetes.io/projected/1acc4598-80e2-4ab6-8703-3f48cace89ed-kube-api-access-rkvj4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.898392 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.898355 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.898392 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.898395 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.898662 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.898415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.898662 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.898438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1acc4598-80e2-4ab6-8703-3f48cace89ed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.898662 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.898463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkvj4\" (UniqueName: \"kubernetes.io/projected/1acc4598-80e2-4ab6-8703-3f48cace89ed-kube-api-access-rkvj4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.898662 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.898523 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.898873 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.898849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.898975 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.898913 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.898975 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.898952 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.900707 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.900691 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1acc4598-80e2-4ab6-8703-3f48cace89ed-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.901034 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.901017 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1acc4598-80e2-4ab6-8703-3f48cace89ed-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.908645 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.908625 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkvj4\" (UniqueName: \"kubernetes.io/projected/1acc4598-80e2-4ab6-8703-3f48cace89ed-kube-api-access-rkvj4\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk\" (UID: \"1acc4598-80e2-4ab6-8703-3f48cace89ed\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:31.976821 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:31.976726 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:17:32.123978 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:32.123952 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk"] Jun 08 13:17:32.126628 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:17:32.126557 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1acc4598_80e2_4ab6_8703_3f48cace89ed.slice/crio-2992e0d343ec8252862e87c2e08b5caacc99558ce52d077578c992fb2b1d5f0c WatchSource:0}: Error finding container 2992e0d343ec8252862e87c2e08b5caacc99558ce52d077578c992fb2b1d5f0c: Status 404 returned error can't find the container with id 2992e0d343ec8252862e87c2e08b5caacc99558ce52d077578c992fb2b1d5f0c Jun 08 13:17:32.379912 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:32.379877 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" event={"ID":"1acc4598-80e2-4ab6-8703-3f48cace89ed","Type":"ContainerStarted","Data":"2992e0d343ec8252862e87c2e08b5caacc99558ce52d077578c992fb2b1d5f0c"} Jun 08 13:17:37.410656 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:37.410611 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" event={"ID":"1acc4598-80e2-4ab6-8703-3f48cace89ed","Type":"ContainerStarted","Data":"602fe964795fdd0880d3b34e22e7e288695d436a89b25b026dfd7f410ab9cceb"} Jun 08 13:17:46.360929 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.360850 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6"] Jun 08 13:17:46.365148 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.365125 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.367748 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.367728 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 08 13:17:46.375901 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.375880 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6"] Jun 08 13:17:46.423212 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.423176 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.423391 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.423217 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.423391 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.423250 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-457vv\" (UniqueName: \"kubernetes.io/projected/f52e74c3-7072-4faa-aac8-63841c62dd38-kube-api-access-457vv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.423391 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.423313 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f52e74c3-7072-4faa-aac8-63841c62dd38-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.423391 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.423335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.423391 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.423351 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.524259 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.524223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.524451 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.524269 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-457vv\" (UniqueName: \"kubernetes.io/projected/f52e74c3-7072-4faa-aac8-63841c62dd38-kube-api-access-457vv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.524451 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.524321 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f52e74c3-7072-4faa-aac8-63841c62dd38-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.524451 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.524339 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.524451 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.524356 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.524451 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.524412 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.524944 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.524920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.525035 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.524996 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.525035 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.525016 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.526992 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.526963 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f52e74c3-7072-4faa-aac8-63841c62dd38-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.527110 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.527048 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f52e74c3-7072-4faa-aac8-63841c62dd38-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.531903 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.531866 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-457vv\" (UniqueName: \"kubernetes.io/projected/f52e74c3-7072-4faa-aac8-63841c62dd38-kube-api-access-457vv\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-kbvk6\" (UID: \"f52e74c3-7072-4faa-aac8-63841c62dd38\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.677069 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.676986 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:46.829258 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:46.829235 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6"] Jun 08 13:17:46.831622 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:17:46.831594 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52e74c3_7072_4faa_aac8_63841c62dd38.slice/crio-afd8b1345f1e30ea3acab779b6fbe7eb0ec69f2171bb7c4f658a4137f8a93b10 WatchSource:0}: Error finding container afd8b1345f1e30ea3acab779b6fbe7eb0ec69f2171bb7c4f658a4137f8a93b10: Status 404 returned error can't find the container with id afd8b1345f1e30ea3acab779b6fbe7eb0ec69f2171bb7c4f658a4137f8a93b10 Jun 08 13:17:47.461968 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:47.461922 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" event={"ID":"f52e74c3-7072-4faa-aac8-63841c62dd38","Type":"ContainerStarted","Data":"8aa6e6aedab1e92324d8d6c52e5dccf08b18a3d4c193a171642a099dce1426c0"} Jun 08 13:17:47.462627 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:47.462593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" event={"ID":"f52e74c3-7072-4faa-aac8-63841c62dd38","Type":"ContainerStarted","Data":"afd8b1345f1e30ea3acab779b6fbe7eb0ec69f2171bb7c4f658a4137f8a93b10"} Jun 08 13:17:49.473294 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:49.473258 2563 generic.go:356] "Generic (PLEG): container finished" podID="f52e74c3-7072-4faa-aac8-63841c62dd38" containerID="8aa6e6aedab1e92324d8d6c52e5dccf08b18a3d4c193a171642a099dce1426c0" exitCode=0 Jun 08 13:17:49.473724 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:49.473330 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" event={"ID":"f52e74c3-7072-4faa-aac8-63841c62dd38","Type":"ContainerDied","Data":"8aa6e6aedab1e92324d8d6c52e5dccf08b18a3d4c193a171642a099dce1426c0"} Jun 08 13:17:51.486311 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:51.486270 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" event={"ID":"f52e74c3-7072-4faa-aac8-63841c62dd38","Type":"ContainerStarted","Data":"13ea5283a0b82b09d714289280e1f4636da5b92a136a6583d6e1ce0b3031622e"} Jun 08 13:17:51.487697 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:51.487674 2563 generic.go:356] "Generic (PLEG): container finished" podID="1acc4598-80e2-4ab6-8703-3f48cace89ed" containerID="602fe964795fdd0880d3b34e22e7e288695d436a89b25b026dfd7f410ab9cceb" exitCode=0 Jun 08 13:17:51.487823 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:51.487742 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" event={"ID":"1acc4598-80e2-4ab6-8703-3f48cace89ed","Type":"ContainerDied","Data":"602fe964795fdd0880d3b34e22e7e288695d436a89b25b026dfd7f410ab9cceb"} Jun 08 13:17:51.509713 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:51.509652 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" podStartSLOduration=2.628128557 podStartE2EDuration="5.509631663s" totalImagesPullingTime="1.296691524s" totalInitContainerRuntime="1.584811582s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:17:51.508083047 +0000 UTC m=+990.477382571" watchObservedRunningTime="2026-06-08 13:17:51.509631663 +0000 UTC m=+990.478931196" Jun 08 13:17:52.494524 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:52.494488 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" event={"ID":"1acc4598-80e2-4ab6-8703-3f48cace89ed","Type":"ContainerStarted","Data":"3fe7519e8bb3f722dfa660c69b63fd4af34d1400dda6cb8df49db7351ca1eb90"} Jun 08 13:17:52.515923 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:52.515863 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" podStartSLOduration=2.725208463 podStartE2EDuration="21.515846511s" totalImagesPullingTime="4.552694671s" totalInitContainerRuntime="14.237943377s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:17:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:17:52.513811318 +0000 UTC m=+991.483110851" watchObservedRunningTime="2026-06-08 13:17:52.515846511 +0000 UTC m=+991.485146041" Jun 08 13:17:56.677403 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:56.677365 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:56.677819 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:56.677444 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:56.690022 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:56.689997 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:17:57.528585 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:17:57.528546 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-kbvk6" Jun 08 13:18:01.976984 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:01.976943 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:18:01.977412 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:01.977011 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:18:01.989446 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:01.989414 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:18:02.551385 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:02.551357 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk" Jun 08 13:18:04.069021 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.068983 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl"] Jun 08 13:18:04.086541 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.086499 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl"] Jun 08 13:18:04.086714 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.086670 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.089391 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.089367 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 08 13:18:04.182481 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.182438 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.182706 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.182493 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.182706 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.182526 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.182706 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.182553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxdbq\" (UniqueName: \"kubernetes.io/projected/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-kube-api-access-nxdbq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.182706 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.182660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.182706 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.182701 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.283836 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.283800 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.283836 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.283840 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.284055 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.283875 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxdbq\" (UniqueName: \"kubernetes.io/projected/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-kube-api-access-nxdbq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.284055 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.283949 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.284055 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.283996 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.284055 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.284041 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.284284 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.284234 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.284284 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.284274 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.284364 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.284325 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.286367 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.286343 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.286533 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.286515 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.296620 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.296599 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxdbq\" (UniqueName: \"kubernetes.io/projected/3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d-kube-api-access-nxdbq\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl\" (UID: \"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.398304 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.398266 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:04.538799 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.538776 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl"] Jun 08 13:18:04.540801 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:18:04.540763 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d0ab98a_2e80_48f6_bbaa_f5c16d970b5d.slice/crio-5b930bd7b011da2e6eaf772decdabba1e79cd7125ce545562564e9a7f44e8fbc WatchSource:0}: Error finding container 5b930bd7b011da2e6eaf772decdabba1e79cd7125ce545562564e9a7f44e8fbc: Status 404 returned error can't find the container with id 5b930bd7b011da2e6eaf772decdabba1e79cd7125ce545562564e9a7f44e8fbc Jun 08 13:18:04.550728 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:04.550698 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" event={"ID":"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d","Type":"ContainerStarted","Data":"5b930bd7b011da2e6eaf772decdabba1e79cd7125ce545562564e9a7f44e8fbc"} Jun 08 13:18:05.556800 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:05.556748 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" event={"ID":"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d","Type":"ContainerStarted","Data":"f181e466f072408066ca75090696fcd4fe76b8f320a89fa9a333953bd91c2e47"} Jun 08 13:18:06.563275 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:06.563242 2563 generic.go:356] "Generic (PLEG): container finished" podID="3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d" containerID="f181e466f072408066ca75090696fcd4fe76b8f320a89fa9a333953bd91c2e47" exitCode=0 Jun 08 13:18:06.563704 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:06.563326 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" event={"ID":"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d","Type":"ContainerDied","Data":"f181e466f072408066ca75090696fcd4fe76b8f320a89fa9a333953bd91c2e47"} Jun 08 13:18:11.588474 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:11.588433 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" event={"ID":"3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d","Type":"ContainerStarted","Data":"5315c8347b5f9029b4c3647da915e975f16b3d59b216ee209f72053c1d8f2e6e"} Jun 08 13:18:11.609507 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:11.609449 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" podStartSLOduration=1.835102366 podStartE2EDuration="7.609431617s" totalImagesPullingTime="4.468999713s" totalInitContainerRuntime="1.305329538s" isStatefulPod=false podCreationTimestamp="2026-06-08 13:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:18:11.608113642 +0000 UTC m=+1010.577413175" watchObservedRunningTime="2026-06-08 13:18:11.609431617 +0000 UTC m=+1010.578731147" Jun 08 13:18:14.398999 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:14.398952 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:14.399435 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:14.399073 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:14.411783 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:14.411752 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:18:14.614674 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:18:14.614648 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl" Jun 08 13:21:26.037596 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:21:26.037472 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:21:26.041597 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:21:26.039535 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:26:26.065508 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:26:26.065395 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:26:26.069462 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:26:26.069170 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:31:26.097265 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:31:26.097157 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:31:26.103822 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:31:26.101671 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:36:26.126601 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:36:26.126556 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:36:26.131948 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:36:26.131925 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:41:26.155805 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:41:26.155701 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:41:26.162402 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:41:26.162382 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mgn84_0e52b7d1-3feb-43f7-b83e-37a3ed9500c9/ovn-acl-logging/0.log" Jun 08 13:43:17.471859 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:17.471779 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7bc4849f48-df7p6_00d793dd-7e1f-48d2-a2f8-6512fffc2117/nginx/0.log" Jun 08 13:43:17.694393 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:17.694365 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-wl4hl_c1c849fd-d492-47c9-b834-93884502bc21/manager/0.log" Jun 08 13:43:17.808168 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:17.808096 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-l679z_b392d6cf-cd89-43a4-8cff-f6137e4dd435/manager/0.log" Jun 08 13:43:17.929840 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:17.929812 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-844b6c964f-7l4mj_c3a28e1a-cc40-4e52-b38a-a3000d751ad0/maas-api/0.log" Jun 08 13:43:18.409336 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:18.409303 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-dzrxg_bc2d943d-342c-474b-a9d5-3d4c495f1dfc/manager/0.log" Jun 08 13:43:18.528067 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:18.528040 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-4z6p8_fc6077e4-2bb1-42f6-84ff-443e50317735/copy-manifests/0.log" Jun 08 13:43:18.541888 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:18.541855 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-4z6p8_fc6077e4-2bb1-42f6-84ff-443e50317735/manager/0.log" Jun 08 13:43:18.905871 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:18.905841 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-tm5t8_2b4f2629-fe32-41e8-9522-ab846fac2d48/postgres/0.log" Jun 08 13:43:20.368134 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:20.368091 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2x967_217f082f-5544-4ea3-8a22-07e6e8f6df74/manager/0.log" Jun 08 13:43:21.586137 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:21.586107 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-wt58c_b9798dc0-f33a-402f-9f58-c6b1c66c2596/discovery/0.log" Jun 08 13:43:21.695466 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:21.695437 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cd48f9f86-lgfjd_4c8fe8dd-2f4d-4d8e-88e2-157189c2161d/kube-auth-proxy/0.log" Jun 08 13:43:22.043578 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:22.043539 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-h95rl_598fc797-c404-459d-b8f7-682c4d83501a/payload-pre-processing/0.log" Jun 08 13:43:22.184398 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:22.184369 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qq8j4_2703338c-7e6d-444e-bf16-fb84cafd7eac/payload-processing/0.log" Jun 08 13:43:22.657580 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:22.657533 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk_1acc4598-80e2-4ab6-8703-3f48cace89ed/storage-initializer/0.log" Jun 08 13:43:22.665084 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:22.665063 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-ws4bk_1acc4598-80e2-4ab6-8703-3f48cace89ed/main/0.log" Jun 08 13:43:22.778307 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:22.778260 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-kbvk6_f52e74c3-7072-4faa-aac8-63841c62dd38/storage-initializer/0.log" Jun 08 13:43:22.786011 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:22.785989 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-kbvk6_f52e74c3-7072-4faa-aac8-63841c62dd38/main/0.log" Jun 08 13:43:23.035735 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:23.035649 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl_3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d/storage-initializer/0.log" Jun 08 13:43:23.042901 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:23.042861 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cxvrrl_3d0ab98a-2e80-48f6-bbaa-f5c16d970b5d/main/0.log" Jun 08 13:43:30.311164 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:30.311135 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b4rvp_d3a8dcb3-1700-4cc9-a515-fcf7ac698a48/global-pull-secret-syncer/0.log" Jun 08 13:43:30.467322 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:30.467290 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-thf4s_5da6b63f-b154-4354-850a-76474e8a26c9/konnectivity-agent/0.log" Jun 08 13:43:30.489224 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:30.489172 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-189.ec2.internal_9319054885e1e5afa5f2ef4b4f79adf8/haproxy/0.log" Jun 08 13:43:33.499089 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:33.499060 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-8xskd_0a37e5e3-fd50-4962-9f77-f2714a91eef8/sail-operator/0.log" Jun 08 13:43:35.229875 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:35.229842 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2x967_217f082f-5544-4ea3-8a22-07e6e8f6df74/manager/0.log" Jun 08 13:43:37.744212 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:37.744167 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbq6m_011db15e-ae01-4064-a29e-fbc1b83cf6ee/node-exporter/0.log" Jun 08 13:43:37.782588 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:37.782530 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbq6m_011db15e-ae01-4064-a29e-fbc1b83cf6ee/kube-rbac-proxy/0.log" Jun 08 13:43:37.819600 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:37.819552 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-zbq6m_011db15e-ae01-4064-a29e-fbc1b83cf6ee/init-textfile/0.log" Jun 08 13:43:38.384095 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:38.384051 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xfgv2_fd0a7c16-f310-49cf-80fa-f90fbdbe1c23/prometheus-operator/0.log" Jun 08 13:43:38.425304 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:38.425193 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xfgv2_fd0a7c16-f310-49cf-80fa-f90fbdbe1c23/kube-rbac-proxy/0.log" Jun 08 13:43:38.459728 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:38.459704 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-qkljr_97355ff4-2350-4e8c-b163-9f2a99594b31/prometheus-operator-admission-webhook/0.log" Jun 08 13:43:38.596356 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:38.596320 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64ff47f944-xw6j6_805c378e-3574-4769-a3c3-01c6ef2f60c0/thanos-query/0.log" Jun 08 13:43:38.629633 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:38.629605 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64ff47f944-xw6j6_805c378e-3574-4769-a3c3-01c6ef2f60c0/kube-rbac-proxy-web/0.log" Jun 08 13:43:38.673763 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:38.673710 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64ff47f944-xw6j6_805c378e-3574-4769-a3c3-01c6ef2f60c0/kube-rbac-proxy/0.log" Jun 08 13:43:38.714322 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:38.714246 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64ff47f944-xw6j6_805c378e-3574-4769-a3c3-01c6ef2f60c0/prom-label-proxy/0.log" Jun 08 13:43:38.749806 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:38.749782 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64ff47f944-xw6j6_805c378e-3574-4769-a3c3-01c6ef2f60c0/kube-rbac-proxy-rules/0.log" Jun 08 13:43:38.796793 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:38.796748 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-64ff47f944-xw6j6_805c378e-3574-4769-a3c3-01c6ef2f60c0/kube-rbac-proxy-metrics/0.log" Jun 08 13:43:41.517936 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:41.517905 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-vjz6f_25da9b0a-2924-4175-b5b6-7d1561814e6e/download-server/0.log" Jun 08 13:43:41.940222 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:41.940188 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt"] Jun 08 13:43:41.943641 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:41.943619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:41.947471 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:41.947448 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flk4d\"/\"kube-root-ca.crt\"" Jun 08 13:43:41.948290 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:41.948272 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-flk4d\"/\"default-dockercfg-mqgqd\"" Jun 08 13:43:41.948386 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:41.948295 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-flk4d\"/\"openshift-service-ca.crt\"" Jun 08 13:43:41.954510 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:41.954483 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt"] Jun 08 13:43:42.044992 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.044959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-proc\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.045172 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.045017 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25m69\" (UniqueName: \"kubernetes.io/projected/9001fab4-5948-4de8-86f6-f782a49c96f6-kube-api-access-25m69\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.045172 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.045046 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-lib-modules\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.045172 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.045117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-podres\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.045172 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.045143 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-sys\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.146433 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.146400 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-proc\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.146650 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.146447 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25m69\" (UniqueName: \"kubernetes.io/projected/9001fab4-5948-4de8-86f6-f782a49c96f6-kube-api-access-25m69\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.146650 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.146469 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-lib-modules\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.146650 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.146502 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-podres\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.146650 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.146519 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-sys\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.146650 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.146534 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-proc\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.146650 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.146639 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-sys\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.146918 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.146665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-podres\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.146918 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.146669 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9001fab4-5948-4de8-86f6-f782a49c96f6-lib-modules\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.155705 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.155682 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-25m69\" (UniqueName: \"kubernetes.io/projected/9001fab4-5948-4de8-86f6-f782a49c96f6-kube-api-access-25m69\") pod \"perf-node-gather-daemonset-np5nt\" (UID: \"9001fab4-5948-4de8-86f6-f782a49c96f6\") " pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.253894 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.253812 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:42.391777 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:42.391752 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt"] Jun 08 13:43:42.394479 ip-10-0-128-189 kubenswrapper[2563]: W0608 13:43:42.394443 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9001fab4_5948_4de8_86f6_f782a49c96f6.slice/crio-4d33119206898684485b74443cf5ad935dfb474abbe1706bebce56a61d499f4b WatchSource:0}: Error finding container 4d33119206898684485b74443cf5ad935dfb474abbe1706bebce56a61d499f4b: Status 404 returned error can't find the container with id 4d33119206898684485b74443cf5ad935dfb474abbe1706bebce56a61d499f4b Jun 08 13:43:43.039113 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:43.039079 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" event={"ID":"9001fab4-5948-4de8-86f6-f782a49c96f6","Type":"ContainerStarted","Data":"638fd8617f126cb4b4dc668651c9a7979535276d9885d9a8def864613b2a98b8"} Jun 08 13:43:43.039500 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:43.039129 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" event={"ID":"9001fab4-5948-4de8-86f6-f782a49c96f6","Type":"ContainerStarted","Data":"4d33119206898684485b74443cf5ad935dfb474abbe1706bebce56a61d499f4b"} Jun 08 13:43:43.039500 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:43.039160 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:43.057779 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:43.057734 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" podStartSLOduration=2.057716216 podStartE2EDuration="2.057716216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-08 13:43:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-08 13:43:43.055473161 +0000 UTC m=+2542.024772695" watchObservedRunningTime="2026-06-08 13:43:43.057716216 +0000 UTC m=+2542.027015749" Jun 08 13:43:43.490266 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:43.490237 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pw4f9_52584272-7c62-4cfc-8430-f6556b92a686/dns/0.log" Jun 08 13:43:43.514529 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:43.514503 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-pw4f9_52584272-7c62-4cfc-8430-f6556b92a686/kube-rbac-proxy/0.log" Jun 08 13:43:43.658389 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:43.658366 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qwjck_919f32d7-40ac-4223-a344-c3194fdcceac/dns-node-resolver/0.log" Jun 08 13:43:44.267804 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:44.267778 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wk4st_2e04f1b8-a81d-4bfa-87ef-91242730bb29/node-ca/0.log" Jun 08 13:43:45.397830 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:45.397796 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-wt58c_b9798dc0-f33a-402f-9f58-c6b1c66c2596/discovery/0.log" Jun 08 13:43:45.423419 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:45.423388 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cd48f9f86-lgfjd_4c8fe8dd-2f4d-4d8e-88e2-157189c2161d/kube-auth-proxy/0.log" Jun 08 13:43:45.559778 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:45.559740 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-h95rl_598fc797-c404-459d-b8f7-682c4d83501a/payload-pre-processing/0.log" Jun 08 13:43:45.629758 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:45.629714 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qq8j4_2703338c-7e6d-444e-bf16-fb84cafd7eac/payload-processing/0.log" Jun 08 13:43:46.322535 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:46.322502 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-h8d68_d3019b3f-b998-4ff6-a9db-23882da23487/serve-healthcheck-canary/0.log" Jun 08 13:43:46.907588 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:46.907525 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qjhd_43306606-03c4-42f2-84f1-809f998eb0cd/kube-rbac-proxy/0.log" Jun 08 13:43:46.933955 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:46.933924 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qjhd_43306606-03c4-42f2-84f1-809f998eb0cd/exporter/0.log" Jun 08 13:43:46.959084 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:46.959058 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2qjhd_43306606-03c4-42f2-84f1-809f998eb0cd/extractor/0.log" Jun 08 13:43:49.054329 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:49.054296 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-flk4d/perf-node-gather-daemonset-np5nt" Jun 08 13:43:49.418479 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:49.418446 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-7bc4849f48-df7p6_00d793dd-7e1f-48d2-a2f8-6512fffc2117/nginx/0.log" Jun 08 13:43:49.484521 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:49.484491 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-wl4hl_c1c849fd-d492-47c9-b834-93884502bc21/manager/0.log" Jun 08 13:43:49.576814 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:49.576783 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-l679z_b392d6cf-cd89-43a4-8cff-f6137e4dd435/manager/0.log" Jun 08 13:43:49.625799 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:49.625770 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-844b6c964f-7l4mj_c3a28e1a-cc40-4e52-b38a-a3000d751ad0/maas-api/0.log" Jun 08 13:43:49.852815 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:49.852735 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-dzrxg_bc2d943d-342c-474b-a9d5-3d4c495f1dfc/manager/0.log" Jun 08 13:43:49.950605 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:49.950552 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-4z6p8_fc6077e4-2bb1-42f6-84ff-443e50317735/manager/0.log" Jun 08 13:43:49.970257 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:49.970231 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-677cd7f45-4z6p8_fc6077e4-2bb1-42f6-84ff-443e50317735/copy-manifests/0.log" Jun 08 13:43:50.116139 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:50.116115 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-tm5t8_2b4f2629-fe32-41e8-9522-ab846fac2d48/postgres/0.log" Jun 08 13:43:51.939143 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:51.939110 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-csqkw_e60597eb-5ca5-48a3-a6d5-fb1613f23c19/openshift-lws-operator/0.log" Jun 08 13:43:55.094275 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:55.094207 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-wt58c_b9798dc0-f33a-402f-9f58-c6b1c66c2596/discovery/0.log" Jun 08 13:43:55.107031 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:55.107002 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cd48f9f86-lgfjd_4c8fe8dd-2f4d-4d8e-88e2-157189c2161d/kube-auth-proxy/0.log" Jun 08 13:43:55.224367 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:55.224330 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-h95rl_598fc797-c404-459d-b8f7-682c4d83501a/payload-pre-processing/0.log" Jun 08 13:43:55.276623 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:55.276591 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qq8j4_2703338c-7e6d-444e-bf16-fb84cafd7eac/payload-processing/0.log" Jun 08 13:43:56.480627 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:56.480597 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-wt58c_b9798dc0-f33a-402f-9f58-c6b1c66c2596/discovery/0.log" Jun 08 13:43:56.492621 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:56.492586 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cd48f9f86-lgfjd_4c8fe8dd-2f4d-4d8e-88e2-157189c2161d/kube-auth-proxy/0.log" Jun 08 13:43:56.605478 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:56.605445 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-h95rl_598fc797-c404-459d-b8f7-682c4d83501a/payload-pre-processing/0.log" Jun 08 13:43:56.656304 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:56.656275 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qq8j4_2703338c-7e6d-444e-bf16-fb84cafd7eac/payload-processing/0.log" Jun 08 13:43:58.463684 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:58.463637 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-wt58c_b9798dc0-f33a-402f-9f58-c6b1c66c2596/discovery/0.log" Jun 08 13:43:58.473940 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:58.473920 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cd48f9f86-lgfjd_4c8fe8dd-2f4d-4d8e-88e2-157189c2161d/kube-auth-proxy/0.log" Jun 08 13:43:58.579897 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:58.579868 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-h95rl_598fc797-c404-459d-b8f7-682c4d83501a/payload-pre-processing/0.log" Jun 08 13:43:58.629350 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:58.629312 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7c6c859784-qq8j4_2703338c-7e6d-444e-bf16-fb84cafd7eac/payload-processing/0.log" Jun 08 13:43:59.286159 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:59.286126 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5897v_016b368d-b894-48ce-a6f5-f4bcb39d0a81/kube-multus/0.log" Jun 08 13:43:59.520757 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:59.520730 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqvxc_fdc26cc8-331e-4431-b20c-13d3b05a7f7a/kube-multus-additional-cni-plugins/0.log" Jun 08 13:43:59.547288 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:59.547214 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqvxc_fdc26cc8-331e-4431-b20c-13d3b05a7f7a/egress-router-binary-copy/0.log" Jun 08 13:43:59.573599 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:59.573555 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqvxc_fdc26cc8-331e-4431-b20c-13d3b05a7f7a/cni-plugins/0.log" Jun 08 13:43:59.599749 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:59.599717 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqvxc_fdc26cc8-331e-4431-b20c-13d3b05a7f7a/bond-cni-plugin/0.log" Jun 08 13:43:59.627380 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:59.627351 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqvxc_fdc26cc8-331e-4431-b20c-13d3b05a7f7a/routeoverride-cni/0.log" Jun 08 13:43:59.654497 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:59.654466 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqvxc_fdc26cc8-331e-4431-b20c-13d3b05a7f7a/whereabouts-cni-bincopy/0.log" Jun 08 13:43:59.678223 ip-10-0-128-189 kubenswrapper[2563]: I0608 13:43:59.678197 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wqvxc_fdc26cc8-331e-4431-b20c-13d3b05a7f7a/whereabouts-cni/0.log"