May 25 00:59:52.294804 ip-10-0-141-154 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory May 25 00:59:52.294915 ip-10-0-141-154 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory May 25 00:59:52.294989 ip-10-0-141-154 systemd[1]: kubelet.service: Failed with result 'resources'. May 25 00:59:52.295487 ip-10-0-141-154 systemd[1]: Failed to start Kubernetes Kubelet. May 25 01:00:02.312290 ip-10-0-141-154 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. May 25 01:00:02.312306 ip-10-0-141-154 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 78dcdbcbd6164ce2a95fb31af941b2df -- May 25 01:02:19.972731 ip-10-0-141-154 systemd[1]: Starting Kubernetes Kubelet... May 25 01:02:20.480852 ip-10-0-141-154 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 01:02:20.480852 ip-10-0-141-154 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 25 01:02:20.480852 ip-10-0-141-154 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 01:02:20.480852 ip-10-0-141-154 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 25 01:02:20.480852 ip-10-0-141-154 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 25 01:02:20.484296 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.484201 2563 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 25 01:02:20.487392 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487374 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 01:02:20.487392 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487393 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487396 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487399 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487402 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487406 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487410 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487413 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487415 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487418 2563 feature_gate.go:328] unrecognized feature gate: Example May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487421 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487424 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487427 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487430 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487446 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487450 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487453 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487455 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487464 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487467 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487471 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 01:02:20.487482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487475 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487478 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487481 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487484 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487487 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487490 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487493 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487496 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487499 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487502 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487505 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487507 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487509 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487512 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487515 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487517 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487520 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487522 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487525 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487528 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 01:02:20.487996 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487531 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487534 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487536 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487539 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487541 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487543 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487546 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487548 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487551 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487553 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487555 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487558 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487561 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487563 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487567 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487570 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487573 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487575 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487580 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 01:02:20.488516 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487584 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487587 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487590 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487593 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487595 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487598 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487601 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487603 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487606 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487609 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487611 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487614 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487617 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487620 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487622 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487624 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487627 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487629 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487632 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487634 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 01:02:20.488968 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487637 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487639 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487642 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487644 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487647 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.487649 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488064 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488070 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488073 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488076 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488078 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488081 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488083 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488086 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488089 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488091 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488094 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488097 2563 feature_gate.go:328] unrecognized feature gate: Example May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488100 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488103 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 01:02:20.489485 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488106 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488108 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488111 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488113 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488116 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488118 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488120 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488122 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488125 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488127 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488130 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488132 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488135 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488137 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488141 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488145 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488147 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488150 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488153 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 01:02:20.489973 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488177 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488181 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488184 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488187 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488190 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488192 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488195 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488198 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488200 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488205 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488207 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488210 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488213 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488215 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488218 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488220 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488222 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488225 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488227 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 01:02:20.490503 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488230 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488232 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488234 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488237 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488239 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488242 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488244 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488247 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488249 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488251 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488254 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488257 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488259 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488265 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488267 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488270 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488273 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488275 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488278 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488281 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 01:02:20.490975 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488283 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488286 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488288 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488290 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488293 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488295 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488298 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488301 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488303 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488305 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488308 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488311 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488315 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.488317 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489123 2563 flags.go:64] FLAG: --address="0.0.0.0" May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489138 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489146 2563 flags.go:64] FLAG: --anonymous-auth="true" May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489150 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489155 2563 flags.go:64] FLAG: --authentication-token-webhook="false" May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489159 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489163 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 25 01:02:20.491482 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489167 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489171 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489174 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489178 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489182 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489185 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489188 2563 flags.go:64] FLAG: --cgroup-root="" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489191 2563 flags.go:64] FLAG: --cgroups-per-qos="true" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489194 2563 flags.go:64] FLAG: --client-ca-file="" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489213 2563 flags.go:64] FLAG: --cloud-config="" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489217 2563 flags.go:64] FLAG: --cloud-provider="external" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489220 2563 flags.go:64] FLAG: --cluster-dns="[]" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489225 2563 flags.go:64] FLAG: --cluster-domain="" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489228 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489231 2563 flags.go:64] FLAG: --config-dir="" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489234 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489237 2563 flags.go:64] FLAG: --container-log-max-files="5" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489241 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489245 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489248 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489252 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489255 2563 flags.go:64] FLAG: --contention-profiling="false" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489258 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489261 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489264 2563 flags.go:64] FLAG: --cpu-manager-policy="none" May 25 01:02:20.491987 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489267 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489271 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489274 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489276 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489279 2563 flags.go:64] FLAG: --enable-load-reader="false" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489282 2563 flags.go:64] FLAG: --enable-server="true" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489285 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489290 2563 flags.go:64] FLAG: --event-burst="100" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489293 2563 flags.go:64] FLAG: --event-qps="50" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489296 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489299 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489303 2563 flags.go:64] FLAG: --eviction-hard="" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489307 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489310 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489313 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489316 2563 flags.go:64] FLAG: --eviction-soft="" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489320 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489322 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489325 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489328 2563 flags.go:64] FLAG: --experimental-mounter-path="" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489331 2563 flags.go:64] FLAG: --fail-cgroupv1="false" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489334 2563 flags.go:64] FLAG: --fail-swap-on="true" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489337 2563 flags.go:64] FLAG: --feature-gates="" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489341 2563 flags.go:64] FLAG: --file-check-frequency="20s" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489343 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 25 01:02:20.492588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489347 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489350 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489361 2563 flags.go:64] FLAG: --healthz-port="10248" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489365 2563 flags.go:64] FLAG: --help="false" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489368 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-141-154.ec2.internal" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489372 2563 flags.go:64] FLAG: --housekeeping-interval="10s" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489375 2563 flags.go:64] FLAG: --http-check-frequency="20s" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489378 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489381 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489385 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489387 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489390 2563 flags.go:64] FLAG: --image-service-endpoint="" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489393 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489396 2563 flags.go:64] FLAG: --kube-api-burst="100" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489399 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489402 2563 flags.go:64] FLAG: --kube-api-qps="50" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489405 2563 flags.go:64] FLAG: --kube-reserved="" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489408 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489411 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489414 2563 flags.go:64] FLAG: --kubelet-cgroups="" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489417 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489420 2563 flags.go:64] FLAG: --lock-file="" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489423 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489426 2563 flags.go:64] FLAG: --log-flush-frequency="5s" May 25 01:02:20.493259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489429 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489451 2563 flags.go:64] FLAG: --log-json-split-stream="false" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489454 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489457 2563 flags.go:64] FLAG: --log-text-split-stream="false" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489460 2563 flags.go:64] FLAG: --logging-format="text" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489463 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489467 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489470 2563 flags.go:64] FLAG: --manifest-url="" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489472 2563 flags.go:64] FLAG: --manifest-url-header="" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489477 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489481 2563 flags.go:64] FLAG: --max-open-files="1000000" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489485 2563 flags.go:64] FLAG: --max-pods="110" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489488 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489492 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489495 2563 flags.go:64] FLAG: --memory-manager-policy="None" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489498 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489501 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489504 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489507 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489515 2563 flags.go:64] FLAG: --node-status-max-images="50" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489518 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489522 2563 flags.go:64] FLAG: --oom-score-adj="-999" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489525 2563 flags.go:64] FLAG: --pod-cidr="" May 25 01:02:20.493870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489528 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489534 2563 flags.go:64] FLAG: --pod-manifest-path="" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489537 2563 flags.go:64] FLAG: --pod-max-pids="-1" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489541 2563 flags.go:64] FLAG: --pods-per-core="0" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489543 2563 flags.go:64] FLAG: --port="10250" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489547 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489551 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-005b16a58312aa0f9" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489554 2563 flags.go:64] FLAG: --qos-reserved="" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489557 2563 flags.go:64] FLAG: --read-only-port="10255" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489560 2563 flags.go:64] FLAG: --register-node="true" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489563 2563 flags.go:64] FLAG: --register-schedulable="true" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489566 2563 flags.go:64] FLAG: --register-with-taints="" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489569 2563 flags.go:64] FLAG: --registry-burst="10" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489572 2563 flags.go:64] FLAG: --registry-qps="5" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489575 2563 flags.go:64] FLAG: --reserved-cpus="" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489578 2563 flags.go:64] FLAG: --reserved-memory="" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489582 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489585 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489588 2563 flags.go:64] FLAG: --rotate-certificates="false" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489591 2563 flags.go:64] FLAG: --rotate-server-certificates="false" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489594 2563 flags.go:64] FLAG: --runonce="false" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489597 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489601 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489603 2563 flags.go:64] FLAG: --seccomp-default="false" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489606 2563 flags.go:64] FLAG: --serialize-image-pulls="true" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489609 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 25 01:02:20.494505 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489612 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489615 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489618 2563 flags.go:64] FLAG: --storage-driver-password="root" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489621 2563 flags.go:64] FLAG: --storage-driver-secure="false" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489624 2563 flags.go:64] FLAG: --storage-driver-table="stats" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489629 2563 flags.go:64] FLAG: --storage-driver-user="root" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489632 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489635 2563 flags.go:64] FLAG: --sync-frequency="1m0s" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489638 2563 flags.go:64] FLAG: --system-cgroups="" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489641 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489647 2563 flags.go:64] FLAG: --system-reserved-cgroup="" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489650 2563 flags.go:64] FLAG: --tls-cert-file="" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489653 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489657 2563 flags.go:64] FLAG: --tls-min-version="" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489660 2563 flags.go:64] FLAG: --tls-private-key-file="" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489662 2563 flags.go:64] FLAG: --topology-manager-policy="none" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489665 2563 flags.go:64] FLAG: --topology-manager-policy-options="" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489668 2563 flags.go:64] FLAG: --topology-manager-scope="container" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489671 2563 flags.go:64] FLAG: --v="2" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489675 2563 flags.go:64] FLAG: --version="false" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489679 2563 flags.go:64] FLAG: --vmodule="" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489684 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.489687 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489787 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 01:02:20.495118 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489790 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489793 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489796 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489800 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489803 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489806 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489809 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489811 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489814 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489816 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489819 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489822 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489824 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489828 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489831 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489834 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489836 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489839 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489841 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489844 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 01:02:20.495696 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489847 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489849 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489851 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489854 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489858 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489861 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489864 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489867 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489869 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489872 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489874 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489877 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489879 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489882 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489884 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489887 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489890 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489893 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489896 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489898 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 01:02:20.496233 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489901 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489904 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489906 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489909 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489911 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489915 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489918 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489920 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489923 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489926 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489928 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489931 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489933 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489936 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489938 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489941 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489943 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489945 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489948 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 01:02:20.496763 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489950 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489953 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489955 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489958 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489961 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489963 2563 feature_gate.go:328] unrecognized feature gate: Example May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489966 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489968 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489971 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489974 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489977 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489980 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489983 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489986 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489989 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489991 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489993 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.489996 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.490000 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.490003 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 01:02:20.497227 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.490006 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 01:02:20.497733 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.490008 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 01:02:20.497733 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.490012 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 25 01:02:20.497733 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.490015 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 01:02:20.497733 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.490017 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 01:02:20.497733 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.490020 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 01:02:20.497733 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.490720 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 01:02:20.500556 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.500411 2563 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 25 01:02:20.500594 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.500559 2563 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 25 01:02:20.500628 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500614 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 01:02:20.500628 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500620 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 01:02:20.500628 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500624 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 01:02:20.500628 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500628 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500631 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500634 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500637 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500639 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500642 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500645 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500648 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500650 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500653 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500657 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500660 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500663 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500665 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500668 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500670 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500673 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500676 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500678 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 01:02:20.500732 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500680 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500683 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500685 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500688 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500690 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500693 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500695 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500698 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500700 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500704 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500708 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500711 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500714 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500717 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500720 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500723 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500726 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500728 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500731 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500733 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 01:02:20.501183 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500736 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500739 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500742 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500744 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500748 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500751 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500753 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500755 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500758 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500760 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500762 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500765 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500767 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500770 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500773 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500775 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500778 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500780 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500783 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500785 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 01:02:20.501699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500788 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500790 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500793 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500795 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500798 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500801 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500803 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500807 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500809 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500812 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500814 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500817 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500819 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500822 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500824 2563 feature_gate.go:328] unrecognized feature gate: Example May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500827 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500829 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500832 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500835 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500839 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 01:02:20.502224 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500843 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500846 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500849 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500851 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.500857 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500962 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500967 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500969 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500972 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500975 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500977 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500980 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500983 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500986 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500988 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500991 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 25 01:02:20.502741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500993 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500996 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.500998 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501002 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501005 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501007 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501010 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501012 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501015 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501018 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501020 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501023 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501025 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501028 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501031 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501033 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501036 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501038 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501041 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501043 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 25 01:02:20.503121 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501045 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501048 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501050 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501053 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501056 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501060 2563 feature_gate.go:328] unrecognized feature gate: NewOLM May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501063 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501066 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501068 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501071 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501073 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501076 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501079 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501081 2563 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501084 2563 feature_gate.go:328] unrecognized feature gate: Example May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501087 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501089 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501092 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501094 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501097 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 25 01:02:20.503720 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501099 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501102 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501104 2563 feature_gate.go:328] unrecognized feature gate: DualReplica May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501106 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501109 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501112 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501114 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501124 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501127 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501130 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501132 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501135 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501137 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501140 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501142 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501144 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501147 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501149 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501152 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 25 01:02:20.504188 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501155 2563 feature_gate.go:328] unrecognized feature gate: Example2 May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501158 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501160 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501163 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501165 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501168 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501170 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501173 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501175 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501178 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501180 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501184 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501188 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501191 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501194 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 25 01:02:20.504657 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:20.501197 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 25 01:02:20.505023 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.501202 2563 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 25 01:02:20.505023 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.502143 2563 server.go:962] "Client rotation is on, will bootstrap in background" May 25 01:02:20.505023 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.504528 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 25 01:02:20.505718 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.505706 2563 server.go:1019] "Starting client certificate rotation" May 25 01:02:20.505822 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.505807 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 01:02:20.505852 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.505848 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 25 01:02:20.535039 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.535016 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 01:02:20.538033 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.537451 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 25 01:02:20.555775 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.555754 2563 log.go:25] "Validated CRI v1 runtime API" May 25 01:02:20.561409 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.561388 2563 log.go:25] "Validated CRI v1 image API" May 25 01:02:20.562896 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.562873 2563 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 25 01:02:20.567098 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.567070 2563 fs.go:135] Filesystem UUIDs: map[2192e393-9bc7-41bb-9d86-0fb72d18ee52:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 aa596fad-7fb4-40d7-b497-e7c082f75a56:/dev/nvme0n1p4] May 25 01:02:20.567180 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.567096 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 25 01:02:20.570525 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.570501 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 01:02:20.571423 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.571314 2563 manager.go:217] Machine: {Timestamp:2026-05-25 01:02:20.570812713 +0000 UTC m=+0.463917355 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3088177 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec203af62aa9ae0dc90a6c9b5b157afe SystemUUID:ec203af6-2aa9-ae0d-c90a-6c9b5b157afe BootID:78dcdbcb-d616-4ce2-a95f-b31af941b2df Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:60:ea:d6:ec:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:60:ea:d6:ec:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:12:c4:e6:97:84:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 25 01:02:20.571976 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.571964 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 25 01:02:20.572111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.572099 2563 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 25 01:02:20.574944 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.574919 2563 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 25 01:02:20.575097 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.574946 2563 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-154.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 25 01:02:20.575153 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.575106 2563 topology_manager.go:138] "Creating topology manager with none policy" May 25 01:02:20.575153 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.575115 2563 container_manager_linux.go:306] "Creating device plugin manager" May 25 01:02:20.575153 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.575123 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 01:02:20.576161 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.576151 2563 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 25 01:02:20.578561 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.578549 2563 state_mem.go:36] "Initialized new in-memory state store" May 25 01:02:20.578687 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.578677 2563 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 25 01:02:20.581840 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.581829 2563 kubelet.go:491] "Attempting to sync node with API server" May 25 01:02:20.581878 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.581844 2563 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 25 01:02:20.581878 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.581858 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 25 01:02:20.581878 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.581866 2563 kubelet.go:397] "Adding apiserver pod source" May 25 01:02:20.581878 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.581875 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 25 01:02:20.583083 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.583067 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 01:02:20.583083 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.583087 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 25 01:02:20.586714 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.586696 2563 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 25 01:02:20.590149 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.590135 2563 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 25 01:02:20.591053 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591042 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 25 01:02:20.591092 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591061 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 25 01:02:20.591092 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591067 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 25 01:02:20.591092 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591072 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 25 01:02:20.591092 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591080 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 25 01:02:20.591092 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591087 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 25 01:02:20.591238 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591096 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 25 01:02:20.591238 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591104 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 25 01:02:20.591238 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591112 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 25 01:02:20.591238 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591118 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 25 01:02:20.591238 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591126 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 25 01:02:20.591510 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.591501 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 25 01:02:20.592461 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.592450 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 25 01:02:20.592499 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.592464 2563 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 25 01:02:20.598578 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.598554 2563 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-154.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 25 01:02:20.599016 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.599003 2563 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 25 01:02:20.599066 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.599049 2563 server.go:1295] "Started kubelet" May 25 01:02:20.599142 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.599113 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 25 01:02:20.599197 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.599127 2563 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 25 01:02:20.599246 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.599213 2563 server_v1.go:47] "podresources" method="list" useActivePods=true May 25 01:02:20.599342 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.599323 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 25 01:02:20.599516 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.599330 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-154.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 25 01:02:20.599971 ip-10-0-141-154 systemd[1]: Started Kubernetes Kubelet. May 25 01:02:20.600154 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.600143 2563 server.go:317] "Adding debug handlers to kubelet server" May 25 01:02:20.600625 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.600611 2563 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 25 01:02:20.605832 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.604359 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-154.ec2.internal.18b2a94a977d5e08 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-154.ec2.internal,UID:ip-10-0-141-154.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-154.ec2.internal,},FirstTimestamp:2026-05-25 01:02:20.599016968 +0000 UTC m=+0.492121611,LastTimestamp:2026-05-25 01:02:20.599016968 +0000 UTC m=+0.492121611,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-154.ec2.internal,}" May 25 01:02:20.609594 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.609565 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 25 01:02:20.609732 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.609711 2563 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 25 01:02:20.610120 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.610106 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 25 01:02:20.610219 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.610200 2563 volume_manager.go:295] "The desired_state_of_world populator starts" May 25 01:02:20.610323 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.610308 2563 volume_manager.go:297] "Starting Kubelet Volume Manager" May 25 01:02:20.610425 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.610411 2563 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 25 01:02:20.610498 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.610466 2563 reconstruct.go:97] "Volume reconstruction finished" May 25 01:02:20.610498 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.610479 2563 reconciler.go:26] "Reconciler: start to sync state" May 25 01:02:20.610793 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.610778 2563 factory.go:55] Registering systemd factory May 25 01:02:20.610836 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.610796 2563 factory.go:223] Registration of the systemd container factory successfully May 25 01:02:20.610999 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.610986 2563 factory.go:153] Registering CRI-O factory May 25 01:02:20.611055 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.611003 2563 factory.go:223] Registration of the crio container factory successfully May 25 01:02:20.611055 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.611026 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:20.611188 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.611059 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 25 01:02:20.611188 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.611079 2563 factory.go:103] Registering Raw factory May 25 01:02:20.611188 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.611102 2563 manager.go:1196] Started watching for new ooms in manager May 25 01:02:20.611411 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.611391 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nnz4r" May 25 01:02:20.612502 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.612484 2563 manager.go:319] Starting recovery of all containers May 25 01:02:20.612583 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.612527 2563 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 25 01:02:20.612583 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.612540 2563 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-154.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 25 01:02:20.616503 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.616479 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nnz4r" May 25 01:02:20.620456 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.620415 2563 manager.go:324] Recovery completed May 25 01:02:20.626617 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.626602 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:20.628351 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.628331 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:20.628454 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.628369 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:20.628454 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.628384 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:20.628960 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.628942 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" May 25 01:02:20.628960 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.628961 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 25 01:02:20.629063 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.628978 2563 state_mem.go:36] "Initialized new in-memory state store" May 25 01:02:20.631795 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.631779 2563 policy_none.go:49] "None policy: Start" May 25 01:02:20.631874 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.631801 2563 memory_manager.go:186] "Starting memorymanager" policy="None" May 25 01:02:20.631874 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.631816 2563 state_mem.go:35] "Initializing new in-memory state store" May 25 01:02:20.668061 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.668043 2563 manager.go:341] "Starting Device Plugin manager" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.668102 2563 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.668126 2563 server.go:85] "Starting device plugin registration server" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.668413 2563 eviction_manager.go:189] "Eviction manager: starting control loop" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.668423 2563 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.668565 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.668636 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.668643 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.669401 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.669458 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.679407 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.680644 2563 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.680661 2563 status_manager.go:230] "Starting to sync pod status with apiserver" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.680678 2563 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.680687 2563 kubelet.go:2451] "Starting kubelet main sync loop" May 25 01:02:20.682821 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.680766 2563 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 25 01:02:20.683283 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.682847 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 01:02:20.769204 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.769115 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:20.770244 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.770219 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:20.770365 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.770254 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:20.770365 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.770267 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:20.770365 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.770298 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-154.ec2.internal" May 25 01:02:20.778412 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.778395 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-154.ec2.internal" May 25 01:02:20.778515 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.778415 2563 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-154.ec2.internal\": node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:20.781563 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.781532 2563 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-154.ec2.internal"] May 25 01:02:20.781624 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.781602 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:20.783065 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.783049 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:20.783154 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.783080 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:20.783154 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.783093 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:20.784123 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.784108 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:20.784259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.784244 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" May 25 01:02:20.784310 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.784275 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:20.784776 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.784761 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:20.784861 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.784781 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:20.784861 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.784791 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:20.784861 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.784792 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:20.784861 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.784814 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:20.784861 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.784825 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:20.786062 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.786049 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-154.ec2.internal" May 25 01:02:20.786111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.786073 2563 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 25 01:02:20.786756 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.786740 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientMemory" May 25 01:02:20.786830 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.786766 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasNoDiskPressure" May 25 01:02:20.786830 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.786781 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeHasSufficientPID" May 25 01:02:20.798820 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.798800 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:20.808104 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.808089 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-154.ec2.internal\" not found" node="ip-10-0-141-154.ec2.internal" May 25 01:02:20.810977 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.810961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09c2fce96c8c4adbabe326db070f541e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal\" (UID: \"09c2fce96c8c4adbabe326db070f541e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" May 25 01:02:20.811048 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.810992 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09c2fce96c8c4adbabe326db070f541e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal\" (UID: \"09c2fce96c8c4adbabe326db070f541e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" May 25 01:02:20.811048 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.811023 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66e3b63fecffd8091301d02a57959078-config\") pod \"kube-apiserver-proxy-ip-10-0-141-154.ec2.internal\" (UID: \"66e3b63fecffd8091301d02a57959078\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-154.ec2.internal" May 25 01:02:20.812615 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.812601 2563 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-154.ec2.internal\" not found" node="ip-10-0-141-154.ec2.internal" May 25 01:02:20.899773 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:20.899735 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:20.912078 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.912055 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09c2fce96c8c4adbabe326db070f541e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal\" (UID: \"09c2fce96c8c4adbabe326db070f541e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" May 25 01:02:20.912142 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.912085 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09c2fce96c8c4adbabe326db070f541e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal\" (UID: \"09c2fce96c8c4adbabe326db070f541e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" May 25 01:02:20.912142 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.912108 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66e3b63fecffd8091301d02a57959078-config\") pod \"kube-apiserver-proxy-ip-10-0-141-154.ec2.internal\" (UID: \"66e3b63fecffd8091301d02a57959078\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-154.ec2.internal" May 25 01:02:20.912207 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.912147 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/66e3b63fecffd8091301d02a57959078-config\") pod \"kube-apiserver-proxy-ip-10-0-141-154.ec2.internal\" (UID: \"66e3b63fecffd8091301d02a57959078\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-154.ec2.internal" May 25 01:02:20.912207 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.912151 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/09c2fce96c8c4adbabe326db070f541e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal\" (UID: \"09c2fce96c8c4adbabe326db070f541e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" May 25 01:02:20.912207 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:20.912160 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/09c2fce96c8c4adbabe326db070f541e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal\" (UID: \"09c2fce96c8c4adbabe326db070f541e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" May 25 01:02:21.000238 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:21.000195 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:21.100970 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:21.100896 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:21.112165 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.112149 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" May 25 01:02:21.116059 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.116032 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-154.ec2.internal" May 25 01:02:21.201251 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:21.201208 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:21.301783 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:21.301747 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:21.402304 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:21.402227 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:21.484971 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.484942 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 25 01:02:21.503113 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:21.503073 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:21.505223 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.505210 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 25 01:02:21.505365 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.505349 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 01:02:21.505399 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.505377 2563 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 25 01:02:21.603838 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:21.603804 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:21.610366 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.610339 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 25 01:02:21.618427 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.618400 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 00:57:20 +0000 UTC" deadline="2027-11-27 13:55:36.491423131 +0000 UTC" May 25 01:02:21.618427 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.618425 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13236h53m14.873001167s" May 25 01:02:21.622675 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.622656 2563 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 25 01:02:21.643044 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.643018 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7c9vc" May 25 01:02:21.650957 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.650936 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7c9vc" May 25 01:02:21.704489 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:21.704418 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:21.724592 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:21.724560 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c2fce96c8c4adbabe326db070f541e.slice/crio-ce563d06339d26a685bddb4d83e2a24926250cc139ea47d9d201aa9b954cd606 WatchSource:0}: Error finding container ce563d06339d26a685bddb4d83e2a24926250cc139ea47d9d201aa9b954cd606: Status 404 returned error can't find the container with id ce563d06339d26a685bddb4d83e2a24926250cc139ea47d9d201aa9b954cd606 May 25 01:02:21.724824 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:21.724804 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66e3b63fecffd8091301d02a57959078.slice/crio-56aec8eeea59569dd6bfbdf382a8f0f54a8bb216ba593333ebee97d2e4585e68 WatchSource:0}: Error finding container 56aec8eeea59569dd6bfbdf382a8f0f54a8bb216ba593333ebee97d2e4585e68: Status 404 returned error can't find the container with id 56aec8eeea59569dd6bfbdf382a8f0f54a8bb216ba593333ebee97d2e4585e68 May 25 01:02:21.729581 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.729564 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 01:02:21.804615 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:21.804576 2563 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-154.ec2.internal\" not found" May 25 01:02:21.874420 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.874395 2563 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 25 01:02:21.910296 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.910267 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" May 25 01:02:21.927510 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.927488 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 01:02:21.928527 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.928514 2563 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-154.ec2.internal" May 25 01:02:21.938123 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:21.938104 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 25 01:02:22.018013 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.017935 2563 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 25 01:02:22.579569 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.579525 2563 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 25 01:02:22.582925 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.582904 2563 apiserver.go:52] "Watching apiserver" May 25 01:02:22.589115 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.589088 2563 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 25 01:02:22.589477 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.589428 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-rk8vg","openshift-network-operator/iptables-alerter-ql2x7","openshift-ovn-kubernetes/ovnkube-node-hqqzs","kube-system/konnectivity-agent-mqnbb","kube-system/kube-apiserver-proxy-ip-10-0-141-154.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pv9qq","openshift-image-registry/node-ca-g5mj4","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal","openshift-multus/multus-additional-cni-plugins-7h99h","openshift-network-diagnostics/network-check-target-p7l25","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72","openshift-dns/node-resolver-nbqnt","openshift-multus/multus-dfvfw"] May 25 01:02:22.591088 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.591067 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g5mj4" May 25 01:02:22.592259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.592236 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.593693 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.593416 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 25 01:02:22.593693 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.593510 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 25 01:02:22.593693 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.593416 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 25 01:02:22.593693 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.593589 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-zfwsz\"" May 25 01:02:22.594746 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.594728 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 25 01:02:22.598097 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.594872 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 25 01:02:22.598097 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.595365 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.598097 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.596914 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.598097 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.597374 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 25 01:02:22.598097 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.597473 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 25 01:02:22.598097 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.597575 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ggrbc\"" May 25 01:02:22.598097 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.597761 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 25 01:02:22.598097 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.597782 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 25 01:02:22.598097 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.597977 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 25 01:02:22.599103 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.599088 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 25 01:02:22.599382 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.599357 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:22.599489 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.599408 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 25 01:02:22.599556 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.599512 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-npnrp\"" May 25 01:02:22.599818 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.599799 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 25 01:02:22.599900 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.599892 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jj4rp\"" May 25 01:02:22.599971 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.599951 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 25 01:02:22.600116 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.600074 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ql2x7" May 25 01:02:22.601567 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.601540 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:22.601567 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.601555 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lt7vw\"" May 25 01:02:22.601683 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:22.601598 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:22.601837 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.601822 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 25 01:02:22.602452 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.602415 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 25 01:02:22.602452 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.602427 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 25 01:02:22.602658 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.602488 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 25 01:02:22.602658 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.602498 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gqppm\"" May 25 01:02:22.602797 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.602706 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 25 01:02:22.610653 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.610627 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.612074 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.612049 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:22.612167 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:22.612117 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:22.614522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.614499 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 25 01:02:22.614901 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.614879 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 25 01:02:22.616683 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.615189 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 25 01:02:22.616683 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.615355 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 25 01:02:22.616683 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.615623 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5ksw6\"" May 25 01:02:22.616683 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.615792 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 25 01:02:22.618788 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.618767 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nbqnt" May 25 01:02:22.618876 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.618796 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dfvfw" May 25 01:02:22.621492 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621262 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5d4e155-ec75-4cbf-98ec-453388135cec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.621492 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.621492 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621337 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-device-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.621492 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621362 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgfpb\" (UniqueName: \"kubernetes.io/projected/f0ab8c52-6ed9-4878-afa0-b4374292f299-kube-api-access-jgfpb\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.621492 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-kubelet\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.621492 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621411 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-lib-modules\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.621492 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621459 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7p7k\" (UniqueName: \"kubernetes.io/projected/57d8aed2-8238-4b0f-9b3e-da1360837ba3-kube-api-access-m7p7k\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.621492 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621483 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krkbn\" (UniqueName: \"kubernetes.io/projected/67bcba76-518c-4f73-96f1-06614f83809a-kube-api-access-krkbn\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621507 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-node-log\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621537 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s22vq\" (UniqueName: \"kubernetes.io/projected/d5d4e155-ec75-4cbf-98ec-453388135cec-kube-api-access-s22vq\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-registration-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621576 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-run-netns\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621596 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-log-socket\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621622 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-ovnkube-script-lib\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621639 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-sysctl-conf\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621653 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-run\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621667 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-socket-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621682 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-slash\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621697 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-etc-openvswitch\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621712 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9hkn\" (UniqueName: \"kubernetes.io/projected/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-kube-api-access-d9hkn\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krkhx\" (UniqueName: \"kubernetes.io/projected/db15759d-02bf-4fe6-999a-cc6846b89e74-kube-api-access-krkhx\") pod \"node-ca-g5mj4\" (UID: \"db15759d-02bf-4fe6-999a-cc6846b89e74\") " pod="openshift-image-registry/node-ca-g5mj4" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621749 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d4e155-ec75-4cbf-98ec-453388135cec-cni-binary-copy\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621765 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.621902 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621786 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-ovnkube-config\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621806 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-sysctl-d\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621823 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-systemd\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621838 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-cni-bin\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621857 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-tuned\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621870 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db15759d-02bf-4fe6-999a-cc6846b89e74-host\") pod \"node-ca-g5mj4\" (UID: \"db15759d-02bf-4fe6-999a-cc6846b89e74\") " pod="openshift-image-registry/node-ca-g5mj4" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621885 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621903 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-sysconfig\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57d8aed2-8238-4b0f-9b3e-da1360837ba3-tmp\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621935 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5cbv\" (UniqueName: \"kubernetes.io/projected/d98f98c4-508f-414e-b38e-43d870947315-kube-api-access-c5cbv\") pod \"iptables-alerter-ql2x7\" (UID: \"d98f98c4-508f-414e-b38e-43d870947315\") " pod="openshift-network-operator/iptables-alerter-ql2x7" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621951 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-system-cni-dir\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621973 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db15759d-02bf-4fe6-999a-cc6846b89e74-serviceca\") pod \"node-ca-g5mj4\" (UID: \"db15759d-02bf-4fe6-999a-cc6846b89e74\") " pod="openshift-image-registry/node-ca-g5mj4" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.621997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00eb2d1b-9bd3-46d0-874a-5312d97f437f-konnectivity-ca\") pod \"konnectivity-agent-mqnbb\" (UID: \"00eb2d1b-9bd3-46d0-874a-5312d97f437f\") " pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622013 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d98f98c4-508f-414e-b38e-43d870947315-iptables-alerter-script\") pod \"iptables-alerter-ql2x7\" (UID: \"d98f98c4-508f-414e-b38e-43d870947315\") " pod="openshift-network-operator/iptables-alerter-ql2x7" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622027 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d98f98c4-508f-414e-b38e-43d870947315-host-slash\") pod \"iptables-alerter-ql2x7\" (UID: \"d98f98c4-508f-414e-b38e-43d870947315\") " pod="openshift-network-operator/iptables-alerter-ql2x7" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622040 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-sys\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.622523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622056 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-sys-fs\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622069 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622089 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-etc-selinux\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622104 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-cnibin\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622117 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-systemd-units\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622131 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-cni-netd\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622145 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-env-overrides\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622162 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-var-lib-kubelet\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622185 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-var-lib-openvswitch\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r5j7\" (UniqueName: \"kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7\") pod \"network-check-target-p7l25\" (UID: \"bb056d63-5efc-4375-9448-ed8e8815abc7\") " pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-run-ovn\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622237 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622251 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-ovn-node-metrics-cert\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622265 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-modprobe-d\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-kubernetes\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622296 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-host\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.622984 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622310 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00eb2d1b-9bd3-46d0-874a-5312d97f437f-agent-certs\") pod \"konnectivity-agent-mqnbb\" (UID: \"00eb2d1b-9bd3-46d0-874a-5312d97f437f\") " pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:22.623486 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622324 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5d4e155-ec75-4cbf-98ec-453388135cec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.623486 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622353 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-run-systemd\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.623486 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-run-openvswitch\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.623486 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.622386 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-os-release\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.623486 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.623049 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 25 01:02:22.623486 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.623109 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-f5rvz\"" May 25 01:02:22.623486 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.623163 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 25 01:02:22.623486 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.623273 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 25 01:02:22.623486 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.623401 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-m64g6\"" May 25 01:02:22.651625 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.651590 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 00:57:21 +0000 UTC" deadline="2027-11-30 09:05:21.843894849 +0000 UTC" May 25 01:02:22.651729 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.651625 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13304h2m59.19227443s" May 25 01:02:22.686098 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.686050 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-154.ec2.internal" event={"ID":"66e3b63fecffd8091301d02a57959078","Type":"ContainerStarted","Data":"56aec8eeea59569dd6bfbdf382a8f0f54a8bb216ba593333ebee97d2e4585e68"} May 25 01:02:22.687168 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.687140 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" event={"ID":"09c2fce96c8c4adbabe326db070f541e","Type":"ContainerStarted","Data":"ce563d06339d26a685bddb4d83e2a24926250cc139ea47d9d201aa9b954cd606"} May 25 01:02:22.711409 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.711383 2563 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 25 01:02:22.722574 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722546 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-os-release\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.722716 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722584 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-run-netns\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.722716 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722613 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5d4e155-ec75-4cbf-98ec-453388135cec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.722716 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722680 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.722868 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722749 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-device-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.722868 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722748 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.722868 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722779 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgfpb\" (UniqueName: \"kubernetes.io/projected/f0ab8c52-6ed9-4878-afa0-b4374292f299-kube-api-access-jgfpb\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.722868 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722792 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-device-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.722868 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722689 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-os-release\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.722868 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722807 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-kubelet\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.722868 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722840 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-lib-modules\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.723174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722885 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m7p7k\" (UniqueName: \"kubernetes.io/projected/57d8aed2-8238-4b0f-9b3e-da1360837ba3-kube-api-access-m7p7k\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.723174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722942 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-run-k8s-cni-cncf-io\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.723174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722981 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krkbn\" (UniqueName: \"kubernetes.io/projected/67bcba76-518c-4f73-96f1-06614f83809a-kube-api-access-krkbn\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:22.723174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723016 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-node-log\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.723174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723036 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-cnibin\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.722944 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-kubelet\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723053 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s22vq\" (UniqueName: \"kubernetes.io/projected/d5d4e155-ec75-4cbf-98ec-453388135cec-kube-api-access-s22vq\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723083 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-lib-modules\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723161 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d5d4e155-ec75-4cbf-98ec-453388135cec-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723206 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-node-log\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723291 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-registration-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723331 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-run-netns\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723360 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-log-socket\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723372 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-registration-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723388 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-ovnkube-script-lib\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723394 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-run-netns\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.723406 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723412 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-sysctl-conf\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723414 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-log-socket\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723458 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-run\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-run\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723554 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-sysctl-conf\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-var-lib-kubelet\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723599 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-daemon-config\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723627 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-socket-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723652 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-slash\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723680 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-etc-openvswitch\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723704 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9hkn\" (UniqueName: \"kubernetes.io/projected/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-kube-api-access-d9hkn\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723731 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-os-release\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723756 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-etc-kubernetes\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723793 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-socket-dir\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723803 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49823412-f0ef-4ded-9c2a-8dbeb2a864f0-hosts-file\") pod \"node-resolver-nbqnt\" (UID: \"49823412-f0ef-4ded-9c2a-8dbeb2a864f0\") " pod="openshift-dns/node-resolver-nbqnt" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723829 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-krkhx\" (UniqueName: \"kubernetes.io/projected/db15759d-02bf-4fe6-999a-cc6846b89e74-kube-api-access-krkhx\") pod \"node-ca-g5mj4\" (UID: \"db15759d-02bf-4fe6-999a-cc6846b89e74\") " pod="openshift-image-registry/node-ca-g5mj4" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723871 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-slash\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.724049 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723894 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d4e155-ec75-4cbf-98ec-453388135cec-cni-binary-copy\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.724870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723914 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.724870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723951 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-ovnkube-script-lib\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.724870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.723933 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-ovnkube-config\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.724870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.724051 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.724870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.724538 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-sysctl-d\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.724870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.724613 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-etc-openvswitch\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.725117 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.724891 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-systemd\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.725117 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.724932 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-var-lib-cni-bin\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.725117 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.724941 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-ovnkube-config\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.725117 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.724975 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-systemd\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.725117 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.724991 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d5d4e155-ec75-4cbf-98ec-453388135cec-cni-binary-copy\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.725117 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725039 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-run-multus-certs\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.725117 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.724991 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-sysctl-d\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.725117 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725071 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-cni-bin\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.725117 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725111 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-cni-bin\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725107 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-tuned\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-conf-dir\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725166 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db15759d-02bf-4fe6-999a-cc6846b89e74-host\") pod \"node-ca-g5mj4\" (UID: \"db15759d-02bf-4fe6-999a-cc6846b89e74\") " pod="openshift-image-registry/node-ca-g5mj4" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725183 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725208 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-sysconfig\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725229 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57d8aed2-8238-4b0f-9b3e-da1360837ba3-tmp\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725237 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725237 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/db15759d-02bf-4fe6-999a-cc6846b89e74-host\") pod \"node-ca-g5mj4\" (UID: \"db15759d-02bf-4fe6-999a-cc6846b89e74\") " pod="openshift-image-registry/node-ca-g5mj4" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725249 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c5cbv\" (UniqueName: \"kubernetes.io/projected/d98f98c4-508f-414e-b38e-43d870947315-kube-api-access-c5cbv\") pod \"iptables-alerter-ql2x7\" (UID: \"d98f98c4-508f-414e-b38e-43d870947315\") " pod="openshift-network-operator/iptables-alerter-ql2x7" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725285 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-system-cni-dir\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725323 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db15759d-02bf-4fe6-999a-cc6846b89e74-serviceca\") pod \"node-ca-g5mj4\" (UID: \"db15759d-02bf-4fe6-999a-cc6846b89e74\") " pod="openshift-image-registry/node-ca-g5mj4" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725289 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-sysconfig\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725348 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00eb2d1b-9bd3-46d0-874a-5312d97f437f-konnectivity-ca\") pod \"konnectivity-agent-mqnbb\" (UID: \"00eb2d1b-9bd3-46d0-874a-5312d97f437f\") " pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725383 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d98f98c4-508f-414e-b38e-43d870947315-iptables-alerter-script\") pod \"iptables-alerter-ql2x7\" (UID: \"d98f98c4-508f-414e-b38e-43d870947315\") " pod="openshift-network-operator/iptables-alerter-ql2x7" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725407 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725343 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-system-cni-dir\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.725522 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725463 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d98f98c4-508f-414e-b38e-43d870947315-host-slash\") pod \"iptables-alerter-ql2x7\" (UID: \"d98f98c4-508f-414e-b38e-43d870947315\") " pod="openshift-network-operator/iptables-alerter-ql2x7" May 25 01:02:22.726218 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725409 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d98f98c4-508f-414e-b38e-43d870947315-host-slash\") pod \"iptables-alerter-ql2x7\" (UID: \"d98f98c4-508f-414e-b38e-43d870947315\") " pod="openshift-network-operator/iptables-alerter-ql2x7" May 25 01:02:22.726218 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725535 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-sys\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.726218 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.725940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-cni-binary-copy\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.726218 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726008 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-sys-fs\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.726218 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726045 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-cni-dir\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.726218 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726083 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-socket-dir-parent\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.726218 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726119 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-var-lib-cni-multus\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.726218 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726153 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-hostroot\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.726218 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726183 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jbl4\" (UniqueName: \"kubernetes.io/projected/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-kube-api-access-4jbl4\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.726218 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726220 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:22.726710 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726316 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-etc-selinux\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.726710 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726474 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/00eb2d1b-9bd3-46d0-874a-5312d97f437f-konnectivity-ca\") pod \"konnectivity-agent-mqnbb\" (UID: \"00eb2d1b-9bd3-46d0-874a-5312d97f437f\") " pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:22.726807 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726720 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/db15759d-02bf-4fe6-999a-cc6846b89e74-serviceca\") pod \"node-ca-g5mj4\" (UID: \"db15759d-02bf-4fe6-999a-cc6846b89e74\") " pod="openshift-image-registry/node-ca-g5mj4" May 25 01:02:22.726901 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726838 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-sys-fs\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.726901 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726256 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0ab8c52-6ed9-4878-afa0-b4374292f299-etc-selinux\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.727111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726920 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-cnibin\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.727111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726960 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-systemd-units\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.727111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726863 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d98f98c4-508f-414e-b38e-43d870947315-iptables-alerter-script\") pod \"iptables-alerter-ql2x7\" (UID: \"d98f98c4-508f-414e-b38e-43d870947315\") " pod="openshift-network-operator/iptables-alerter-ql2x7" May 25 01:02:22.727111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.726987 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-cni-netd\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.727111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727033 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-cni-netd\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.727111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727043 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-systemd-units\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.727111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727008 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d5d4e155-ec75-4cbf-98ec-453388135cec-cnibin\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.727111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727066 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-env-overrides\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.727111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727106 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-var-lib-kubelet\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.727542 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727137 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-system-cni-dir\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.727542 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:22.727163 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:22.727542 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727171 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-sys\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.727542 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727246 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-var-lib-kubelet\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.727542 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727165 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-497t9\" (UniqueName: \"kubernetes.io/projected/49823412-f0ef-4ded-9c2a-8dbeb2a864f0-kube-api-access-497t9\") pod \"node-resolver-nbqnt\" (UID: \"49823412-f0ef-4ded-9c2a-8dbeb2a864f0\") " pod="openshift-dns/node-resolver-nbqnt" May 25 01:02:22.727781 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727399 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-var-lib-openvswitch\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.727781 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:22.727573 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs podName:67bcba76-518c-4f73-96f1-06614f83809a nodeName:}" failed. No retries permitted until 2026-05-25 01:02:23.227404213 +0000 UTC m=+3.120508850 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs") pod "network-metrics-daemon-rk8vg" (UID: "67bcba76-518c-4f73-96f1-06614f83809a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:22.727781 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727621 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5j7\" (UniqueName: \"kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7\") pod \"network-check-target-p7l25\" (UID: \"bb056d63-5efc-4375-9448-ed8e8815abc7\") " pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:22.727781 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727689 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-run-ovn\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.727781 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727726 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.728007 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727754 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-ovn-node-metrics-cert\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.728007 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727909 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-modprobe-d\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.728007 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727944 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-kubernetes\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.728007 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727973 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-host\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.728007 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728003 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00eb2d1b-9bd3-46d0-874a-5312d97f437f-agent-certs\") pod \"konnectivity-agent-mqnbb\" (UID: \"00eb2d1b-9bd3-46d0-874a-5312d97f437f\") " pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:22.728217 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.727910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-run-ovn\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.728217 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728041 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-env-overrides\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.728217 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728095 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5d4e155-ec75-4cbf-98ec-453388135cec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.728402 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728283 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-kubernetes\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.728402 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728366 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-host-run-ovn-kubernetes\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.728517 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-modprobe-d\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.728563 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728539 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-var-lib-openvswitch\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.728608 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728590 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-run-systemd\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.728653 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728637 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-run-openvswitch\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.728699 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49823412-f0ef-4ded-9c2a-8dbeb2a864f0-tmp-dir\") pod \"node-resolver-nbqnt\" (UID: \"49823412-f0ef-4ded-9c2a-8dbeb2a864f0\") " pod="openshift-dns/node-resolver-nbqnt" May 25 01:02:22.728801 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728783 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-run-systemd\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.728859 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d5d4e155-ec75-4cbf-98ec-453388135cec-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.728859 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728831 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-run-openvswitch\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.728957 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.728891 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57d8aed2-8238-4b0f-9b3e-da1360837ba3-host\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.729799 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.729742 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57d8aed2-8238-4b0f-9b3e-da1360837ba3-tmp\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.729913 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.729808 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57d8aed2-8238-4b0f-9b3e-da1360837ba3-etc-tuned\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.733661 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.733635 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/00eb2d1b-9bd3-46d0-874a-5312d97f437f-agent-certs\") pod \"konnectivity-agent-mqnbb\" (UID: \"00eb2d1b-9bd3-46d0-874a-5312d97f437f\") " pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:22.733884 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:22.733860 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:22.733954 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:22.733888 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:22.733954 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:22.733905 2563 projected.go:194] Error preparing data for projected volume kube-api-access-2r5j7 for pod openshift-network-diagnostics/network-check-target-p7l25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:22.734560 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.734536 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgfpb\" (UniqueName: \"kubernetes.io/projected/f0ab8c52-6ed9-4878-afa0-b4374292f299-kube-api-access-jgfpb\") pod \"aws-ebs-csi-driver-node-dcr72\" (UID: \"f0ab8c52-6ed9-4878-afa0-b4374292f299\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.734655 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:22.734609 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7 podName:bb056d63-5efc-4375-9448-ed8e8815abc7 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:23.233956458 +0000 UTC m=+3.127061111 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2r5j7" (UniqueName: "kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7") pod "network-check-target-p7l25" (UID: "bb056d63-5efc-4375-9448-ed8e8815abc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:22.734884 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.734861 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-ovn-node-metrics-cert\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.735519 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.735494 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s22vq\" (UniqueName: \"kubernetes.io/projected/d5d4e155-ec75-4cbf-98ec-453388135cec-kube-api-access-s22vq\") pod \"multus-additional-cni-plugins-7h99h\" (UID: \"d5d4e155-ec75-4cbf-98ec-453388135cec\") " pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.735622 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.735497 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9hkn\" (UniqueName: \"kubernetes.io/projected/fbdb65e9-5cfd-4dd7-b150-bc0447e169ba-kube-api-access-d9hkn\") pod \"ovnkube-node-hqqzs\" (UID: \"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba\") " pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.735622 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.735590 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krkhx\" (UniqueName: \"kubernetes.io/projected/db15759d-02bf-4fe6-999a-cc6846b89e74-kube-api-access-krkhx\") pod \"node-ca-g5mj4\" (UID: \"db15759d-02bf-4fe6-999a-cc6846b89e74\") " pod="openshift-image-registry/node-ca-g5mj4" May 25 01:02:22.735738 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.735630 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krkbn\" (UniqueName: \"kubernetes.io/projected/67bcba76-518c-4f73-96f1-06614f83809a-kube-api-access-krkbn\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:22.736696 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.736675 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7p7k\" (UniqueName: \"kubernetes.io/projected/57d8aed2-8238-4b0f-9b3e-da1360837ba3-kube-api-access-m7p7k\") pod \"tuned-pv9qq\" (UID: \"57d8aed2-8238-4b0f-9b3e-da1360837ba3\") " pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.737387 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.737362 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5cbv\" (UniqueName: \"kubernetes.io/projected/d98f98c4-508f-414e-b38e-43d870947315-kube-api-access-c5cbv\") pod \"iptables-alerter-ql2x7\" (UID: \"d98f98c4-508f-414e-b38e-43d870947315\") " pod="openshift-network-operator/iptables-alerter-ql2x7" May 25 01:02:22.829376 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829342 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49823412-f0ef-4ded-9c2a-8dbeb2a864f0-tmp-dir\") pod \"node-resolver-nbqnt\" (UID: \"49823412-f0ef-4ded-9c2a-8dbeb2a864f0\") " pod="openshift-dns/node-resolver-nbqnt" May 25 01:02:22.829643 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829388 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-run-netns\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.829643 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829417 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-run-k8s-cni-cncf-io\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.829643 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829463 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-cnibin\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.829643 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829491 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-var-lib-kubelet\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.829643 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829511 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-run-netns\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.829643 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829515 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-daemon-config\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.829643 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829581 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-os-release\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.829643 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829611 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-etc-kubernetes\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.829643 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829636 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49823412-f0ef-4ded-9c2a-8dbeb2a864f0-hosts-file\") pod \"node-resolver-nbqnt\" (UID: \"49823412-f0ef-4ded-9c2a-8dbeb2a864f0\") " pod="openshift-dns/node-resolver-nbqnt" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829666 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-var-lib-cni-bin\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829689 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-run-multus-certs\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829714 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-conf-dir\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829729 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/49823412-f0ef-4ded-9c2a-8dbeb2a864f0-tmp-dir\") pod \"node-resolver-nbqnt\" (UID: \"49823412-f0ef-4ded-9c2a-8dbeb2a864f0\") " pod="openshift-dns/node-resolver-nbqnt" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829749 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-cni-binary-copy\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829774 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-cni-dir\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829794 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-cnibin\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829799 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-socket-dir-parent\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829825 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-var-lib-cni-multus\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829833 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-run-k8s-cni-cncf-io\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829849 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-hostroot\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829872 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-run-multus-certs\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829874 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4jbl4\" (UniqueName: \"kubernetes.io/projected/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-kube-api-access-4jbl4\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829920 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-system-cni-dir\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829928 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-os-release\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829963 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-497t9\" (UniqueName: \"kubernetes.io/projected/49823412-f0ef-4ded-9c2a-8dbeb2a864f0-kube-api-access-497t9\") pod \"node-resolver-nbqnt\" (UID: \"49823412-f0ef-4ded-9c2a-8dbeb2a864f0\") " pod="openshift-dns/node-resolver-nbqnt" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.829965 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-etc-kubernetes\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830080 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.830000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-daemon-config\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830745 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.830000 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/49823412-f0ef-4ded-9c2a-8dbeb2a864f0-hosts-file\") pod \"node-resolver-nbqnt\" (UID: \"49823412-f0ef-4ded-9c2a-8dbeb2a864f0\") " pod="openshift-dns/node-resolver-nbqnt" May 25 01:02:22.830745 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.830030 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-var-lib-cni-bin\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830745 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.830055 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-var-lib-kubelet\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830745 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.830068 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-conf-dir\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830745 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.830085 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-hostroot\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830745 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.830112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-host-var-lib-cni-multus\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830745 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.830112 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-socket-dir-parent\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830745 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.830159 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-system-cni-dir\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830745 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.830285 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-multus-cni-dir\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.830745 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.830390 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-cni-binary-copy\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.839475 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.839450 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jbl4\" (UniqueName: \"kubernetes.io/projected/7512ac5b-aebd-4930-acc8-73f75bcbd2ba-kube-api-access-4jbl4\") pod \"multus-dfvfw\" (UID: \"7512ac5b-aebd-4930-acc8-73f75bcbd2ba\") " pod="openshift-multus/multus-dfvfw" May 25 01:02:22.839638 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.839427 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-497t9\" (UniqueName: \"kubernetes.io/projected/49823412-f0ef-4ded-9c2a-8dbeb2a864f0-kube-api-access-497t9\") pod \"node-resolver-nbqnt\" (UID: \"49823412-f0ef-4ded-9c2a-8dbeb2a864f0\") " pod="openshift-dns/node-resolver-nbqnt" May 25 01:02:22.918515 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.918479 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g5mj4" May 25 01:02:22.927343 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.927312 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:22.935779 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.935755 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" May 25 01:02:22.941344 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.941324 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" May 25 01:02:22.948924 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.948904 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:22.957507 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.957486 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ql2x7" May 25 01:02:22.965047 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.965027 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7h99h" May 25 01:02:22.971570 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.971555 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nbqnt" May 25 01:02:22.978181 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:22.978163 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dfvfw" May 25 01:02:23.232624 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.232537 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:23.232784 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:23.232684 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:23.232784 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:23.232750 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs podName:67bcba76-518c-4f73-96f1-06614f83809a nodeName:}" failed. No retries permitted until 2026-05-25 01:02:24.232734461 +0000 UTC m=+4.125839096 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs") pod "network-metrics-daemon-rk8vg" (UID: "67bcba76-518c-4f73-96f1-06614f83809a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:23.332946 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.332923 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5j7\" (UniqueName: \"kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7\") pod \"network-check-target-p7l25\" (UID: \"bb056d63-5efc-4375-9448-ed8e8815abc7\") " pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:23.333095 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:23.333077 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:23.333165 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:23.333102 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:23.333165 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:23.333115 2563 projected.go:194] Error preparing data for projected volume kube-api-access-2r5j7 for pod openshift-network-diagnostics/network-check-target-p7l25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:23.333260 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:23.333179 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7 podName:bb056d63-5efc-4375-9448-ed8e8815abc7 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:24.333160103 +0000 UTC m=+4.226264753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r5j7" (UniqueName: "kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7") pod "network-check-target-p7l25" (UID: "bb056d63-5efc-4375-9448-ed8e8815abc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:23.346545 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:23.346298 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49823412_f0ef_4ded_9c2a_8dbeb2a864f0.slice/crio-2e44bc21a62af7dc5fbc9fe684495d91ff25de634d8b3329ea5bdb647147255e WatchSource:0}: Error finding container 2e44bc21a62af7dc5fbc9fe684495d91ff25de634d8b3329ea5bdb647147255e: Status 404 returned error can't find the container with id 2e44bc21a62af7dc5fbc9fe684495d91ff25de634d8b3329ea5bdb647147255e May 25 01:02:23.348303 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:23.348281 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb15759d_02bf_4fe6_999a_cc6846b89e74.slice/crio-728901b00d2aceb01e75df168b11417c13ab29bbc0d817164e5381bfc0b185cf WatchSource:0}: Error finding container 728901b00d2aceb01e75df168b11417c13ab29bbc0d817164e5381bfc0b185cf: Status 404 returned error can't find the container with id 728901b00d2aceb01e75df168b11417c13ab29bbc0d817164e5381bfc0b185cf May 25 01:02:23.351417 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:23.351393 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ab8c52_6ed9_4878_afa0_b4374292f299.slice/crio-84b88aad4a29d7832c075844b3254f9ab570d507544a40e0ec4d959eb7994e61 WatchSource:0}: Error finding container 84b88aad4a29d7832c075844b3254f9ab570d507544a40e0ec4d959eb7994e61: Status 404 returned error can't find the container with id 84b88aad4a29d7832c075844b3254f9ab570d507544a40e0ec4d959eb7994e61 May 25 01:02:23.352115 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:23.352084 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5d4e155_ec75_4cbf_98ec_453388135cec.slice/crio-da70083017e79678893f1ae107ae956356e3ac2c45a7a2222b7937315bde9427 WatchSource:0}: Error finding container da70083017e79678893f1ae107ae956356e3ac2c45a7a2222b7937315bde9427: Status 404 returned error can't find the container with id da70083017e79678893f1ae107ae956356e3ac2c45a7a2222b7937315bde9427 May 25 01:02:23.352912 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:23.352877 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7512ac5b_aebd_4930_acc8_73f75bcbd2ba.slice/crio-e5192ceda258ff8abb6f372273bdedabd9b83d5e711a4b4b475da27241e9ba3d WatchSource:0}: Error finding container e5192ceda258ff8abb6f372273bdedabd9b83d5e711a4b4b475da27241e9ba3d: Status 404 returned error can't find the container with id e5192ceda258ff8abb6f372273bdedabd9b83d5e711a4b4b475da27241e9ba3d May 25 01:02:23.353598 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:23.353579 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd98f98c4_508f_414e_b38e_43d870947315.slice/crio-0e3962a90445367413f4ecd4ae6049fcab6de0a1a024f5bfff444ef997197a26 WatchSource:0}: Error finding container 0e3962a90445367413f4ecd4ae6049fcab6de0a1a024f5bfff444ef997197a26: Status 404 returned error can't find the container with id 0e3962a90445367413f4ecd4ae6049fcab6de0a1a024f5bfff444ef997197a26 May 25 01:02:23.355171 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:23.355152 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbdb65e9_5cfd_4dd7_b150_bc0447e169ba.slice/crio-e1ede7894c0c3e2af1a347db79ca3e319c44c863cf5cb23b06b4d38b271e5fe6 WatchSource:0}: Error finding container e1ede7894c0c3e2af1a347db79ca3e319c44c863cf5cb23b06b4d38b271e5fe6: Status 404 returned error can't find the container with id e1ede7894c0c3e2af1a347db79ca3e319c44c863cf5cb23b06b4d38b271e5fe6 May 25 01:02:23.356544 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:23.356530 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57d8aed2_8238_4b0f_9b3e_da1360837ba3.slice/crio-66012ae6e1bee5a6d7a6bbfec6fecfc4d5eb9ca3584d25b78488edc754fa4b73 WatchSource:0}: Error finding container 66012ae6e1bee5a6d7a6bbfec6fecfc4d5eb9ca3584d25b78488edc754fa4b73: Status 404 returned error can't find the container with id 66012ae6e1bee5a6d7a6bbfec6fecfc4d5eb9ca3584d25b78488edc754fa4b73 May 25 01:02:23.359699 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:23.359145 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00eb2d1b_9bd3_46d0_874a_5312d97f437f.slice/crio-faad97afeb99dccb4b509049ec0d84d2b1087a12610f15666289befcf2500462 WatchSource:0}: Error finding container faad97afeb99dccb4b509049ec0d84d2b1087a12610f15666289befcf2500462: Status 404 returned error can't find the container with id faad97afeb99dccb4b509049ec0d84d2b1087a12610f15666289befcf2500462 May 25 01:02:23.494353 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.494277 2563 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 25 01:02:23.652023 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.651990 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 00:57:21 +0000 UTC" deadline="2027-10-29 17:23:41.098806657 +0000 UTC" May 25 01:02:23.652023 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.652016 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12544h21m17.446792714s" May 25 01:02:23.682099 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.681617 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:23.682099 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:23.681742 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:23.682099 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.681997 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:23.682326 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:23.682141 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:23.690064 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.689994 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" event={"ID":"f0ab8c52-6ed9-4878-afa0-b4374292f299","Type":"ContainerStarted","Data":"84b88aad4a29d7832c075844b3254f9ab570d507544a40e0ec4d959eb7994e61"} May 25 01:02:23.691182 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.691150 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g5mj4" event={"ID":"db15759d-02bf-4fe6-999a-cc6846b89e74","Type":"ContainerStarted","Data":"728901b00d2aceb01e75df168b11417c13ab29bbc0d817164e5381bfc0b185cf"} May 25 01:02:23.692940 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.692905 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-154.ec2.internal" event={"ID":"66e3b63fecffd8091301d02a57959078","Type":"ContainerStarted","Data":"d35eae79ce411f89605584dc2a7d70fabfa4970b9d29d5b8ae37e5cf3c4f7437"} May 25 01:02:23.694519 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.694495 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" event={"ID":"09c2fce96c8c4adbabe326db070f541e","Type":"ContainerStarted","Data":"0d73e21b687cfe81fdce7dec3774de505576fb5835a3ec8a6fc04ca3ad0827e2"} May 25 01:02:23.695688 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.695663 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mqnbb" event={"ID":"00eb2d1b-9bd3-46d0-874a-5312d97f437f","Type":"ContainerStarted","Data":"faad97afeb99dccb4b509049ec0d84d2b1087a12610f15666289befcf2500462"} May 25 01:02:23.697407 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.697382 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" event={"ID":"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba","Type":"ContainerStarted","Data":"e1ede7894c0c3e2af1a347db79ca3e319c44c863cf5cb23b06b4d38b271e5fe6"} May 25 01:02:23.699216 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.699192 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ql2x7" event={"ID":"d98f98c4-508f-414e-b38e-43d870947315","Type":"ContainerStarted","Data":"0e3962a90445367413f4ecd4ae6049fcab6de0a1a024f5bfff444ef997197a26"} May 25 01:02:23.700578 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.700545 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dfvfw" event={"ID":"7512ac5b-aebd-4930-acc8-73f75bcbd2ba","Type":"ContainerStarted","Data":"e5192ceda258ff8abb6f372273bdedabd9b83d5e711a4b4b475da27241e9ba3d"} May 25 01:02:23.702664 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.702627 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nbqnt" event={"ID":"49823412-f0ef-4ded-9c2a-8dbeb2a864f0","Type":"ContainerStarted","Data":"2e44bc21a62af7dc5fbc9fe684495d91ff25de634d8b3329ea5bdb647147255e"} May 25 01:02:23.703859 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.703809 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" event={"ID":"57d8aed2-8238-4b0f-9b3e-da1360837ba3","Type":"ContainerStarted","Data":"66012ae6e1bee5a6d7a6bbfec6fecfc4d5eb9ca3584d25b78488edc754fa4b73"} May 25 01:02:23.705096 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.705071 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7h99h" event={"ID":"d5d4e155-ec75-4cbf-98ec-453388135cec","Type":"ContainerStarted","Data":"da70083017e79678893f1ae107ae956356e3ac2c45a7a2222b7937315bde9427"} May 25 01:02:23.708761 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:23.708050 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-154.ec2.internal" podStartSLOduration=2.708036091 podStartE2EDuration="2.708036091s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:02:23.707815822 +0000 UTC m=+3.600920469" watchObservedRunningTime="2026-05-25 01:02:23.708036091 +0000 UTC m=+3.601140745" May 25 01:02:24.239752 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:24.239129 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:24.239752 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:24.239274 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:24.239752 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:24.239339 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs podName:67bcba76-518c-4f73-96f1-06614f83809a nodeName:}" failed. No retries permitted until 2026-05-25 01:02:26.239322082 +0000 UTC m=+6.132426718 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs") pod "network-metrics-daemon-rk8vg" (UID: "67bcba76-518c-4f73-96f1-06614f83809a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:24.340978 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:24.340351 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5j7\" (UniqueName: \"kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7\") pod \"network-check-target-p7l25\" (UID: \"bb056d63-5efc-4375-9448-ed8e8815abc7\") " pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:24.340978 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:24.340530 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:24.340978 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:24.340553 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:24.340978 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:24.340567 2563 projected.go:194] Error preparing data for projected volume kube-api-access-2r5j7 for pod openshift-network-diagnostics/network-check-target-p7l25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:24.340978 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:24.340630 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7 podName:bb056d63-5efc-4375-9448-ed8e8815abc7 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:26.340611276 +0000 UTC m=+6.233715908 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r5j7" (UniqueName: "kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7") pod "network-check-target-p7l25" (UID: "bb056d63-5efc-4375-9448-ed8e8815abc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:24.740841 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:24.740804 2563 generic.go:358] "Generic (PLEG): container finished" podID="09c2fce96c8c4adbabe326db070f541e" containerID="0d73e21b687cfe81fdce7dec3774de505576fb5835a3ec8a6fc04ca3ad0827e2" exitCode=0 May 25 01:02:24.741874 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:24.741846 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" event={"ID":"09c2fce96c8c4adbabe326db070f541e","Type":"ContainerDied","Data":"0d73e21b687cfe81fdce7dec3774de505576fb5835a3ec8a6fc04ca3ad0827e2"} May 25 01:02:25.681324 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:25.681257 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:25.681537 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:25.681403 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:25.681880 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:25.681857 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:25.681989 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:25.681968 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:25.757994 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:25.757252 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" event={"ID":"09c2fce96c8c4adbabe326db070f541e","Type":"ContainerStarted","Data":"4bacacfc17db86265e13ee850182b05084aaed0aad6764af77bc2b78e2001010"} May 25 01:02:26.256388 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:26.256350 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:26.256587 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:26.256558 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:26.256634 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:26.256621 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs podName:67bcba76-518c-4f73-96f1-06614f83809a nodeName:}" failed. No retries permitted until 2026-05-25 01:02:30.256602726 +0000 UTC m=+10.149707357 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs") pod "network-metrics-daemon-rk8vg" (UID: "67bcba76-518c-4f73-96f1-06614f83809a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:26.357645 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:26.357603 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5j7\" (UniqueName: \"kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7\") pod \"network-check-target-p7l25\" (UID: \"bb056d63-5efc-4375-9448-ed8e8815abc7\") " pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:26.357844 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:26.357809 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:26.357844 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:26.357827 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:26.357844 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:26.357836 2563 projected.go:194] Error preparing data for projected volume kube-api-access-2r5j7 for pod openshift-network-diagnostics/network-check-target-p7l25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:26.358021 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:26.357896 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7 podName:bb056d63-5efc-4375-9448-ed8e8815abc7 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:30.35787706 +0000 UTC m=+10.250981693 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r5j7" (UniqueName: "kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7") pod "network-check-target-p7l25" (UID: "bb056d63-5efc-4375-9448-ed8e8815abc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:27.681811 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:27.681771 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:27.682170 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:27.681917 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:27.682339 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:27.682321 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:27.682450 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:27.682414 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:29.681211 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:29.681167 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:29.681644 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:29.681312 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:29.681815 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:29.681797 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:29.681926 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:29.681905 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:30.293556 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:30.293481 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:30.293742 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:30.293634 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:30.293742 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:30.293702 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs podName:67bcba76-518c-4f73-96f1-06614f83809a nodeName:}" failed. No retries permitted until 2026-05-25 01:02:38.29368228 +0000 UTC m=+18.186786924 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs") pod "network-metrics-daemon-rk8vg" (UID: "67bcba76-518c-4f73-96f1-06614f83809a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:30.394275 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:30.394237 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5j7\" (UniqueName: \"kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7\") pod \"network-check-target-p7l25\" (UID: \"bb056d63-5efc-4375-9448-ed8e8815abc7\") " pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:30.394475 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:30.394399 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:30.394475 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:30.394415 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:30.394475 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:30.394425 2563 projected.go:194] Error preparing data for projected volume kube-api-access-2r5j7 for pod openshift-network-diagnostics/network-check-target-p7l25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:30.394635 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:30.394498 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7 podName:bb056d63-5efc-4375-9448-ed8e8815abc7 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:38.39448024 +0000 UTC m=+18.287584875 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r5j7" (UniqueName: "kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7") pod "network-check-target-p7l25" (UID: "bb056d63-5efc-4375-9448-ed8e8815abc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:31.681795 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:31.681759 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:31.682218 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:31.681759 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:31.682218 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:31.681905 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:31.682218 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:31.681985 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:33.681455 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:33.681396 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:33.681854 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:33.681564 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:33.681854 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:33.681653 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:33.681854 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:33.681707 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:35.681523 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:35.681488 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:35.681980 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:35.681491 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:35.681980 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:35.681608 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:35.681980 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:35.681696 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:37.681227 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.681195 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:37.681695 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.681205 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:37.681695 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:37.681308 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:37.681695 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:37.681455 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:37.791589 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.791517 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-154.ec2.internal" podStartSLOduration=16.791502731 podStartE2EDuration="16.791502731s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:02:25.782340048 +0000 UTC m=+5.675444705" watchObservedRunningTime="2026-05-25 01:02:37.791502731 +0000 UTC m=+17.684607383" May 25 01:02:37.792037 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.792018 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-fzbpg"] May 25 01:02:37.799026 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.799006 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:37.799152 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:37.799085 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzbpg" podUID="306748e0-bd1f-4d83-b4ae-7a35930030ba" May 25 01:02:37.843953 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.843918 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/306748e0-bd1f-4d83-b4ae-7a35930030ba-kubelet-config\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:37.843953 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.843959 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/306748e0-bd1f-4d83-b4ae-7a35930030ba-dbus\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:37.844160 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.843984 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:37.944337 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.944248 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/306748e0-bd1f-4d83-b4ae-7a35930030ba-dbus\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:37.944337 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.944305 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:37.944590 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.944373 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/306748e0-bd1f-4d83-b4ae-7a35930030ba-kubelet-config\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:37.944590 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.944372 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/306748e0-bd1f-4d83-b4ae-7a35930030ba-dbus\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:37.944590 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:37.944471 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/306748e0-bd1f-4d83-b4ae-7a35930030ba-kubelet-config\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:37.944590 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:37.944483 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 01:02:37.944590 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:37.944556 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret podName:306748e0-bd1f-4d83-b4ae-7a35930030ba nodeName:}" failed. No retries permitted until 2026-05-25 01:02:38.444540568 +0000 UTC m=+18.337645198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret") pod "global-pull-secret-syncer-fzbpg" (UID: "306748e0-bd1f-4d83-b4ae-7a35930030ba") : object "kube-system"/"original-pull-secret" not registered May 25 01:02:38.346628 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:38.346555 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:38.346774 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:38.346678 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:38.346774 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:38.346746 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs podName:67bcba76-518c-4f73-96f1-06614f83809a nodeName:}" failed. No retries permitted until 2026-05-25 01:02:54.346727346 +0000 UTC m=+34.239831984 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs") pod "network-metrics-daemon-rk8vg" (UID: "67bcba76-518c-4f73-96f1-06614f83809a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:38.447297 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:38.447255 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5j7\" (UniqueName: \"kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7\") pod \"network-check-target-p7l25\" (UID: \"bb056d63-5efc-4375-9448-ed8e8815abc7\") " pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:38.447502 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:38.447349 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:38.447502 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:38.447463 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:38.447502 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:38.447493 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:38.447662 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:38.447507 2563 projected.go:194] Error preparing data for projected volume kube-api-access-2r5j7 for pod openshift-network-diagnostics/network-check-target-p7l25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:38.447662 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:38.447469 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 01:02:38.447662 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:38.447569 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7 podName:bb056d63-5efc-4375-9448-ed8e8815abc7 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:54.447550023 +0000 UTC m=+34.340654667 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r5j7" (UniqueName: "kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7") pod "network-check-target-p7l25" (UID: "bb056d63-5efc-4375-9448-ed8e8815abc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:38.447662 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:38.447605 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret podName:306748e0-bd1f-4d83-b4ae-7a35930030ba nodeName:}" failed. No retries permitted until 2026-05-25 01:02:39.447591166 +0000 UTC m=+19.340695801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret") pod "global-pull-secret-syncer-fzbpg" (UID: "306748e0-bd1f-4d83-b4ae-7a35930030ba") : object "kube-system"/"original-pull-secret" not registered May 25 01:02:39.456110 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:39.455906 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:39.456556 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:39.456075 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 01:02:39.456556 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:39.456245 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret podName:306748e0-bd1f-4d83-b4ae-7a35930030ba nodeName:}" failed. No retries permitted until 2026-05-25 01:02:41.456225071 +0000 UTC m=+21.349329704 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret") pod "global-pull-secret-syncer-fzbpg" (UID: "306748e0-bd1f-4d83-b4ae-7a35930030ba") : object "kube-system"/"original-pull-secret" not registered May 25 01:02:39.681228 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:39.681196 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:39.681410 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:39.681196 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:39.681410 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:39.681318 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:39.681410 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:39.681384 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzbpg" podUID="306748e0-bd1f-4d83-b4ae-7a35930030ba" May 25 01:02:39.681410 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:39.681196 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:39.681608 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:39.681553 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:41.473761 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:41.473725 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:41.474080 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:41.473871 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 01:02:41.474080 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:41.473927 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret podName:306748e0-bd1f-4d83-b4ae-7a35930030ba nodeName:}" failed. No retries permitted until 2026-05-25 01:02:45.473913675 +0000 UTC m=+25.367018305 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret") pod "global-pull-secret-syncer-fzbpg" (UID: "306748e0-bd1f-4d83-b4ae-7a35930030ba") : object "kube-system"/"original-pull-secret" not registered May 25 01:02:41.681276 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:41.681229 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:41.681276 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:41.681272 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:41.681484 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:41.681331 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:41.681484 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:41.681374 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:41.681555 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:41.681486 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:41.681593 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:41.681552 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzbpg" podUID="306748e0-bd1f-4d83-b4ae-7a35930030ba" May 25 01:02:41.795167 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:41.795101 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" event={"ID":"f0ab8c52-6ed9-4878-afa0-b4374292f299","Type":"ContainerStarted","Data":"6e628984bdbf0f3a215209906066c031d1b7b59e7d93b8c61afce202443f6c68"} May 25 01:02:41.806103 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:41.805531 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g5mj4" event={"ID":"db15759d-02bf-4fe6-999a-cc6846b89e74","Type":"ContainerStarted","Data":"ba46c86201a842c08ba1beab566760adf868bf54a31cba5feabf948749d80cfa"} May 25 01:02:42.808996 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.808822 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mqnbb" event={"ID":"00eb2d1b-9bd3-46d0-874a-5312d97f437f","Type":"ContainerStarted","Data":"1753305bbfa556a0e0c3683bca6f05dc5b817b1198a5d37bb3f38d1e7adde5d0"} May 25 01:02:42.811628 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.811607 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" event={"ID":"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba","Type":"ContainerStarted","Data":"f6af09c2d4de1617c2e295ed95fde4d20e56da7656a992de052d8035432ce4ab"} May 25 01:02:42.811705 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.811635 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" event={"ID":"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba","Type":"ContainerStarted","Data":"bf42664c1da8b07542061c94cf7483f677d071f74981892c4089d1d1f3c340f1"} May 25 01:02:42.811705 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.811644 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" event={"ID":"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba","Type":"ContainerStarted","Data":"d2c194a140a33084ed7d00ae1a368d76d685fad0cdb2af07882884fa0ef1a099"} May 25 01:02:42.811705 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.811652 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" event={"ID":"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba","Type":"ContainerStarted","Data":"7e0272df282ae59728a539d7a1522ce42417dbbf7ac25203cbb31331a86736ef"} May 25 01:02:42.811705 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.811663 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" event={"ID":"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba","Type":"ContainerStarted","Data":"be4c8c4c77e39f156dc0cd3fa830f2e326e782641b2e2a5c5d993686ff1756c1"} May 25 01:02:42.812946 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.812923 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dfvfw" event={"ID":"7512ac5b-aebd-4930-acc8-73f75bcbd2ba","Type":"ContainerStarted","Data":"e963640457b722147100fe492f0b7ec2191b078c26a61a6d8a9388242c15fb2f"} May 25 01:02:42.814216 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.814186 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nbqnt" event={"ID":"49823412-f0ef-4ded-9c2a-8dbeb2a864f0","Type":"ContainerStarted","Data":"5a6f45ef795f367a54f7641624f56b0387405cb87e2e4147a3d50d0e6934b644"} May 25 01:02:42.815552 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.815338 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" event={"ID":"57d8aed2-8238-4b0f-9b3e-da1360837ba3","Type":"ContainerStarted","Data":"176de02c023710fbe6b1c3847154e66668057cd090168ee5a9024fa36891ef71"} May 25 01:02:42.816859 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.816839 2563 generic.go:358] "Generic (PLEG): container finished" podID="d5d4e155-ec75-4cbf-98ec-453388135cec" containerID="00dbe29e5746cc73f33d801cb0cc56df2e078d983454d47eaa1099896b4c8ca5" exitCode=0 May 25 01:02:42.816951 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.816940 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7h99h" event={"ID":"d5d4e155-ec75-4cbf-98ec-453388135cec","Type":"ContainerDied","Data":"00dbe29e5746cc73f33d801cb0cc56df2e078d983454d47eaa1099896b4c8ca5"} May 25 01:02:42.837680 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.837639 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g5mj4" podStartSLOduration=4.731933504 podStartE2EDuration="22.837622307s" podCreationTimestamp="2026-05-25 01:02:20 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.35051948 +0000 UTC m=+3.243624112" lastFinishedPulling="2026-05-25 01:02:41.456208271 +0000 UTC m=+21.349312915" observedRunningTime="2026-05-25 01:02:41.820528933 +0000 UTC m=+21.713633584" watchObservedRunningTime="2026-05-25 01:02:42.837622307 +0000 UTC m=+22.730726953" May 25 01:02:42.838199 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.838176 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mqnbb" podStartSLOduration=4.744014977 podStartE2EDuration="22.838171964s" podCreationTimestamp="2026-05-25 01:02:20 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.362054061 +0000 UTC m=+3.255158692" lastFinishedPulling="2026-05-25 01:02:41.456211049 +0000 UTC m=+21.349315679" observedRunningTime="2026-05-25 01:02:42.837763465 +0000 UTC m=+22.730868117" watchObservedRunningTime="2026-05-25 01:02:42.838171964 +0000 UTC m=+22.731276615" May 25 01:02:42.862265 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.862113 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 25 01:02:42.881861 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.881816 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pv9qq" podStartSLOduration=4.764881619 podStartE2EDuration="22.881803038s" podCreationTimestamp="2026-05-25 01:02:20 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.35938632 +0000 UTC m=+3.252490964" lastFinishedPulling="2026-05-25 01:02:41.476307747 +0000 UTC m=+21.369412383" observedRunningTime="2026-05-25 01:02:42.881694598 +0000 UTC m=+22.774799249" watchObservedRunningTime="2026-05-25 01:02:42.881803038 +0000 UTC m=+22.774907690" May 25 01:02:42.896770 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:42.896722 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-nbqnt" podStartSLOduration=3.763822492 podStartE2EDuration="21.896708709s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.349001576 +0000 UTC m=+3.242106206" lastFinishedPulling="2026-05-25 01:02:41.48188778 +0000 UTC m=+21.374992423" observedRunningTime="2026-05-25 01:02:42.896462858 +0000 UTC m=+22.789567521" watchObservedRunningTime="2026-05-25 01:02:42.896708709 +0000 UTC m=+22.789813362" May 25 01:02:43.681070 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:43.681038 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:43.681267 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:43.681046 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:43.681267 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:43.681172 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:43.681380 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:43.681269 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:43.681380 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:43.681271 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:43.681380 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:43.681352 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzbpg" podUID="306748e0-bd1f-4d83-b4ae-7a35930030ba" May 25 01:02:43.683205 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:43.683092 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T01:02:42.862257676Z","UUID":"5f86a531-c290-4224-bfc2-0ee88d8013ad","Handler":null,"Name":"","Endpoint":""} May 25 01:02:43.685052 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:43.685029 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 25 01:02:43.685153 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:43.685059 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 25 01:02:43.821815 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:43.821777 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" event={"ID":"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba","Type":"ContainerStarted","Data":"5510d077a38c62a0e744f9eba0b0b95554abe175ab9ed337a27f2dd12667293e"} May 25 01:02:43.823007 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:43.822979 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ql2x7" event={"ID":"d98f98c4-508f-414e-b38e-43d870947315","Type":"ContainerStarted","Data":"3d60a151b14a4c5e6b44ea6cbf48d101c95011a03a76ea39fed6682febf5c8a2"} May 25 01:02:43.824613 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:43.824589 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" event={"ID":"f0ab8c52-6ed9-4878-afa0-b4374292f299","Type":"ContainerStarted","Data":"e6ac817085eba3e3897da2e9ca0e0e8b690112c66b880be1bcaf5dac767a7d78"} May 25 01:02:43.839359 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:43.839312 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-dfvfw" podStartSLOduration=4.70383395 podStartE2EDuration="22.839297614s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.354740247 +0000 UTC m=+3.247844883" lastFinishedPulling="2026-05-25 01:02:41.490203917 +0000 UTC m=+21.383308547" observedRunningTime="2026-05-25 01:02:42.92168527 +0000 UTC m=+22.814789921" watchObservedRunningTime="2026-05-25 01:02:43.839297614 +0000 UTC m=+23.732402315" May 25 01:02:43.839539 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:43.839504 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ql2x7" podStartSLOduration=4.719530624 podStartE2EDuration="22.839494337s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.356345411 +0000 UTC m=+3.249450041" lastFinishedPulling="2026-05-25 01:02:41.476309124 +0000 UTC m=+21.369413754" observedRunningTime="2026-05-25 01:02:43.838819944 +0000 UTC m=+23.731924597" watchObservedRunningTime="2026-05-25 01:02:43.839494337 +0000 UTC m=+23.732598990" May 25 01:02:44.828453 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:44.828363 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" event={"ID":"f0ab8c52-6ed9-4878-afa0-b4374292f299","Type":"ContainerStarted","Data":"18814c129905261acb13222d5aebd679a902f80a9c3c6a5d7f1e3b8cef37ca9a"} May 25 01:02:44.848137 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:44.848082 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dcr72" podStartSLOduration=4.302206314 podStartE2EDuration="24.848065413s" podCreationTimestamp="2026-05-25 01:02:20 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.352990971 +0000 UTC m=+3.246095615" lastFinishedPulling="2026-05-25 01:02:43.898850078 +0000 UTC m=+23.791954714" observedRunningTime="2026-05-25 01:02:44.847825727 +0000 UTC m=+24.740930378" watchObservedRunningTime="2026-05-25 01:02:44.848065413 +0000 UTC m=+24.741170068" May 25 01:02:45.502864 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:45.502832 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:45.503012 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:45.502928 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 01:02:45.503012 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:45.502976 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret podName:306748e0-bd1f-4d83-b4ae-7a35930030ba nodeName:}" failed. No retries permitted until 2026-05-25 01:02:53.502963372 +0000 UTC m=+33.396068001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret") pod "global-pull-secret-syncer-fzbpg" (UID: "306748e0-bd1f-4d83-b4ae-7a35930030ba") : object "kube-system"/"original-pull-secret" not registered May 25 01:02:45.681513 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:45.681484 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:45.681672 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:45.681576 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:45.681672 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:45.681592 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:45.681672 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:45.681616 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:45.681767 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:45.681676 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzbpg" podUID="306748e0-bd1f-4d83-b4ae-7a35930030ba" May 25 01:02:45.681767 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:45.681744 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:45.833691 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:45.833606 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" event={"ID":"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba","Type":"ContainerStarted","Data":"d61b462d78e81486cc8a5014c80eb348e2198611622a1688a41d65681c3b4691"} May 25 01:02:46.076037 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:46.076000 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:46.076951 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:46.076927 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:47.681106 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:47.681070 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:47.681106 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:47.681097 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:47.681765 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:47.681070 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:47.681765 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:47.681196 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:47.681765 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:47.681318 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzbpg" podUID="306748e0-bd1f-4d83-b4ae-7a35930030ba" May 25 01:02:47.681765 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:47.681393 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:48.841482 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:48.841233 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" event={"ID":"fbdb65e9-5cfd-4dd7-b150-bc0447e169ba","Type":"ContainerStarted","Data":"e2fc8e42b4286fef70e6689fd8f48857cbe79539be0b2486de379d8d4c64c8d1"} May 25 01:02:48.841935 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:48.841533 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:48.841935 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:48.841570 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:48.843098 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:48.843075 2563 generic.go:358] "Generic (PLEG): container finished" podID="d5d4e155-ec75-4cbf-98ec-453388135cec" containerID="3eca45d36c24c8aa39698b6bb363036b072b94ebefec39786ac6fcd34b0ee02b" exitCode=0 May 25 01:02:48.843196 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:48.843112 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7h99h" event={"ID":"d5d4e155-ec75-4cbf-98ec-453388135cec","Type":"ContainerDied","Data":"3eca45d36c24c8aa39698b6bb363036b072b94ebefec39786ac6fcd34b0ee02b"} May 25 01:02:48.858387 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:48.858367 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:48.870985 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:48.870946 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" podStartSLOduration=10.255211826 podStartE2EDuration="28.8709345s" podCreationTimestamp="2026-05-25 01:02:20 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.3567959 +0000 UTC m=+3.249900548" lastFinishedPulling="2026-05-25 01:02:41.972518577 +0000 UTC m=+21.865623222" observedRunningTime="2026-05-25 01:02:48.870387015 +0000 UTC m=+28.763491668" watchObservedRunningTime="2026-05-25 01:02:48.8709345 +0000 UTC m=+28.764039182" May 25 01:02:49.681684 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.681510 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:49.681821 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.681547 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:49.681821 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:49.681753 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:49.681901 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:49.681841 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:49.681901 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.681571 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:49.681957 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:49.681913 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzbpg" podUID="306748e0-bd1f-4d83-b4ae-7a35930030ba" May 25 01:02:49.789555 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.789484 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzbpg"] May 25 01:02:49.792165 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.792146 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rk8vg"] May 25 01:02:49.794916 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.794895 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p7l25"] May 25 01:02:49.846622 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.846589 2563 generic.go:358] "Generic (PLEG): container finished" podID="d5d4e155-ec75-4cbf-98ec-453388135cec" containerID="016b8a32b9f85ec67d51f5dc9ff52f301a95f60eaf922e2ddee2c7a431f6dccd" exitCode=0 May 25 01:02:49.847005 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.846701 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7h99h" event={"ID":"d5d4e155-ec75-4cbf-98ec-453388135cec","Type":"ContainerDied","Data":"016b8a32b9f85ec67d51f5dc9ff52f301a95f60eaf922e2ddee2c7a431f6dccd"} May 25 01:02:49.847005 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.846838 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:49.847005 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.846932 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:49.847005 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:49.846948 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:49.847198 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:49.847008 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzbpg" podUID="306748e0-bd1f-4d83-b4ae-7a35930030ba" May 25 01:02:49.847198 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.847103 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:49.847198 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:49.847177 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:49.847957 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.847660 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:49.865363 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:49.865339 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:02:50.852756 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:50.852666 2563 generic.go:358] "Generic (PLEG): container finished" podID="d5d4e155-ec75-4cbf-98ec-453388135cec" containerID="6e4e1389db2e4c0438951701238e6e3fcfada74ecc0fbeb4dae5d8541d0f150f" exitCode=0 May 25 01:02:50.852756 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:50.852740 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7h99h" event={"ID":"d5d4e155-ec75-4cbf-98ec-453388135cec","Type":"ContainerDied","Data":"6e4e1389db2e4c0438951701238e6e3fcfada74ecc0fbeb4dae5d8541d0f150f"} May 25 01:02:51.681749 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:51.681661 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:51.681749 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:51.681684 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:51.681972 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:51.681808 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:51.681972 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:51.681818 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:51.681972 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:51.681893 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:51.682095 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:51.681988 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzbpg" podUID="306748e0-bd1f-4d83-b4ae-7a35930030ba" May 25 01:02:52.627266 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:52.627230 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:52.627871 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:52.627372 2563 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 25 01:02:52.628255 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:52.628235 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mqnbb" May 25 01:02:53.566405 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:53.566361 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:53.566635 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:53.566540 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 25 01:02:53.566635 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:53.566613 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret podName:306748e0-bd1f-4d83-b4ae-7a35930030ba nodeName:}" failed. No retries permitted until 2026-05-25 01:03:09.566599184 +0000 UTC m=+49.459703814 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret") pod "global-pull-secret-syncer-fzbpg" (UID: "306748e0-bd1f-4d83-b4ae-7a35930030ba") : object "kube-system"/"original-pull-secret" not registered May 25 01:02:53.681178 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:53.681146 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:53.681616 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:53.681243 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fzbpg" podUID="306748e0-bd1f-4d83-b4ae-7a35930030ba" May 25 01:02:53.681616 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:53.681272 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:53.681616 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:53.681296 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:53.681616 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:53.681390 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p7l25" podUID="bb056d63-5efc-4375-9448-ed8e8815abc7" May 25 01:02:53.681616 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:53.681536 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:02:54.371886 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:54.371837 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:54.372103 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:54.372080 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:54.372187 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:54.372174 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs podName:67bcba76-518c-4f73-96f1-06614f83809a nodeName:}" failed. No retries permitted until 2026-05-25 01:03:26.372141975 +0000 UTC m=+66.265246621 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs") pod "network-metrics-daemon-rk8vg" (UID: "67bcba76-518c-4f73-96f1-06614f83809a") : object "openshift-multus"/"metrics-daemon-secret" not registered May 25 01:02:54.472427 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:54.472390 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5j7\" (UniqueName: \"kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7\") pod \"network-check-target-p7l25\" (UID: \"bb056d63-5efc-4375-9448-ed8e8815abc7\") " pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:54.472610 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:54.472558 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 25 01:02:54.472610 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:54.472573 2563 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 25 01:02:54.472610 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:54.472586 2563 projected.go:194] Error preparing data for projected volume kube-api-access-2r5j7 for pod openshift-network-diagnostics/network-check-target-p7l25: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:54.472756 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:54.472656 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7 podName:bb056d63-5efc-4375-9448-ed8e8815abc7 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:26.472636144 +0000 UTC m=+66.365740776 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2r5j7" (UniqueName: "kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7") pod "network-check-target-p7l25" (UID: "bb056d63-5efc-4375-9448-ed8e8815abc7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 25 01:02:55.459544 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.459461 2563 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-154.ec2.internal" event="NodeReady" May 25 01:02:55.460053 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.459617 2563 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 25 01:02:55.497246 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.497215 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68dfdb6946-t24v4"] May 25 01:02:55.530141 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.530112 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb"] May 25 01:02:55.530284 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.530269 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.532574 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.532550 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 25 01:02:55.532720 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.532601 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 25 01:02:55.532720 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.532628 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 25 01:02:55.532720 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.532710 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jl9qq\"" May 25 01:02:55.538465 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.538399 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 25 01:02:55.554953 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.554925 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d"] May 25 01:02:55.555091 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.554971 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:02:55.557930 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.557899 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 25 01:02:55.560448 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.558135 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 25 01:02:55.560448 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.558335 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 25 01:02:55.560448 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.558540 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 25 01:02:55.570763 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.570739 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst"] May 25 01:02:55.570900 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.570882 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.573571 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.573542 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 25 01:02:55.573686 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.573623 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 25 01:02:55.574165 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.574147 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 25 01:02:55.574259 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.574212 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 25 01:02:55.588818 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.588792 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68dfdb6946-t24v4"] May 25 01:02:55.588930 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.588830 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst"] May 25 01:02:55.588930 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.588844 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb"] May 25 01:02:55.588930 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.588856 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" May 25 01:02:55.589070 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.588860 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kghmq"] May 25 01:02:55.591609 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.591586 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 25 01:02:55.591717 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.591586 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-j87dh\"" May 25 01:02:55.607327 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.607305 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s9vfh"] May 25 01:02:55.607513 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.607487 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.610293 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.610272 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 25 01:02:55.610605 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.610585 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bftwk\"" May 25 01:02:55.610707 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.610674 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 25 01:02:55.624295 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.624275 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d"] May 25 01:02:55.624384 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.624299 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kghmq"] May 25 01:02:55.624384 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.624308 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s9vfh"] May 25 01:02:55.624538 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.624417 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:02:55.626656 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.626633 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 25 01:02:55.626758 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.626666 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 25 01:02:55.626758 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.626640 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 25 01:02:55.626758 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.626749 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rtn5\"" May 25 01:02:55.680925 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.680891 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcc93170-9e13-495e-b3af-7606f18697e1-tmp\") pod \"klusterlet-addon-workmgr-7b76cb4698-fpmgb\" (UID: \"bcc93170-9e13-495e-b3af-7606f18697e1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:02:55.681111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.680933 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.681111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.680964 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-trusted-ca\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.681111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681028 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-installation-pull-secrets\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.681111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681048 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:02:55.681111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681041 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:02:55.681111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681065 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12ec03f5-f9ec-403b-bafe-e9d2814c4cb5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5647cc4586-wtzst\" (UID: \"12ec03f5-f9ec-403b-bafe-e9d2814c4cb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" May 25 01:02:55.681111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681079 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:02:55.681476 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681126 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bcc93170-9e13-495e-b3af-7606f18697e1-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b76cb4698-fpmgb\" (UID: \"bcc93170-9e13-495e-b3af-7606f18697e1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:02:55.681476 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681147 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-hub\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.681476 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681178 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1bba914-4c0c-4d5a-bba1-476651b01f4c-ca-trust-extracted\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.681476 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-certificates\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.681476 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681229 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-bound-sa-token\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.681476 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681252 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.681476 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psw9d\" (UniqueName: \"kubernetes.io/projected/12ec03f5-f9ec-403b-bafe-e9d2814c4cb5-kube-api-access-psw9d\") pod \"managed-serviceaccount-addon-agent-5647cc4586-wtzst\" (UID: \"12ec03f5-f9ec-403b-bafe-e9d2814c4cb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" May 25 01:02:55.681476 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681339 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.681476 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681367 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.681476 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681393 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af475045-cb51-4e75-b2f5-5e68681538cc-config-volume\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.681476 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681426 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6swsw\" (UniqueName: \"kubernetes.io/projected/bcc93170-9e13-495e-b3af-7606f18697e1-kube-api-access-6swsw\") pod \"klusterlet-addon-workmgr-7b76cb4698-fpmgb\" (UID: \"bcc93170-9e13-495e-b3af-7606f18697e1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:02:55.681879 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681484 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-ca\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.681879 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681543 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj9f2\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-kube-api-access-xj9f2\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.681879 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681568 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.681879 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681589 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af475045-cb51-4e75-b2f5-5e68681538cc-tmp-dir\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.681879 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681628 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twv2r\" (UniqueName: \"kubernetes.io/projected/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-kube-api-access-twv2r\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.681879 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681657 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-image-registry-private-configuration\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.681879 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.681684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk9jv\" (UniqueName: \"kubernetes.io/projected/af475045-cb51-4e75-b2f5-5e68681538cc-kube-api-access-mk9jv\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.684970 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.684748 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2dmfc\"" May 25 01:02:55.685176 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.685145 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 25 01:02:55.685176 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.685145 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-657vv\"" May 25 01:02:55.685453 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.685417 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 01:02:55.686190 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.686171 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 01:02:55.686305 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.686289 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 01:02:55.782565 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782475 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-installation-pull-secrets\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.782565 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782515 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12ec03f5-f9ec-403b-bafe-e9d2814c4cb5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5647cc4586-wtzst\" (UID: \"12ec03f5-f9ec-403b-bafe-e9d2814c4cb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" May 25 01:02:55.782779 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782596 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bcc93170-9e13-495e-b3af-7606f18697e1-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b76cb4698-fpmgb\" (UID: \"bcc93170-9e13-495e-b3af-7606f18697e1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:02:55.782779 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782625 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-hub\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.782779 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782646 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1bba914-4c0c-4d5a-bba1-476651b01f4c-ca-trust-extracted\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.782779 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782661 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-certificates\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.782779 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782682 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-bound-sa-token\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.782779 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782713 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfqff\" (UniqueName: \"kubernetes.io/projected/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-kube-api-access-dfqff\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:02:55.782779 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782741 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.782779 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782767 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-psw9d\" (UniqueName: \"kubernetes.io/projected/12ec03f5-f9ec-403b-bafe-e9d2814c4cb5-kube-api-access-psw9d\") pod \"managed-serviceaccount-addon-agent-5647cc4586-wtzst\" (UID: \"12ec03f5-f9ec-403b-bafe-e9d2814c4cb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782815 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782842 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782871 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af475045-cb51-4e75-b2f5-5e68681538cc-config-volume\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782927 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6swsw\" (UniqueName: \"kubernetes.io/projected/bcc93170-9e13-495e-b3af-7606f18697e1-kube-api-access-6swsw\") pod \"klusterlet-addon-workmgr-7b76cb4698-fpmgb\" (UID: \"bcc93170-9e13-495e-b3af-7606f18697e1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782952 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-ca\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782974 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xj9f2\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-kube-api-access-xj9f2\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.782995 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783018 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af475045-cb51-4e75-b2f5-5e68681538cc-tmp-dir\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783044 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twv2r\" (UniqueName: \"kubernetes.io/projected/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-kube-api-access-twv2r\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783069 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-image-registry-private-configuration\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783092 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mk9jv\" (UniqueName: \"kubernetes.io/projected/af475045-cb51-4e75-b2f5-5e68681538cc-kube-api-access-mk9jv\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783098 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1bba914-4c0c-4d5a-bba1-476651b01f4c-ca-trust-extracted\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783159 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcc93170-9e13-495e-b3af-7606f18697e1-tmp\") pod \"klusterlet-addon-workmgr-7b76cb4698-fpmgb\" (UID: \"bcc93170-9e13-495e-b3af-7606f18697e1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:02:55.783174 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783180 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.783789 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783198 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-trusted-ca\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.783789 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783216 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:02:55.783789 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783324 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-certificates\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.783789 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783569 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcc93170-9e13-495e-b3af-7606f18697e1-tmp\") pod \"klusterlet-addon-workmgr-7b76cb4698-fpmgb\" (UID: \"bcc93170-9e13-495e-b3af-7606f18697e1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:02:55.783789 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.783679 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af475045-cb51-4e75-b2f5-5e68681538cc-tmp-dir\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.783789 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:55.783710 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:02:55.783789 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:55.783770 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls podName:af475045-cb51-4e75-b2f5-5e68681538cc nodeName:}" failed. No retries permitted until 2026-05-25 01:02:56.283752198 +0000 UTC m=+36.176856843 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls") pod "dns-default-kghmq" (UID: "af475045-cb51-4e75-b2f5-5e68681538cc") : secret "dns-default-metrics-tls" not found May 25 01:02:55.784157 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:55.783928 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:02:55.784157 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:55.783944 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfdb6946-t24v4: secret "image-registry-tls" not found May 25 01:02:55.784157 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:55.783997 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls podName:a1bba914-4c0c-4d5a-bba1-476651b01f4c nodeName:}" failed. No retries permitted until 2026-05-25 01:02:56.283981616 +0000 UTC m=+36.177086252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls") pod "image-registry-68dfdb6946-t24v4" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c") : secret "image-registry-tls" not found May 25 01:02:55.784632 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.784608 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.784737 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.784718 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/af475045-cb51-4e75-b2f5-5e68681538cc-config-volume\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.785267 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.785234 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-trusted-ca\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.788242 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.788074 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-image-registry-private-configuration\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.788418 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.788363 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-ca\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.788560 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.788486 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-installation-pull-secrets\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.788560 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.788532 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.788665 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.788614 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-hub\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.788943 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.788920 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.789545 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.789525 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bcc93170-9e13-495e-b3af-7606f18697e1-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b76cb4698-fpmgb\" (UID: \"bcc93170-9e13-495e-b3af-7606f18697e1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:02:55.790160 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.790144 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/12ec03f5-f9ec-403b-bafe-e9d2814c4cb5-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-5647cc4586-wtzst\" (UID: \"12ec03f5-f9ec-403b-bafe-e9d2814c4cb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" May 25 01:02:55.802356 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.802330 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-bound-sa-token\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.804834 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.804487 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj9f2\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-kube-api-access-xj9f2\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:55.806872 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.806849 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6swsw\" (UniqueName: \"kubernetes.io/projected/bcc93170-9e13-495e-b3af-7606f18697e1-kube-api-access-6swsw\") pod \"klusterlet-addon-workmgr-7b76cb4698-fpmgb\" (UID: \"bcc93170-9e13-495e-b3af-7606f18697e1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:02:55.808385 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.808360 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk9jv\" (UniqueName: \"kubernetes.io/projected/af475045-cb51-4e75-b2f5-5e68681538cc-kube-api-access-mk9jv\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:55.810401 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.810369 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twv2r\" (UniqueName: \"kubernetes.io/projected/ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf-kube-api-access-twv2r\") pod \"cluster-proxy-proxy-agent-6fd64c47c9-5t94d\" (UID: \"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.811186 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.811164 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psw9d\" (UniqueName: \"kubernetes.io/projected/12ec03f5-f9ec-403b-bafe-e9d2814c4cb5-kube-api-access-psw9d\") pod \"managed-serviceaccount-addon-agent-5647cc4586-wtzst\" (UID: \"12ec03f5-f9ec-403b-bafe-e9d2814c4cb5\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" May 25 01:02:55.866926 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.866893 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:02:55.883907 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.883865 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:02:55.884040 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.883926 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dfqff\" (UniqueName: \"kubernetes.io/projected/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-kube-api-access-dfqff\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:02:55.884040 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:55.884019 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:02:55.884138 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:55.884089 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert podName:5cb43ecb-16f8-46ea-9c92-4bf296452f7b nodeName:}" failed. No retries permitted until 2026-05-25 01:02:56.384071076 +0000 UTC m=+36.277175710 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert") pod "ingress-canary-s9vfh" (UID: "5cb43ecb-16f8-46ea-9c92-4bf296452f7b") : secret "canary-serving-cert" not found May 25 01:02:55.893417 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.893390 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfqff\" (UniqueName: \"kubernetes.io/projected/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-kube-api-access-dfqff\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:02:55.895100 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.895082 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:02:55.903737 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:55.903717 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" May 25 01:02:56.287839 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:56.287806 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:56.288006 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:56.287909 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:56.288065 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:56.287998 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:02:56.288065 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:56.288042 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:02:56.288179 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:56.288066 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfdb6946-t24v4: secret "image-registry-tls" not found May 25 01:02:56.288179 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:56.288146 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls podName:af475045-cb51-4e75-b2f5-5e68681538cc nodeName:}" failed. No retries permitted until 2026-05-25 01:02:57.288115665 +0000 UTC m=+37.181220310 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls") pod "dns-default-kghmq" (UID: "af475045-cb51-4e75-b2f5-5e68681538cc") : secret "dns-default-metrics-tls" not found May 25 01:02:56.288179 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:56.288170 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls podName:a1bba914-4c0c-4d5a-bba1-476651b01f4c nodeName:}" failed. No retries permitted until 2026-05-25 01:02:57.288159341 +0000 UTC m=+37.181263986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls") pod "image-registry-68dfdb6946-t24v4" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c") : secret "image-registry-tls" not found May 25 01:02:56.388485 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:56.388428 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:02:56.388646 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:56.388564 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:02:56.388646 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:56.388642 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert podName:5cb43ecb-16f8-46ea-9c92-4bf296452f7b nodeName:}" failed. No retries permitted until 2026-05-25 01:02:57.388626541 +0000 UTC m=+37.281731172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert") pod "ingress-canary-s9vfh" (UID: "5cb43ecb-16f8-46ea-9c92-4bf296452f7b") : secret "canary-serving-cert" not found May 25 01:02:56.751297 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:56.751112 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst"] May 25 01:02:56.755574 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:56.755548 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d"] May 25 01:02:56.756298 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:56.756275 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb"] May 25 01:02:56.817170 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:56.817135 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod12ec03f5_f9ec_403b_bafe_e9d2814c4cb5.slice/crio-e4bbeec1483d91e85e3b1e814e62364eeff25991c30432c0a15a396f989fc13c WatchSource:0}: Error finding container e4bbeec1483d91e85e3b1e814e62364eeff25991c30432c0a15a396f989fc13c: Status 404 returned error can't find the container with id e4bbeec1483d91e85e3b1e814e62364eeff25991c30432c0a15a396f989fc13c May 25 01:02:56.817404 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:56.817376 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc93170_9e13_495e_b3af_7606f18697e1.slice/crio-0ab346e3b93cd5b6fd4f31d5d43ad63dcc9d4b07181d812aa7c09dd55015de89 WatchSource:0}: Error finding container 0ab346e3b93cd5b6fd4f31d5d43ad63dcc9d4b07181d812aa7c09dd55015de89: Status 404 returned error can't find the container with id 0ab346e3b93cd5b6fd4f31d5d43ad63dcc9d4b07181d812aa7c09dd55015de89 May 25 01:02:56.818274 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:02:56.818250 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab4e6bb4_a04e_448b_a05c_c5f6b4fa54cf.slice/crio-cd83d32ab4c445b732edd5eec7997dd3698a4d9b13d5915981c2330834ac54fd WatchSource:0}: Error finding container cd83d32ab4c445b732edd5eec7997dd3698a4d9b13d5915981c2330834ac54fd: Status 404 returned error can't find the container with id cd83d32ab4c445b732edd5eec7997dd3698a4d9b13d5915981c2330834ac54fd May 25 01:02:56.863716 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:56.863689 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" event={"ID":"12ec03f5-f9ec-403b-bafe-e9d2814c4cb5","Type":"ContainerStarted","Data":"e4bbeec1483d91e85e3b1e814e62364eeff25991c30432c0a15a396f989fc13c"} May 25 01:02:56.864683 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:56.864659 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" event={"ID":"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf","Type":"ContainerStarted","Data":"cd83d32ab4c445b732edd5eec7997dd3698a4d9b13d5915981c2330834ac54fd"} May 25 01:02:56.865589 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:56.865566 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" event={"ID":"bcc93170-9e13-495e-b3af-7606f18697e1","Type":"ContainerStarted","Data":"0ab346e3b93cd5b6fd4f31d5d43ad63dcc9d4b07181d812aa7c09dd55015de89"} May 25 01:02:57.295674 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:57.295636 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:57.295826 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:57.295727 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:57.295826 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:57.295798 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:02:57.295907 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:57.295830 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:02:57.295907 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:57.295841 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfdb6946-t24v4: secret "image-registry-tls" not found May 25 01:02:57.295907 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:57.295868 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls podName:af475045-cb51-4e75-b2f5-5e68681538cc nodeName:}" failed. No retries permitted until 2026-05-25 01:02:59.295850633 +0000 UTC m=+39.188955263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls") pod "dns-default-kghmq" (UID: "af475045-cb51-4e75-b2f5-5e68681538cc") : secret "dns-default-metrics-tls" not found May 25 01:02:57.295907 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:57.295886 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls podName:a1bba914-4c0c-4d5a-bba1-476651b01f4c nodeName:}" failed. No retries permitted until 2026-05-25 01:02:59.295874115 +0000 UTC m=+39.188978764 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls") pod "image-registry-68dfdb6946-t24v4" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c") : secret "image-registry-tls" not found May 25 01:02:57.397096 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:57.397068 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:02:57.397283 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:57.397253 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:02:57.397362 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:57.397346 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert podName:5cb43ecb-16f8-46ea-9c92-4bf296452f7b nodeName:}" failed. No retries permitted until 2026-05-25 01:02:59.397323755 +0000 UTC m=+39.290428384 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert") pod "ingress-canary-s9vfh" (UID: "5cb43ecb-16f8-46ea-9c92-4bf296452f7b") : secret "canary-serving-cert" not found May 25 01:02:57.872698 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:57.871719 2563 generic.go:358] "Generic (PLEG): container finished" podID="d5d4e155-ec75-4cbf-98ec-453388135cec" containerID="4034f5c4eab21eeff605dbd339a916f5f73dee4d1795c0be647db15e1b52861a" exitCode=0 May 25 01:02:57.872698 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:57.871776 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7h99h" event={"ID":"d5d4e155-ec75-4cbf-98ec-453388135cec","Type":"ContainerDied","Data":"4034f5c4eab21eeff605dbd339a916f5f73dee4d1795c0be647db15e1b52861a"} May 25 01:02:58.880604 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:58.880534 2563 generic.go:358] "Generic (PLEG): container finished" podID="d5d4e155-ec75-4cbf-98ec-453388135cec" containerID="46dc2305dbce3158817a875d35d7622a41fe443fbad1996edf43e853b7d8c62c" exitCode=0 May 25 01:02:58.881043 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:58.880612 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7h99h" event={"ID":"d5d4e155-ec75-4cbf-98ec-453388135cec","Type":"ContainerDied","Data":"46dc2305dbce3158817a875d35d7622a41fe443fbad1996edf43e853b7d8c62c"} May 25 01:02:59.319183 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:59.318931 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:02:59.319376 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:59.319353 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:02:59.319614 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:59.319588 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:02:59.319683 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:59.319657 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls podName:af475045-cb51-4e75-b2f5-5e68681538cc nodeName:}" failed. No retries permitted until 2026-05-25 01:03:03.319637611 +0000 UTC m=+43.212742247 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls") pod "dns-default-kghmq" (UID: "af475045-cb51-4e75-b2f5-5e68681538cc") : secret "dns-default-metrics-tls" not found May 25 01:02:59.320144 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:59.320048 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:02:59.320144 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:59.320067 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfdb6946-t24v4: secret "image-registry-tls" not found May 25 01:02:59.320144 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:59.320109 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls podName:a1bba914-4c0c-4d5a-bba1-476651b01f4c nodeName:}" failed. No retries permitted until 2026-05-25 01:03:03.320092971 +0000 UTC m=+43.213197615 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls") pod "image-registry-68dfdb6946-t24v4" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c") : secret "image-registry-tls" not found May 25 01:02:59.420331 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:59.420280 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:02:59.420502 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:59.420483 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:02:59.420568 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:02:59.420555 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert podName:5cb43ecb-16f8-46ea-9c92-4bf296452f7b nodeName:}" failed. No retries permitted until 2026-05-25 01:03:03.420537295 +0000 UTC m=+43.313641937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert") pod "ingress-canary-s9vfh" (UID: "5cb43ecb-16f8-46ea-9c92-4bf296452f7b") : secret "canary-serving-cert" not found May 25 01:02:59.886667 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:59.886627 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7h99h" event={"ID":"d5d4e155-ec75-4cbf-98ec-453388135cec","Type":"ContainerStarted","Data":"ed706f630495b5f4c3c1e8b3581cb5fd637d188329c350c3eafc18b6406d42a4"} May 25 01:02:59.915837 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:02:59.915777 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7h99h" podStartSLOduration=5.4209327720000005 podStartE2EDuration="38.915755116s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.354390357 +0000 UTC m=+3.247494987" lastFinishedPulling="2026-05-25 01:02:56.849212698 +0000 UTC m=+36.742317331" observedRunningTime="2026-05-25 01:02:59.914868026 +0000 UTC m=+39.807972718" watchObservedRunningTime="2026-05-25 01:02:59.915755116 +0000 UTC m=+39.808859770" May 25 01:03:03.357154 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:03.357100 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:03:03.357661 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:03.357189 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:03:03.357661 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:03.357287 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:03:03.357661 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:03.357314 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfdb6946-t24v4: secret "image-registry-tls" not found May 25 01:03:03.357661 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:03.357325 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:03:03.357661 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:03.357413 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls podName:a1bba914-4c0c-4d5a-bba1-476651b01f4c nodeName:}" failed. No retries permitted until 2026-05-25 01:03:11.357391594 +0000 UTC m=+51.250496244 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls") pod "image-registry-68dfdb6946-t24v4" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c") : secret "image-registry-tls" not found May 25 01:03:03.357661 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:03.357546 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls podName:af475045-cb51-4e75-b2f5-5e68681538cc nodeName:}" failed. No retries permitted until 2026-05-25 01:03:11.357531316 +0000 UTC m=+51.250635945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls") pod "dns-default-kghmq" (UID: "af475045-cb51-4e75-b2f5-5e68681538cc") : secret "dns-default-metrics-tls" not found May 25 01:03:03.457929 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:03.457895 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:03:03.458082 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:03.458061 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:03:03.458153 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:03.458135 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert podName:5cb43ecb-16f8-46ea-9c92-4bf296452f7b nodeName:}" failed. No retries permitted until 2026-05-25 01:03:11.458119317 +0000 UTC m=+51.351223962 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert") pod "ingress-canary-s9vfh" (UID: "5cb43ecb-16f8-46ea-9c92-4bf296452f7b") : secret "canary-serving-cert" not found May 25 01:03:04.898521 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:04.898466 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" event={"ID":"bcc93170-9e13-495e-b3af-7606f18697e1","Type":"ContainerStarted","Data":"003f608cde51128b16984f4d43e95363da7ba31cee19666707e209f61a910998"} May 25 01:03:04.899004 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:04.898709 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:03:04.899892 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:04.899872 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:03:04.900241 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:04.900222 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" event={"ID":"12ec03f5-f9ec-403b-bafe-e9d2814c4cb5","Type":"ContainerStarted","Data":"41102efc95dcd83335b206e1e9750f59d9f2749ad77113d3ef77ad49c68b058f"} May 25 01:03:04.901296 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:04.901276 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" event={"ID":"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf","Type":"ContainerStarted","Data":"282d87dfff6cfdc67ad34101cc0d9565f2f8c2eed2d77494c98632923f8d6e10"} May 25 01:03:04.922184 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:04.922140 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" podStartSLOduration=23.03539726 podStartE2EDuration="30.92212568s" podCreationTimestamp="2026-05-25 01:02:34 +0000 UTC" firstStartedPulling="2026-05-25 01:02:56.82557563 +0000 UTC m=+36.718680263" lastFinishedPulling="2026-05-25 01:03:04.712304051 +0000 UTC m=+44.605408683" observedRunningTime="2026-05-25 01:03:04.920926535 +0000 UTC m=+44.814031187" watchObservedRunningTime="2026-05-25 01:03:04.92212568 +0000 UTC m=+44.815230332" May 25 01:03:04.984959 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:04.984848 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" podStartSLOduration=23.089535665 podStartE2EDuration="30.984831933s" podCreationTimestamp="2026-05-25 01:02:34 +0000 UTC" firstStartedPulling="2026-05-25 01:02:56.825653189 +0000 UTC m=+36.718757833" lastFinishedPulling="2026-05-25 01:03:04.720949467 +0000 UTC m=+44.614054101" observedRunningTime="2026-05-25 01:03:04.983168492 +0000 UTC m=+44.876273146" watchObservedRunningTime="2026-05-25 01:03:04.984831933 +0000 UTC m=+44.877936584" May 25 01:03:07.909270 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:07.909225 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" event={"ID":"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf","Type":"ContainerStarted","Data":"d66f96db53d98e238c24a33d965f1ef51bb58a0dee8840e115b342de8b8006c1"} May 25 01:03:07.909270 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:07.909273 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" event={"ID":"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf","Type":"ContainerStarted","Data":"2d1f1e824203441d57d0498a09f29ae039a90e78fbccf66fc4dfeeab32217283"} May 25 01:03:07.929680 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:07.929631 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" podStartSLOduration=23.445398206 podStartE2EDuration="33.929617566s" podCreationTimestamp="2026-05-25 01:02:34 +0000 UTC" firstStartedPulling="2026-05-25 01:02:56.825614412 +0000 UTC m=+36.718719047" lastFinishedPulling="2026-05-25 01:03:07.309833775 +0000 UTC m=+47.202938407" observedRunningTime="2026-05-25 01:03:07.929289641 +0000 UTC m=+47.822394294" watchObservedRunningTime="2026-05-25 01:03:07.929617566 +0000 UTC m=+47.822722218" May 25 01:03:09.613181 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:09.613139 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:03:09.617182 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:09.617153 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/306748e0-bd1f-4d83-b4ae-7a35930030ba-original-pull-secret\") pod \"global-pull-secret-syncer-fzbpg\" (UID: \"306748e0-bd1f-4d83-b4ae-7a35930030ba\") " pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:03:09.805944 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:09.805903 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fzbpg" May 25 01:03:09.929882 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:09.929854 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fzbpg"] May 25 01:03:09.933020 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:03:09.932990 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod306748e0_bd1f_4d83_b4ae_7a35930030ba.slice/crio-38c84fb95b5beea65c2d21a89397fccabd03f93712492b91fe5f3c595d6a3a3d WatchSource:0}: Error finding container 38c84fb95b5beea65c2d21a89397fccabd03f93712492b91fe5f3c595d6a3a3d: Status 404 returned error can't find the container with id 38c84fb95b5beea65c2d21a89397fccabd03f93712492b91fe5f3c595d6a3a3d May 25 01:03:10.918843 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:10.918800 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzbpg" event={"ID":"306748e0-bd1f-4d83-b4ae-7a35930030ba","Type":"ContainerStarted","Data":"38c84fb95b5beea65c2d21a89397fccabd03f93712492b91fe5f3c595d6a3a3d"} May 25 01:03:11.428938 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:11.428895 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:03:11.429215 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:11.428984 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:03:11.429215 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:11.429052 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:03:11.429215 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:11.429093 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfdb6946-t24v4: secret "image-registry-tls" not found May 25 01:03:11.429215 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:11.429111 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:03:11.429215 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:11.429156 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls podName:a1bba914-4c0c-4d5a-bba1-476651b01f4c nodeName:}" failed. No retries permitted until 2026-05-25 01:03:27.429139772 +0000 UTC m=+67.322244401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls") pod "image-registry-68dfdb6946-t24v4" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c") : secret "image-registry-tls" not found May 25 01:03:11.429215 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:11.429174 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls podName:af475045-cb51-4e75-b2f5-5e68681538cc nodeName:}" failed. No retries permitted until 2026-05-25 01:03:27.429165447 +0000 UTC m=+67.322270077 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls") pod "dns-default-kghmq" (UID: "af475045-cb51-4e75-b2f5-5e68681538cc") : secret "dns-default-metrics-tls" not found May 25 01:03:11.529538 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:11.529494 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:03:11.529726 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:11.529653 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:03:11.529788 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:11.529731 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert podName:5cb43ecb-16f8-46ea-9c92-4bf296452f7b nodeName:}" failed. No retries permitted until 2026-05-25 01:03:27.529710092 +0000 UTC m=+67.422814734 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert") pod "ingress-canary-s9vfh" (UID: "5cb43ecb-16f8-46ea-9c92-4bf296452f7b") : secret "canary-serving-cert" not found May 25 01:03:14.928537 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:14.928496 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fzbpg" event={"ID":"306748e0-bd1f-4d83-b4ae-7a35930030ba","Type":"ContainerStarted","Data":"c800a80d8fc51d4cabe1ea4dea21b08c34947195efc659175d402a0aea0584e0"} May 25 01:03:14.944936 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:14.944887 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fzbpg" podStartSLOduration=33.861845165 podStartE2EDuration="37.944870439s" podCreationTimestamp="2026-05-25 01:02:37 +0000 UTC" firstStartedPulling="2026-05-25 01:03:09.934917558 +0000 UTC m=+49.828022200" lastFinishedPulling="2026-05-25 01:03:14.017942844 +0000 UTC m=+53.911047474" observedRunningTime="2026-05-25 01:03:14.94439179 +0000 UTC m=+54.837496445" watchObservedRunningTime="2026-05-25 01:03:14.944870439 +0000 UTC m=+54.837975090" May 25 01:03:21.865678 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:21.865649 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hqqzs" May 25 01:03:26.435695 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:26.435652 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:03:26.453797 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:26.453768 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 25 01:03:26.455938 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:26.455920 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 01:03:26.456064 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:26.456053 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs podName:67bcba76-518c-4f73-96f1-06614f83809a nodeName:}" failed. No retries permitted until 2026-05-25 01:04:30.456025906 +0000 UTC m=+130.349130543 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs") pod "network-metrics-daemon-rk8vg" (UID: "67bcba76-518c-4f73-96f1-06614f83809a") : secret "metrics-daemon-secret" not found May 25 01:03:26.537099 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:26.537070 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2r5j7\" (UniqueName: \"kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7\") pod \"network-check-target-p7l25\" (UID: \"bb056d63-5efc-4375-9448-ed8e8815abc7\") " pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:03:26.540102 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:26.540076 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 25 01:03:26.550351 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:26.550317 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 25 01:03:26.561699 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:26.561679 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r5j7\" (UniqueName: \"kubernetes.io/projected/bb056d63-5efc-4375-9448-ed8e8815abc7-kube-api-access-2r5j7\") pod \"network-check-target-p7l25\" (UID: \"bb056d63-5efc-4375-9448-ed8e8815abc7\") " pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:03:26.595357 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:26.595325 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2dmfc\"" May 25 01:03:26.603518 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:26.603493 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:03:26.733538 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:26.733498 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p7l25"] May 25 01:03:26.960980 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:26.960938 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p7l25" event={"ID":"bb056d63-5efc-4375-9448-ed8e8815abc7","Type":"ContainerStarted","Data":"7109f6029f695e1333f95fae80b2bb61dfc03fe3544481ecba37c310e22640b8"} May 25 01:03:27.443588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:27.443536 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:03:27.444058 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:27.443598 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:03:27.444058 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:27.443712 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:03:27.444058 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:27.443712 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:03:27.444058 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:27.443742 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfdb6946-t24v4: secret "image-registry-tls" not found May 25 01:03:27.444058 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:27.443786 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls podName:af475045-cb51-4e75-b2f5-5e68681538cc nodeName:}" failed. No retries permitted until 2026-05-25 01:03:59.44376641 +0000 UTC m=+99.336871043 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls") pod "dns-default-kghmq" (UID: "af475045-cb51-4e75-b2f5-5e68681538cc") : secret "dns-default-metrics-tls" not found May 25 01:03:27.444058 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:27.443805 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls podName:a1bba914-4c0c-4d5a-bba1-476651b01f4c nodeName:}" failed. No retries permitted until 2026-05-25 01:03:59.443796305 +0000 UTC m=+99.336900941 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls") pod "image-registry-68dfdb6946-t24v4" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c") : secret "image-registry-tls" not found May 25 01:03:27.544156 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:27.544115 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:03:27.544359 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:27.544341 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:03:27.544469 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:27.544449 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert podName:5cb43ecb-16f8-46ea-9c92-4bf296452f7b nodeName:}" failed. No retries permitted until 2026-05-25 01:03:59.544409702 +0000 UTC m=+99.437514347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert") pod "ingress-canary-s9vfh" (UID: "5cb43ecb-16f8-46ea-9c92-4bf296452f7b") : secret "canary-serving-cert" not found May 25 01:03:29.969557 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:29.969517 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p7l25" event={"ID":"bb056d63-5efc-4375-9448-ed8e8815abc7","Type":"ContainerStarted","Data":"72c9a883b170772801bd4b53ffdd2c0a75d6988ee6bebaabea0d5fe26818ec21"} May 25 01:03:29.969961 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:29.969775 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:03:29.987092 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:29.987043 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p7l25" podStartSLOduration=65.962438271 podStartE2EDuration="1m8.987030532s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:03:26.734507362 +0000 UTC m=+66.627612008" lastFinishedPulling="2026-05-25 01:03:29.759099637 +0000 UTC m=+69.652204269" observedRunningTime="2026-05-25 01:03:29.986272039 +0000 UTC m=+69.879376691" watchObservedRunningTime="2026-05-25 01:03:29.987030532 +0000 UTC m=+69.880135185" May 25 01:03:59.482940 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:59.482886 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:03:59.482940 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:59.482949 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:03:59.483554 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:59.483043 2563 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 25 01:03:59.483554 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:59.483052 2563 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 25 01:03:59.483554 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:59.483079 2563 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68dfdb6946-t24v4: secret "image-registry-tls" not found May 25 01:03:59.483554 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:59.483096 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls podName:af475045-cb51-4e75-b2f5-5e68681538cc nodeName:}" failed. No retries permitted until 2026-05-25 01:05:03.483080892 +0000 UTC m=+163.376185522 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls") pod "dns-default-kghmq" (UID: "af475045-cb51-4e75-b2f5-5e68681538cc") : secret "dns-default-metrics-tls" not found May 25 01:03:59.483554 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:59.483144 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls podName:a1bba914-4c0c-4d5a-bba1-476651b01f4c nodeName:}" failed. No retries permitted until 2026-05-25 01:05:03.483126847 +0000 UTC m=+163.376231480 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls") pod "image-registry-68dfdb6946-t24v4" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c") : secret "image-registry-tls" not found May 25 01:03:59.583532 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:03:59.583491 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:03:59.583692 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:59.583632 2563 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 25 01:03:59.583731 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:03:59.583700 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert podName:5cb43ecb-16f8-46ea-9c92-4bf296452f7b nodeName:}" failed. No retries permitted until 2026-05-25 01:05:03.583684499 +0000 UTC m=+163.476789130 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert") pod "ingress-canary-s9vfh" (UID: "5cb43ecb-16f8-46ea-9c92-4bf296452f7b") : secret "canary-serving-cert" not found May 25 01:04:00.974611 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:00.974581 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p7l25" May 25 01:04:28.281538 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:28.281501 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nbqnt_49823412-f0ef-4ded-9c2a-8dbeb2a864f0/dns-node-resolver/0.log" May 25 01:04:29.278544 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:29.278513 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g5mj4_db15759d-02bf-4fe6-999a-cc6846b89e74/node-ca/0.log" May 25 01:04:30.520133 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:30.520094 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:04:30.520563 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:04:30.520220 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 25 01:04:30.520563 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:04:30.520286 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs podName:67bcba76-518c-4f73-96f1-06614f83809a nodeName:}" failed. No retries permitted until 2026-05-25 01:06:32.520272045 +0000 UTC m=+252.413376675 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs") pod "network-metrics-daemon-rk8vg" (UID: "67bcba76-518c-4f73-96f1-06614f83809a") : secret "metrics-daemon-secret" not found May 25 01:04:49.884189 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.884159 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9mvh7"] May 25 01:04:49.887051 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.887036 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:49.890967 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.889560 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 25 01:04:49.890967 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.890631 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sv4c5\"" May 25 01:04:49.890967 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.890901 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 25 01:04:49.890967 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.890931 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 25 01:04:49.891229 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.891123 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 25 01:04:49.908630 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.908582 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9mvh7"] May 25 01:04:49.963558 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.963524 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a4cd995-04f9-47c4-bb0f-9151c7590232-data-volume\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:49.963558 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.963559 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a4cd995-04f9-47c4-bb0f-9151c7590232-crio-socket\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:49.963776 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.963603 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6n5cw\" (UniqueName: \"kubernetes.io/projected/4a4cd995-04f9-47c4-bb0f-9151c7590232-kube-api-access-6n5cw\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:49.963776 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.963648 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a4cd995-04f9-47c4-bb0f-9151c7590232-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:49.963776 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:49.963708 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a4cd995-04f9-47c4-bb0f-9151c7590232-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.064603 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.064564 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a4cd995-04f9-47c4-bb0f-9151c7590232-data-volume\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.064603 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.064603 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a4cd995-04f9-47c4-bb0f-9151c7590232-crio-socket\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.064834 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.064639 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6n5cw\" (UniqueName: \"kubernetes.io/projected/4a4cd995-04f9-47c4-bb0f-9151c7590232-kube-api-access-6n5cw\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.064834 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.064666 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a4cd995-04f9-47c4-bb0f-9151c7590232-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.064834 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.064709 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4a4cd995-04f9-47c4-bb0f-9151c7590232-crio-socket\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.064834 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.064716 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a4cd995-04f9-47c4-bb0f-9151c7590232-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.065036 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.064910 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4a4cd995-04f9-47c4-bb0f-9151c7590232-data-volume\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.065131 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.065114 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4a4cd995-04f9-47c4-bb0f-9151c7590232-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.067138 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.067117 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4a4cd995-04f9-47c4-bb0f-9151c7590232-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.076208 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.076185 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6n5cw\" (UniqueName: \"kubernetes.io/projected/4a4cd995-04f9-47c4-bb0f-9151c7590232-kube-api-access-6n5cw\") pod \"insights-runtime-extractor-9mvh7\" (UID: \"4a4cd995-04f9-47c4-bb0f-9151c7590232\") " pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.198968 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.198926 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9mvh7" May 25 01:04:50.325904 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:50.325848 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9mvh7"] May 25 01:04:50.329541 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:04:50.329512 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a4cd995_04f9_47c4_bb0f_9151c7590232.slice/crio-a9717a22b961dbb91ec660d5ced363767870b1765c4de95ff2d1b60bb6909b96 WatchSource:0}: Error finding container a9717a22b961dbb91ec660d5ced363767870b1765c4de95ff2d1b60bb6909b96: Status 404 returned error can't find the container with id a9717a22b961dbb91ec660d5ced363767870b1765c4de95ff2d1b60bb6909b96 May 25 01:04:51.162231 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:51.162194 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mvh7" event={"ID":"4a4cd995-04f9-47c4-bb0f-9151c7590232","Type":"ContainerStarted","Data":"b80ce0cea21809ce020ff42ede88d9ff046d3db909c9d125dcb26b0780f57ad6"} May 25 01:04:51.162231 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:51.162229 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mvh7" event={"ID":"4a4cd995-04f9-47c4-bb0f-9151c7590232","Type":"ContainerStarted","Data":"ebf6df949aaa74aaebc8aabd7c131e86cdfb162ce35fb530e497f3fd6f99b094"} May 25 01:04:51.162231 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:51.162238 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mvh7" event={"ID":"4a4cd995-04f9-47c4-bb0f-9151c7590232","Type":"ContainerStarted","Data":"a9717a22b961dbb91ec660d5ced363767870b1765c4de95ff2d1b60bb6909b96"} May 25 01:04:53.173633 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:53.173598 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9mvh7" event={"ID":"4a4cd995-04f9-47c4-bb0f-9151c7590232","Type":"ContainerStarted","Data":"81ee99e72ac4d8df9d9580bbeceaf0be0cc0e108f41d405840d540ee8474d385"} May 25 01:04:53.194342 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:53.194291 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-9mvh7" podStartSLOduration=2.447111225 podStartE2EDuration="4.194279469s" podCreationTimestamp="2026-05-25 01:04:49 +0000 UTC" firstStartedPulling="2026-05-25 01:04:50.402641603 +0000 UTC m=+150.295746234" lastFinishedPulling="2026-05-25 01:04:52.14980984 +0000 UTC m=+152.042914478" observedRunningTime="2026-05-25 01:04:53.192875048 +0000 UTC m=+153.085979701" watchObservedRunningTime="2026-05-25 01:04:53.194279469 +0000 UTC m=+153.087384121" May 25 01:04:58.542709 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:04:58.542651 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" podUID="a1bba914-4c0c-4d5a-bba1-476651b01f4c" May 25 01:04:58.624199 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:04:58.624160 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kghmq" podUID="af475045-cb51-4e75-b2f5-5e68681538cc" May 25 01:04:58.634347 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:04:58.634321 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-s9vfh" podUID="5cb43ecb-16f8-46ea-9c92-4bf296452f7b" May 25 01:04:58.698961 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:04:58.698925 2563 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-rk8vg" podUID="67bcba76-518c-4f73-96f1-06614f83809a" May 25 01:04:59.188398 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:59.188367 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:04:59.188588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:04:59.188455 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kghmq" May 25 01:05:02.568858 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.568777 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fb4h9"] May 25 01:05:02.571810 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.571794 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.574731 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.574687 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 25 01:05:02.574886 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.574827 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 25 01:05:02.574948 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.574910 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 25 01:05:02.574948 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.574910 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 25 01:05:02.575598 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.575576 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 25 01:05:02.575598 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.575590 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-npnnj\"" May 25 01:05:02.575739 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.575643 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 25 01:05:02.665534 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.665492 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-wtmp\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.665740 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.665553 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-root\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.665740 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.665652 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-tls\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.665740 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.665696 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-sys\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.665740 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.665730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-textfile\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.665953 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.665782 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-metrics-client-ca\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.665953 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.665814 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.665953 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.665845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-accelerators-collector-config\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.665953 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.665879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcz9r\" (UniqueName: \"kubernetes.io/projected/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-kube-api-access-rcz9r\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766517 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766475 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-accelerators-collector-config\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766517 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766520 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcz9r\" (UniqueName: \"kubernetes.io/projected/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-kube-api-access-rcz9r\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766761 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766580 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-wtmp\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766761 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766631 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-root\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766761 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766682 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-tls\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766761 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766706 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-sys\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766761 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766728 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-textfile\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766993 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766775 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-metrics-client-ca\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766993 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766777 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-wtmp\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766993 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766803 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766993 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766811 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-root\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.766993 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.766824 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-sys\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.767210 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.767088 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-accelerators-collector-config\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.767210 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.767097 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-textfile\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.767306 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.767229 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-metrics-client-ca\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.769232 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.769210 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.769366 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.769347 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-node-exporter-tls\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.776981 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.776959 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcz9r\" (UniqueName: \"kubernetes.io/projected/d619d1c7-c3ec-43be-80b5-2952a5e7cdf1-kube-api-access-rcz9r\") pod \"node-exporter-fb4h9\" (UID: \"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1\") " pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.880631 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:02.880553 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fb4h9" May 25 01:05:02.889015 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:05:02.888986 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd619d1c7_c3ec_43be_80b5_2952a5e7cdf1.slice/crio-92319a886946b5944feb8a006710809ce679bbe27fa1c842093013ebb2835b30 WatchSource:0}: Error finding container 92319a886946b5944feb8a006710809ce679bbe27fa1c842093013ebb2835b30: Status 404 returned error can't find the container with id 92319a886946b5944feb8a006710809ce679bbe27fa1c842093013ebb2835b30 May 25 01:05:03.202207 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.202161 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb4h9" event={"ID":"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1","Type":"ContainerStarted","Data":"92319a886946b5944feb8a006710809ce679bbe27fa1c842093013ebb2835b30"} May 25 01:05:03.574839 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.574743 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:05:03.574839 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.574800 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:05:03.577896 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.577872 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/af475045-cb51-4e75-b2f5-5e68681538cc-metrics-tls\") pod \"dns-default-kghmq\" (UID: \"af475045-cb51-4e75-b2f5-5e68681538cc\") " pod="openshift-dns/dns-default-kghmq" May 25 01:05:03.578063 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.577954 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"image-registry-68dfdb6946-t24v4\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:05:03.675314 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.675284 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:05:03.677718 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.677690 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5cb43ecb-16f8-46ea-9c92-4bf296452f7b-cert\") pod \"ingress-canary-s9vfh\" (UID: \"5cb43ecb-16f8-46ea-9c92-4bf296452f7b\") " pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:05:03.691923 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.691902 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jl9qq\"" May 25 01:05:03.692618 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.692602 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bftwk\"" May 25 01:05:03.699991 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.699977 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:05:03.700083 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.700068 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kghmq" May 25 01:05:03.846553 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.846427 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68dfdb6946-t24v4"] May 25 01:05:03.850147 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:05:03.850112 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1bba914_4c0c_4d5a_bba1_476651b01f4c.slice/crio-ba0a75356ebc99c77d8d8aef1b08d77c57c43f527e9aca9d2fdb44c1eaca1a61 WatchSource:0}: Error finding container ba0a75356ebc99c77d8d8aef1b08d77c57c43f527e9aca9d2fdb44c1eaca1a61: Status 404 returned error can't find the container with id ba0a75356ebc99c77d8d8aef1b08d77c57c43f527e9aca9d2fdb44c1eaca1a61 May 25 01:05:03.866864 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:03.866841 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kghmq"] May 25 01:05:03.925369 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:05:03.925341 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf475045_cb51_4e75_b2f5_5e68681538cc.slice/crio-2fabdf7a5297f658c43e187406db3f57ab9e8da714da2c8ef7734d984b0cab20 WatchSource:0}: Error finding container 2fabdf7a5297f658c43e187406db3f57ab9e8da714da2c8ef7734d984b0cab20: Status 404 returned error can't find the container with id 2fabdf7a5297f658c43e187406db3f57ab9e8da714da2c8ef7734d984b0cab20 May 25 01:05:04.205852 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:04.205820 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" event={"ID":"a1bba914-4c0c-4d5a-bba1-476651b01f4c","Type":"ContainerStarted","Data":"27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede"} May 25 01:05:04.205852 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:04.205856 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" event={"ID":"a1bba914-4c0c-4d5a-bba1-476651b01f4c","Type":"ContainerStarted","Data":"ba0a75356ebc99c77d8d8aef1b08d77c57c43f527e9aca9d2fdb44c1eaca1a61"} May 25 01:05:04.206081 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:04.205985 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:05:04.206917 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:04.206881 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kghmq" event={"ID":"af475045-cb51-4e75-b2f5-5e68681538cc","Type":"ContainerStarted","Data":"2fabdf7a5297f658c43e187406db3f57ab9e8da714da2c8ef7734d984b0cab20"} May 25 01:05:04.208298 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:04.208274 2563 generic.go:358] "Generic (PLEG): container finished" podID="d619d1c7-c3ec-43be-80b5-2952a5e7cdf1" containerID="7d9f69672154ec1042f8bb4fa4377d1ec09890e5dcf226489e8f9d21edb9c518" exitCode=0 May 25 01:05:04.208404 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:04.208303 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb4h9" event={"ID":"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1","Type":"ContainerDied","Data":"7d9f69672154ec1042f8bb4fa4377d1ec09890e5dcf226489e8f9d21edb9c518"} May 25 01:05:04.226452 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:04.226385 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" podStartSLOduration=163.226371388 podStartE2EDuration="2m43.226371388s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:05:04.225022581 +0000 UTC m=+164.118127228" watchObservedRunningTime="2026-05-25 01:05:04.226371388 +0000 UTC m=+164.119476101" May 25 01:05:04.900095 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:04.900034 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" podUID="bcc93170-9e13-495e-b3af-7606f18697e1" containerName="acm-agent" probeResult="failure" output="Get \"http://10.132.0.7:8000/readyz\": dial tcp 10.132.0.7:8000: connect: connection refused" May 25 01:05:05.216186 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:05.216143 2563 generic.go:358] "Generic (PLEG): container finished" podID="12ec03f5-f9ec-403b-bafe-e9d2814c4cb5" containerID="41102efc95dcd83335b206e1e9750f59d9f2749ad77113d3ef77ad49c68b058f" exitCode=255 May 25 01:05:05.216317 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:05.216226 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" event={"ID":"12ec03f5-f9ec-403b-bafe-e9d2814c4cb5","Type":"ContainerDied","Data":"41102efc95dcd83335b206e1e9750f59d9f2749ad77113d3ef77ad49c68b058f"} May 25 01:05:05.216671 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:05.216638 2563 scope.go:117] "RemoveContainer" containerID="41102efc95dcd83335b206e1e9750f59d9f2749ad77113d3ef77ad49c68b058f" May 25 01:05:05.218070 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:05.218041 2563 generic.go:358] "Generic (PLEG): container finished" podID="bcc93170-9e13-495e-b3af-7606f18697e1" containerID="003f608cde51128b16984f4d43e95363da7ba31cee19666707e209f61a910998" exitCode=1 May 25 01:05:05.218178 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:05.218093 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" event={"ID":"bcc93170-9e13-495e-b3af-7606f18697e1","Type":"ContainerDied","Data":"003f608cde51128b16984f4d43e95363da7ba31cee19666707e209f61a910998"} May 25 01:05:05.218465 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:05.218427 2563 scope.go:117] "RemoveContainer" containerID="003f608cde51128b16984f4d43e95363da7ba31cee19666707e209f61a910998" May 25 01:05:05.220114 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:05.220092 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb4h9" event={"ID":"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1","Type":"ContainerStarted","Data":"0555415fb46b5a41ea98986d60431235726c9826755cd207ef8336f4383b2970"} May 25 01:05:05.220203 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:05.220124 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fb4h9" event={"ID":"d619d1c7-c3ec-43be-80b5-2952a5e7cdf1","Type":"ContainerStarted","Data":"1d24f582e74bc3d1451b739d29e9d44a2986e6248724161b41144839c6c5527c"} May 25 01:05:05.274220 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:05.274175 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fb4h9" podStartSLOduration=2.468475003 podStartE2EDuration="3.274159809s" podCreationTimestamp="2026-05-25 01:05:02 +0000 UTC" firstStartedPulling="2026-05-25 01:05:02.891155312 +0000 UTC m=+162.784259946" lastFinishedPulling="2026-05-25 01:05:03.696840123 +0000 UTC m=+163.589944752" observedRunningTime="2026-05-25 01:05:05.272873062 +0000 UTC m=+165.165977715" watchObservedRunningTime="2026-05-25 01:05:05.274159809 +0000 UTC m=+165.167264461" May 25 01:05:05.867546 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:05.867508 2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:05:05.904680 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:05.904654 2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" May 25 01:05:06.228151 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:06.228109 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kghmq" event={"ID":"af475045-cb51-4e75-b2f5-5e68681538cc","Type":"ContainerStarted","Data":"da0893a8b16197d3a12b7aacdb374cf0b1059f0a1b4df37ff990dc0a0778c1ae"} May 25 01:05:06.228151 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:06.228149 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kghmq" event={"ID":"af475045-cb51-4e75-b2f5-5e68681538cc","Type":"ContainerStarted","Data":"f331f8040bcc2b012ecb326c10b062742e4f4346ac9e094425febec4ad0f0c49"} May 25 01:05:06.228396 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:06.228234 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kghmq" May 25 01:05:06.229517 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:06.229493 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-5647cc4586-wtzst" event={"ID":"12ec03f5-f9ec-403b-bafe-e9d2814c4cb5","Type":"ContainerStarted","Data":"f9fef5e2e5629b8163545d99caaa483c075a3a5a2a743fab18aa8872853198dd"} May 25 01:05:06.230834 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:06.230812 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" event={"ID":"bcc93170-9e13-495e-b3af-7606f18697e1","Type":"ContainerStarted","Data":"2f88bf737000430d96310326e3c0871b32b57730a49c379519e15f8a9b12aa91"} May 25 01:05:06.231185 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:06.231168 2563 status_manager.go:355] "Container readiness changed for unknown container" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" containerID="cri-o://003f608cde51128b16984f4d43e95363da7ba31cee19666707e209f61a910998" May 25 01:05:06.231256 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:06.231186 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:05:06.247078 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:06.247032 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kghmq" podStartSLOduration=129.980414976 podStartE2EDuration="2m11.247019444s" podCreationTimestamp="2026-05-25 01:02:55 +0000 UTC" firstStartedPulling="2026-05-25 01:05:03.927372172 +0000 UTC m=+163.820476815" lastFinishedPulling="2026-05-25 01:05:05.193976649 +0000 UTC m=+165.087081283" observedRunningTime="2026-05-25 01:05:06.245779583 +0000 UTC m=+166.138884258" watchObservedRunningTime="2026-05-25 01:05:06.247019444 +0000 UTC m=+166.140124095" May 25 01:05:07.233578 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:07.233545 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:05:07.234546 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:07.234523 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b76cb4698-fpmgb" May 25 01:05:13.681339 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:13.681297 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:05:13.681339 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:13.681298 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:05:13.683970 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:13.683952 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-7rtn5\"" May 25 01:05:13.691830 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:13.691808 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s9vfh" May 25 01:05:13.819694 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:13.819658 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s9vfh"] May 25 01:05:13.823149 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:05:13.823123 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cb43ecb_16f8_46ea_9c92_4bf296452f7b.slice/crio-e3043304dc92b43f0fd30867f01bc9a2bdb2fc67c39298ba70a4cae4f4dfe33e WatchSource:0}: Error finding container e3043304dc92b43f0fd30867f01bc9a2bdb2fc67c39298ba70a4cae4f4dfe33e: Status 404 returned error can't find the container with id e3043304dc92b43f0fd30867f01bc9a2bdb2fc67c39298ba70a4cae4f4dfe33e May 25 01:05:14.252249 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:14.252207 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s9vfh" event={"ID":"5cb43ecb-16f8-46ea-9c92-4bf296452f7b","Type":"ContainerStarted","Data":"e3043304dc92b43f0fd30867f01bc9a2bdb2fc67c39298ba70a4cae4f4dfe33e"} May 25 01:05:16.236272 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:16.236246 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kghmq" May 25 01:05:16.258594 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:16.258560 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s9vfh" event={"ID":"5cb43ecb-16f8-46ea-9c92-4bf296452f7b","Type":"ContainerStarted","Data":"1f4fb3874ff21a9fbfdc7e7d3a8bc5cbe1cd1a9610acc40ed4cee1d313fbd48a"} May 25 01:05:16.282382 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:16.282333 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s9vfh" podStartSLOduration=139.844037648 podStartE2EDuration="2m21.282318771s" podCreationTimestamp="2026-05-25 01:02:55 +0000 UTC" firstStartedPulling="2026-05-25 01:05:13.82519172 +0000 UTC m=+173.718296350" lastFinishedPulling="2026-05-25 01:05:15.26347284 +0000 UTC m=+175.156577473" observedRunningTime="2026-05-25 01:05:16.28158383 +0000 UTC m=+176.174688485" watchObservedRunningTime="2026-05-25 01:05:16.282318771 +0000 UTC m=+176.175423422" May 25 01:05:22.040875 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:22.040837 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68dfdb6946-t24v4"] May 25 01:05:22.044896 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:22.044862 2563 patch_prober.go:28] interesting pod/image-registry-68dfdb6946-t24v4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} May 25 01:05:22.045185 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:22.044921 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" podUID="a1bba914-4c0c-4d5a-bba1-476651b01f4c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" May 25 01:05:25.896840 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:25.896797 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" podUID="ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 25 01:05:32.046002 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:32.045971 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:05:35.897031 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:35.896991 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" podUID="ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 25 01:05:37.958942 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:37.958915 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kghmq_af475045-cb51-4e75-b2f5-5e68681538cc/dns/0.log" May 25 01:05:37.966631 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:37.966614 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kghmq_af475045-cb51-4e75-b2f5-5e68681538cc/kube-rbac-proxy/0.log" May 25 01:05:38.260686 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:38.260610 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nbqnt_49823412-f0ef-4ded-9c2a-8dbeb2a864f0/dns-node-resolver/0.log" May 25 01:05:45.896927 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:45.896880 2563 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" podUID="ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 25 01:05:45.897519 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:45.896957 2563 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" May 25 01:05:45.897669 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:45.897635 2563 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"d66f96db53d98e238c24a33d965f1ef51bb58a0dee8840e115b342de8b8006c1"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 25 01:05:45.897732 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:45.897699 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" podUID="ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf" containerName="service-proxy" containerID="cri-o://d66f96db53d98e238c24a33d965f1ef51bb58a0dee8840e115b342de8b8006c1" gracePeriod=30 May 25 01:05:46.339263 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:46.339174 2563 generic.go:358] "Generic (PLEG): container finished" podID="ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf" containerID="d66f96db53d98e238c24a33d965f1ef51bb58a0dee8840e115b342de8b8006c1" exitCode=2 May 25 01:05:46.339263 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:46.339249 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" event={"ID":"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf","Type":"ContainerDied","Data":"d66f96db53d98e238c24a33d965f1ef51bb58a0dee8840e115b342de8b8006c1"} May 25 01:05:46.339475 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:46.339286 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6fd64c47c9-5t94d" event={"ID":"ab4e6bb4-a04e-448b-a05c-c5f6b4fa54cf","Type":"ContainerStarted","Data":"3e1f87c75883ddee5bee74e7221abdb821b45af79ca530e94fe106104d8ad530"} May 25 01:05:47.059841 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.059805 2563 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" podUID="a1bba914-4c0c-4d5a-bba1-476651b01f4c" containerName="registry" containerID="cri-o://27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede" gracePeriod=30 May 25 01:05:47.310359 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.310306 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:05:47.342717 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.342686 2563 generic.go:358] "Generic (PLEG): container finished" podID="a1bba914-4c0c-4d5a-bba1-476651b01f4c" containerID="27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede" exitCode=0 May 25 01:05:47.342907 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.342731 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" event={"ID":"a1bba914-4c0c-4d5a-bba1-476651b01f4c","Type":"ContainerDied","Data":"27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede"} May 25 01:05:47.342907 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.342763 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" event={"ID":"a1bba914-4c0c-4d5a-bba1-476651b01f4c","Type":"ContainerDied","Data":"ba0a75356ebc99c77d8d8aef1b08d77c57c43f527e9aca9d2fdb44c1eaca1a61"} May 25 01:05:47.342907 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.342782 2563 scope.go:117] "RemoveContainer" containerID="27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede" May 25 01:05:47.342907 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.342799 2563 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68dfdb6946-t24v4" May 25 01:05:47.352749 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.352659 2563 scope.go:117] "RemoveContainer" containerID="27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede" May 25 01:05:47.353224 ip-10-0-141-154 kubenswrapper[2563]: E0525 01:05:47.353129 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede\": container with ID starting with 27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede not found: ID does not exist" containerID="27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede" May 25 01:05:47.353224 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.353168 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede"} err="failed to get container status \"27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede\": rpc error: code = NotFound desc = could not find container \"27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede\": container with ID starting with 27325976755f63bf948af01fbd75d762a8eae3a8b604d31d501046f6665e3ede not found: ID does not exist" May 25 01:05:47.414054 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.414024 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xj9f2\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-kube-api-access-xj9f2\") pod \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " May 25 01:05:47.414256 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.414059 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-image-registry-private-configuration\") pod \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " May 25 01:05:47.414256 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.414082 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") pod \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " May 25 01:05:47.414256 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.414099 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-installation-pull-secrets\") pod \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " May 25 01:05:47.414256 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.414123 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1bba914-4c0c-4d5a-bba1-476651b01f4c-ca-trust-extracted\") pod \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " May 25 01:05:47.414256 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.414181 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-trusted-ca\") pod \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " May 25 01:05:47.414256 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.414236 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-certificates\") pod \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " May 25 01:05:47.414598 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.414299 2563 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-bound-sa-token\") pod \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\" (UID: \"a1bba914-4c0c-4d5a-bba1-476651b01f4c\") " May 25 01:05:47.414877 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.414808 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a1bba914-4c0c-4d5a-bba1-476651b01f4c" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 01:05:47.415167 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.414824 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a1bba914-4c0c-4d5a-bba1-476651b01f4c" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 25 01:05:47.416872 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.416842 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-kube-api-access-xj9f2" (OuterVolumeSpecName: "kube-api-access-xj9f2") pod "a1bba914-4c0c-4d5a-bba1-476651b01f4c" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c"). InnerVolumeSpecName "kube-api-access-xj9f2". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 01:05:47.416985 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.416944 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a1bba914-4c0c-4d5a-bba1-476651b01f4c" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:05:47.416985 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.416949 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a1bba914-4c0c-4d5a-bba1-476651b01f4c" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 01:05:47.417230 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.417197 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a1bba914-4c0c-4d5a-bba1-476651b01f4c" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 25 01:05:47.417281 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.417262 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a1bba914-4c0c-4d5a-bba1-476651b01f4c" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 25 01:05:47.423028 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.423004 2563 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1bba914-4c0c-4d5a-bba1-476651b01f4c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a1bba914-4c0c-4d5a-bba1-476651b01f4c" (UID: "a1bba914-4c0c-4d5a-bba1-476651b01f4c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 25 01:05:47.515784 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.515746 2563 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-bound-sa-token\") on node \"ip-10-0-141-154.ec2.internal\" DevicePath \"\"" May 25 01:05:47.515784 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.515776 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xj9f2\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-kube-api-access-xj9f2\") on node \"ip-10-0-141-154.ec2.internal\" DevicePath \"\"" May 25 01:05:47.515784 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.515786 2563 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-image-registry-private-configuration\") on node \"ip-10-0-141-154.ec2.internal\" DevicePath \"\"" May 25 01:05:47.516005 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.515797 2563 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-tls\") on node \"ip-10-0-141-154.ec2.internal\" DevicePath \"\"" May 25 01:05:47.516005 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.515808 2563 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a1bba914-4c0c-4d5a-bba1-476651b01f4c-installation-pull-secrets\") on node \"ip-10-0-141-154.ec2.internal\" DevicePath \"\"" May 25 01:05:47.516005 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.515818 2563 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a1bba914-4c0c-4d5a-bba1-476651b01f4c-ca-trust-extracted\") on node \"ip-10-0-141-154.ec2.internal\" DevicePath \"\"" May 25 01:05:47.516005 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.515826 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-trusted-ca\") on node \"ip-10-0-141-154.ec2.internal\" DevicePath \"\"" May 25 01:05:47.516005 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.515835 2563 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a1bba914-4c0c-4d5a-bba1-476651b01f4c-registry-certificates\") on node \"ip-10-0-141-154.ec2.internal\" DevicePath \"\"" May 25 01:05:47.664054 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.664023 2563 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68dfdb6946-t24v4"] May 25 01:05:47.668676 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:47.668653 2563 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68dfdb6946-t24v4"] May 25 01:05:48.688005 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:05:48.687965 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1bba914-4c0c-4d5a-bba1-476651b01f4c" path="/var/lib/kubelet/pods/a1bba914-4c0c-4d5a-bba1-476651b01f4c/volumes" May 25 01:06:32.540701 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:06:32.540599 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:06:32.543012 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:06:32.542981 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/67bcba76-518c-4f73-96f1-06614f83809a-metrics-certs\") pod \"network-metrics-daemon-rk8vg\" (UID: \"67bcba76-518c-4f73-96f1-06614f83809a\") " pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:06:32.584614 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:06:32.584584 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-657vv\"" May 25 01:06:32.592674 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:06:32.592653 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rk8vg" May 25 01:06:32.721856 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:06:32.721826 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rk8vg"] May 25 01:06:32.725377 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:06:32.725347 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67bcba76_518c_4f73_96f1_06614f83809a.slice/crio-807ffc962059000d12c68a6b5051d38887b9182c455e476f3a39d6141c617a23 WatchSource:0}: Error finding container 807ffc962059000d12c68a6b5051d38887b9182c455e476f3a39d6141c617a23: Status 404 returned error can't find the container with id 807ffc962059000d12c68a6b5051d38887b9182c455e476f3a39d6141c617a23 May 25 01:06:33.464310 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:06:33.464271 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rk8vg" event={"ID":"67bcba76-518c-4f73-96f1-06614f83809a","Type":"ContainerStarted","Data":"807ffc962059000d12c68a6b5051d38887b9182c455e476f3a39d6141c617a23"} May 25 01:06:34.468802 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:06:34.468768 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rk8vg" event={"ID":"67bcba76-518c-4f73-96f1-06614f83809a","Type":"ContainerStarted","Data":"e4e05d9a17f7346b8ed6b5c4d76e77b52fdb37328083bd4fc0c5c3b4e5777675"} May 25 01:06:34.468802 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:06:34.468804 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rk8vg" event={"ID":"67bcba76-518c-4f73-96f1-06614f83809a","Type":"ContainerStarted","Data":"44c4c74102a0d5ef30252a532dc43c8f780d1cde4dee91462eca7fad181aa6d5"} May 25 01:06:34.490607 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:06:34.490554 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rk8vg" podStartSLOduration=252.610045194 podStartE2EDuration="4m13.490535643s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:06:32.727188841 +0000 UTC m=+252.620293471" lastFinishedPulling="2026-05-25 01:06:33.607679287 +0000 UTC m=+253.500783920" observedRunningTime="2026-05-25 01:06:34.489584242 +0000 UTC m=+254.382688892" watchObservedRunningTime="2026-05-25 01:06:34.490535643 +0000 UTC m=+254.383640296" May 25 01:07:20.627450 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:07:20.627393 2563 kubelet.go:1628] "Image garbage collection succeeded" May 25 01:08:16.795772 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.795689 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-mpzwg"] May 25 01:08:16.796197 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.795954 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1bba914-4c0c-4d5a-bba1-476651b01f4c" containerName="registry" May 25 01:08:16.796197 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.795968 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1bba914-4c0c-4d5a-bba1-476651b01f4c" containerName="registry" May 25 01:08:16.796197 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.796008 2563 memory_manager.go:356] "RemoveStaleState removing state" podUID="a1bba914-4c0c-4d5a-bba1-476651b01f4c" containerName="registry" May 25 01:08:16.798629 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.798614 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-mpzwg" May 25 01:08:16.800800 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.800776 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" May 25 01:08:16.801593 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.801576 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" May 25 01:08:16.801658 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.801576 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jp5p2\"" May 25 01:08:16.807572 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.807548 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-mpzwg"] May 25 01:08:16.874040 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.873997 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7b57591-ed84-4b06-bc91-59a10dac7590-bound-sa-token\") pod \"cert-manager-79c8d999ff-mpzwg\" (UID: \"a7b57591-ed84-4b06-bc91-59a10dac7590\") " pod="cert-manager/cert-manager-79c8d999ff-mpzwg" May 25 01:08:16.874221 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.874051 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgm7m\" (UniqueName: \"kubernetes.io/projected/a7b57591-ed84-4b06-bc91-59a10dac7590-kube-api-access-lgm7m\") pod \"cert-manager-79c8d999ff-mpzwg\" (UID: \"a7b57591-ed84-4b06-bc91-59a10dac7590\") " pod="cert-manager/cert-manager-79c8d999ff-mpzwg" May 25 01:08:16.975320 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.975276 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7b57591-ed84-4b06-bc91-59a10dac7590-bound-sa-token\") pod \"cert-manager-79c8d999ff-mpzwg\" (UID: \"a7b57591-ed84-4b06-bc91-59a10dac7590\") " pod="cert-manager/cert-manager-79c8d999ff-mpzwg" May 25 01:08:16.975501 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.975337 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lgm7m\" (UniqueName: \"kubernetes.io/projected/a7b57591-ed84-4b06-bc91-59a10dac7590-kube-api-access-lgm7m\") pod \"cert-manager-79c8d999ff-mpzwg\" (UID: \"a7b57591-ed84-4b06-bc91-59a10dac7590\") " pod="cert-manager/cert-manager-79c8d999ff-mpzwg" May 25 01:08:16.983086 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.983049 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7b57591-ed84-4b06-bc91-59a10dac7590-bound-sa-token\") pod \"cert-manager-79c8d999ff-mpzwg\" (UID: \"a7b57591-ed84-4b06-bc91-59a10dac7590\") " pod="cert-manager/cert-manager-79c8d999ff-mpzwg" May 25 01:08:16.983210 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:16.983165 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgm7m\" (UniqueName: \"kubernetes.io/projected/a7b57591-ed84-4b06-bc91-59a10dac7590-kube-api-access-lgm7m\") pod \"cert-manager-79c8d999ff-mpzwg\" (UID: \"a7b57591-ed84-4b06-bc91-59a10dac7590\") " pod="cert-manager/cert-manager-79c8d999ff-mpzwg" May 25 01:08:17.107228 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:17.107140 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-mpzwg" May 25 01:08:17.230501 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:17.230468 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-mpzwg"] May 25 01:08:17.233742 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:08:17.233714 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda7b57591_ed84_4b06_bc91_59a10dac7590.slice/crio-d1fdd32a75678d4c7d8a952f6322cc4d3fc6232e54006d3da1b9a52617bec27e WatchSource:0}: Error finding container d1fdd32a75678d4c7d8a952f6322cc4d3fc6232e54006d3da1b9a52617bec27e: Status 404 returned error can't find the container with id d1fdd32a75678d4c7d8a952f6322cc4d3fc6232e54006d3da1b9a52617bec27e May 25 01:08:17.235485 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:17.235472 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 25 01:08:17.725419 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:17.725373 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-mpzwg" event={"ID":"a7b57591-ed84-4b06-bc91-59a10dac7590","Type":"ContainerStarted","Data":"d1fdd32a75678d4c7d8a952f6322cc4d3fc6232e54006d3da1b9a52617bec27e"} May 25 01:08:19.731752 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:19.731716 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-mpzwg" event={"ID":"a7b57591-ed84-4b06-bc91-59a10dac7590","Type":"ContainerStarted","Data":"2eeafdb78d976803225971d37d8b05f55c154fc5f74a90834437e2380a50ad63"} May 25 01:08:19.751111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:19.751061 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-mpzwg" podStartSLOduration=1.4670248799999999 podStartE2EDuration="3.751047116s" podCreationTimestamp="2026-05-25 01:08:16 +0000 UTC" firstStartedPulling="2026-05-25 01:08:17.23559348 +0000 UTC m=+357.128698110" lastFinishedPulling="2026-05-25 01:08:19.519615714 +0000 UTC m=+359.412720346" observedRunningTime="2026-05-25 01:08:19.750834692 +0000 UTC m=+359.643939348" watchObservedRunningTime="2026-05-25 01:08:19.751047116 +0000 UTC m=+359.644151768" May 25 01:08:46.591059 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.591022 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6"] May 25 01:08:46.593961 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.593942 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:46.596296 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.596274 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" May 25 01:08:46.596681 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.596663 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" May 25 01:08:46.596803 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.596680 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" May 25 01:08:46.596803 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.596786 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-m7q2p\"" May 25 01:08:46.596897 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.596836 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" May 25 01:08:46.608804 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.608783 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6"] May 25 01:08:46.683619 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.683585 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8a00423-a9f7-4d27-9f71-9b303fe4eba0-webhook-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-27cj6\" (UID: \"b8a00423-a9f7-4d27-9f71-9b303fe4eba0\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:46.683788 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.683642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8a00423-a9f7-4d27-9f71-9b303fe4eba0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-27cj6\" (UID: \"b8a00423-a9f7-4d27-9f71-9b303fe4eba0\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:46.683788 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.683667 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlpks\" (UniqueName: \"kubernetes.io/projected/b8a00423-a9f7-4d27-9f71-9b303fe4eba0-kube-api-access-vlpks\") pod \"opendatahub-operator-controller-manager-68d974c4c6-27cj6\" (UID: \"b8a00423-a9f7-4d27-9f71-9b303fe4eba0\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:46.784054 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.784015 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8a00423-a9f7-4d27-9f71-9b303fe4eba0-webhook-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-27cj6\" (UID: \"b8a00423-a9f7-4d27-9f71-9b303fe4eba0\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:46.784243 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.784067 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8a00423-a9f7-4d27-9f71-9b303fe4eba0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-27cj6\" (UID: \"b8a00423-a9f7-4d27-9f71-9b303fe4eba0\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:46.784243 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.784087 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vlpks\" (UniqueName: \"kubernetes.io/projected/b8a00423-a9f7-4d27-9f71-9b303fe4eba0-kube-api-access-vlpks\") pod \"opendatahub-operator-controller-manager-68d974c4c6-27cj6\" (UID: \"b8a00423-a9f7-4d27-9f71-9b303fe4eba0\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:46.786600 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.786576 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b8a00423-a9f7-4d27-9f71-9b303fe4eba0-webhook-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-27cj6\" (UID: \"b8a00423-a9f7-4d27-9f71-9b303fe4eba0\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:46.786692 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.786619 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b8a00423-a9f7-4d27-9f71-9b303fe4eba0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68d974c4c6-27cj6\" (UID: \"b8a00423-a9f7-4d27-9f71-9b303fe4eba0\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:46.793091 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.793070 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlpks\" (UniqueName: \"kubernetes.io/projected/b8a00423-a9f7-4d27-9f71-9b303fe4eba0-kube-api-access-vlpks\") pod \"opendatahub-operator-controller-manager-68d974c4c6-27cj6\" (UID: \"b8a00423-a9f7-4d27-9f71-9b303fe4eba0\") " pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:46.904090 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:46.904059 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:47.040725 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:47.040693 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6"] May 25 01:08:47.044858 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:08:47.044830 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8a00423_a9f7_4d27_9f71_9b303fe4eba0.slice/crio-69ff7416fd54be7732cb1df5e180e1fb7ef30d6ddda8f0cc768f0d3749ef72e8 WatchSource:0}: Error finding container 69ff7416fd54be7732cb1df5e180e1fb7ef30d6ddda8f0cc768f0d3749ef72e8: Status 404 returned error can't find the container with id 69ff7416fd54be7732cb1df5e180e1fb7ef30d6ddda8f0cc768f0d3749ef72e8 May 25 01:08:47.809750 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:47.809660 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" event={"ID":"b8a00423-a9f7-4d27-9f71-9b303fe4eba0","Type":"ContainerStarted","Data":"69ff7416fd54be7732cb1df5e180e1fb7ef30d6ddda8f0cc768f0d3749ef72e8"} May 25 01:08:49.816562 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:49.816522 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" event={"ID":"b8a00423-a9f7-4d27-9f71-9b303fe4eba0","Type":"ContainerStarted","Data":"e324ffd656e21f53bfe9737330492c829230581215395a40c069a1a45582eff2"} May 25 01:08:49.816993 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:49.816700 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:08:49.840321 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:49.840275 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" podStartSLOduration=1.166783889 podStartE2EDuration="3.840260677s" podCreationTimestamp="2026-05-25 01:08:46 +0000 UTC" firstStartedPulling="2026-05-25 01:08:47.046518395 +0000 UTC m=+386.939623025" lastFinishedPulling="2026-05-25 01:08:49.719995179 +0000 UTC m=+389.613099813" observedRunningTime="2026-05-25 01:08:49.838998845 +0000 UTC m=+389.732103496" watchObservedRunningTime="2026-05-25 01:08:49.840260677 +0000 UTC m=+389.733365330" May 25 01:08:56.210598 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.210564 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2"] May 25 01:08:56.214591 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.214571 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.217737 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.217714 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h4645\"" May 25 01:08:56.217926 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.217909 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" May 25 01:08:56.218597 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.218568 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" May 25 01:08:56.218597 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.218585 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" May 25 01:08:56.218740 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.218658 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" May 25 01:08:56.220968 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.220951 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" May 25 01:08:56.230097 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.230072 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2"] May 25 01:08:56.353345 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.353301 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8be9577-172e-4ad2-929e-83ffdabc0b51-metrics-cert\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.353345 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.353348 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfxvx\" (UniqueName: \"kubernetes.io/projected/b8be9577-172e-4ad2-929e-83ffdabc0b51-kube-api-access-tfxvx\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.353613 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.353401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b8be9577-172e-4ad2-929e-83ffdabc0b51-manager-config\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.353613 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.353485 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8be9577-172e-4ad2-929e-83ffdabc0b51-cert\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.454570 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.454531 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8be9577-172e-4ad2-929e-83ffdabc0b51-cert\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.454734 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.454590 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8be9577-172e-4ad2-929e-83ffdabc0b51-metrics-cert\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.454734 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.454613 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tfxvx\" (UniqueName: \"kubernetes.io/projected/b8be9577-172e-4ad2-929e-83ffdabc0b51-kube-api-access-tfxvx\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.454734 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.454647 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b8be9577-172e-4ad2-929e-83ffdabc0b51-manager-config\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.455347 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.455259 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/b8be9577-172e-4ad2-929e-83ffdabc0b51-manager-config\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.457076 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.457053 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b8be9577-172e-4ad2-929e-83ffdabc0b51-cert\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.457147 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.457086 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/b8be9577-172e-4ad2-929e-83ffdabc0b51-metrics-cert\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.463816 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.463761 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfxvx\" (UniqueName: \"kubernetes.io/projected/b8be9577-172e-4ad2-929e-83ffdabc0b51-kube-api-access-tfxvx\") pod \"lws-controller-manager-dcfffc65c-ltpg2\" (UID: \"b8be9577-172e-4ad2-929e-83ffdabc0b51\") " pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.523689 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.523647 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:56.653176 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.653135 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2"] May 25 01:08:56.656381 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:08:56.656349 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8be9577_172e_4ad2_929e_83ffdabc0b51.slice/crio-11fcfb13e19889fc52ea7524fbd5cc516014a88cad0119f79210da9c0da9699f WatchSource:0}: Error finding container 11fcfb13e19889fc52ea7524fbd5cc516014a88cad0119f79210da9c0da9699f: Status 404 returned error can't find the container with id 11fcfb13e19889fc52ea7524fbd5cc516014a88cad0119f79210da9c0da9699f May 25 01:08:56.835591 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:56.835507 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" event={"ID":"b8be9577-172e-4ad2-929e-83ffdabc0b51","Type":"ContainerStarted","Data":"11fcfb13e19889fc52ea7524fbd5cc516014a88cad0119f79210da9c0da9699f"} May 25 01:08:59.847140 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:59.847103 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" event={"ID":"b8be9577-172e-4ad2-929e-83ffdabc0b51","Type":"ContainerStarted","Data":"d1bbf6ffd65b0aa7f4a2a1f7699f2b544f50ea24c14e5c20291e84f16d9b4132"} May 25 01:08:59.847624 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:59.847163 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:08:59.874786 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:08:59.874739 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" podStartSLOduration=1.26961486 podStartE2EDuration="3.874723049s" podCreationTimestamp="2026-05-25 01:08:56 +0000 UTC" firstStartedPulling="2026-05-25 01:08:56.658176341 +0000 UTC m=+396.551280971" lastFinishedPulling="2026-05-25 01:08:59.263284528 +0000 UTC m=+399.156389160" observedRunningTime="2026-05-25 01:08:59.872864863 +0000 UTC m=+399.765969515" watchObservedRunningTime="2026-05-25 01:08:59.874723049 +0000 UTC m=+399.767827741" May 25 01:09:00.820860 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:00.820830 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68d974c4c6-27cj6" May 25 01:09:10.852999 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:10.852967 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dcfffc65c-ltpg2" May 25 01:09:33.962569 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:33.962489 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7"] May 25 01:09:33.965682 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:33.965662 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:33.969999 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:33.969976 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" May 25 01:09:33.970228 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:33.970212 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" May 25 01:09:33.970276 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:33.970212 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wjrdn\"" May 25 01:09:33.970775 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:33.970757 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" May 25 01:09:33.979740 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:33.979715 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7"] May 25 01:09:34.019290 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.019255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57tss\" (UniqueName: \"kubernetes.io/projected/f097dd21-cadb-4a72-abeb-489afe5308a8-kube-api-access-57tss\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.019504 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.019304 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.019504 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.019331 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.019504 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.019365 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f097dd21-cadb-4a72-abeb-489afe5308a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.019504 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.019394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.019504 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.019453 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.019504 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.019479 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.019740 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.019520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.019740 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.019547 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.120720 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.120684 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.120720 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.120723 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.120930 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.120745 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.120930 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.120760 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.120930 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.120785 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57tss\" (UniqueName: \"kubernetes.io/projected/f097dd21-cadb-4a72-abeb-489afe5308a8-kube-api-access-57tss\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.120930 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.120821 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.120930 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.120839 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.120930 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.120886 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f097dd21-cadb-4a72-abeb-489afe5308a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.120930 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.120922 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.121253 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.121156 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.121253 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.121183 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.121342 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.121264 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.121379 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.121343 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.121749 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.121731 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f097dd21-cadb-4a72-abeb-489afe5308a8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.123132 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.123103 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.123333 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.123316 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.132661 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.132634 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f097dd21-cadb-4a72-abeb-489afe5308a8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.132863 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.132847 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57tss\" (UniqueName: \"kubernetes.io/projected/f097dd21-cadb-4a72-abeb-489afe5308a8-kube-api-access-57tss\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4btldb7\" (UID: \"f097dd21-cadb-4a72-abeb-489afe5308a8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.277609 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.277512 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:34.411391 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.410731 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7"] May 25 01:09:34.413007 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:09:34.412979 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf097dd21_cadb_4a72_abeb_489afe5308a8.slice/crio-799392e45027c98f491f07e1e2180929fd475466939bf2218d5358e888fc030b WatchSource:0}: Error finding container 799392e45027c98f491f07e1e2180929fd475466939bf2218d5358e888fc030b: Status 404 returned error can't find the container with id 799392e45027c98f491f07e1e2180929fd475466939bf2218d5358e888fc030b May 25 01:09:34.938524 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:34.938482 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" event={"ID":"f097dd21-cadb-4a72-abeb-489afe5308a8","Type":"ContainerStarted","Data":"799392e45027c98f491f07e1e2180929fd475466939bf2218d5358e888fc030b"} May 25 01:09:37.369530 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:37.369494 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} May 25 01:09:37.369804 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:37.369566 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} May 25 01:09:37.369804 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:37.369596 2563 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} May 25 01:09:37.948184 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:37.948142 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" event={"ID":"f097dd21-cadb-4a72-abeb-489afe5308a8","Type":"ContainerStarted","Data":"321945b69cb456e4e67c0a5ba0f2eafba36c5f14746a4cacd13c6fe3db540e80"} May 25 01:09:37.977715 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:37.977661 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" podStartSLOduration=2.023252853 podStartE2EDuration="4.977646446s" podCreationTimestamp="2026-05-25 01:09:33 +0000 UTC" firstStartedPulling="2026-05-25 01:09:34.414859665 +0000 UTC m=+434.307964295" lastFinishedPulling="2026-05-25 01:09:37.369253259 +0000 UTC m=+437.262357888" observedRunningTime="2026-05-25 01:09:37.976748396 +0000 UTC m=+437.869853047" watchObservedRunningTime="2026-05-25 01:09:37.977646446 +0000 UTC m=+437.870751098" May 25 01:09:38.278544 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:38.278430 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:38.282896 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:38.282871 2563 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:38.951777 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:38.951748 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:09:38.952833 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:09:38.952811 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4btldb7" May 25 01:10:08.950991 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:08.950962 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68d974c4c6-27cj6_b8a00423-a9f7-4d27-9f71-9b303fe4eba0/manager/0.log" May 25 01:10:09.943409 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:09.943368 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4btldb7_f097dd21-cadb-4a72-abeb-489afe5308a8/istio-proxy/0.log" May 25 01:10:14.858370 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:14.858331 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g8phq/must-gather-2j4mt"] May 25 01:10:14.868761 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:14.868734 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8phq/must-gather-2j4mt" May 25 01:10:14.872670 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:14.872648 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8phq\"/\"kube-root-ca.crt\"" May 25 01:10:14.873252 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:14.873231 2563 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-g8phq\"/\"openshift-service-ca.crt\"" May 25 01:10:14.873543 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:14.873520 2563 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-g8phq\"/\"default-dockercfg-dm52t\"" May 25 01:10:14.874426 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:14.874403 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8phq/must-gather-2j4mt"] May 25 01:10:14.921613 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:14.921573 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb167535-70ee-450e-946c-f58d16c5d031-must-gather-output\") pod \"must-gather-2j4mt\" (UID: \"cb167535-70ee-450e-946c-f58d16c5d031\") " pod="openshift-must-gather-g8phq/must-gather-2j4mt" May 25 01:10:14.921613 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:14.921619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8l4z\" (UniqueName: \"kubernetes.io/projected/cb167535-70ee-450e-946c-f58d16c5d031-kube-api-access-h8l4z\") pod \"must-gather-2j4mt\" (UID: \"cb167535-70ee-450e-946c-f58d16c5d031\") " pod="openshift-must-gather-g8phq/must-gather-2j4mt" May 25 01:10:15.022730 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:15.022680 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb167535-70ee-450e-946c-f58d16c5d031-must-gather-output\") pod \"must-gather-2j4mt\" (UID: \"cb167535-70ee-450e-946c-f58d16c5d031\") " pod="openshift-must-gather-g8phq/must-gather-2j4mt" May 25 01:10:15.022730 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:15.022732 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h8l4z\" (UniqueName: \"kubernetes.io/projected/cb167535-70ee-450e-946c-f58d16c5d031-kube-api-access-h8l4z\") pod \"must-gather-2j4mt\" (UID: \"cb167535-70ee-450e-946c-f58d16c5d031\") " pod="openshift-must-gather-g8phq/must-gather-2j4mt" May 25 01:10:15.023056 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:15.023036 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb167535-70ee-450e-946c-f58d16c5d031-must-gather-output\") pod \"must-gather-2j4mt\" (UID: \"cb167535-70ee-450e-946c-f58d16c5d031\") " pod="openshift-must-gather-g8phq/must-gather-2j4mt" May 25 01:10:15.031006 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:15.030984 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8l4z\" (UniqueName: \"kubernetes.io/projected/cb167535-70ee-450e-946c-f58d16c5d031-kube-api-access-h8l4z\") pod \"must-gather-2j4mt\" (UID: \"cb167535-70ee-450e-946c-f58d16c5d031\") " pod="openshift-must-gather-g8phq/must-gather-2j4mt" May 25 01:10:15.178768 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:15.178735 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8phq/must-gather-2j4mt" May 25 01:10:15.309915 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:15.309883 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8phq/must-gather-2j4mt"] May 25 01:10:15.313367 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:10:15.313333 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb167535_70ee_450e_946c_f58d16c5d031.slice/crio-c1dbbc89ab326ae331cbb3bbc205d2c1105b803320ecc06aa7dcf1197ea21dac WatchSource:0}: Error finding container c1dbbc89ab326ae331cbb3bbc205d2c1105b803320ecc06aa7dcf1197ea21dac: Status 404 returned error can't find the container with id c1dbbc89ab326ae331cbb3bbc205d2c1105b803320ecc06aa7dcf1197ea21dac May 25 01:10:16.051387 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:16.051351 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8phq/must-gather-2j4mt" event={"ID":"cb167535-70ee-450e-946c-f58d16c5d031","Type":"ContainerStarted","Data":"c1dbbc89ab326ae331cbb3bbc205d2c1105b803320ecc06aa7dcf1197ea21dac"} May 25 01:10:17.056296 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:17.056260 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8phq/must-gather-2j4mt" event={"ID":"cb167535-70ee-450e-946c-f58d16c5d031","Type":"ContainerStarted","Data":"0184ec88b8b16c672468e2179d837b7cf6b97ebd8a9cd243886a2647e393ecb6"} May 25 01:10:17.056844 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:17.056824 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8phq/must-gather-2j4mt" event={"ID":"cb167535-70ee-450e-946c-f58d16c5d031","Type":"ContainerStarted","Data":"8f07f3d42c3087fd1a5fc40d3e381e7c3f5e776ac49aa02b3cb5ea1e2cbbe8f4"} May 25 01:10:17.094592 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:17.094526 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-g8phq/must-gather-2j4mt" podStartSLOduration=2.346994837 podStartE2EDuration="3.094504267s" podCreationTimestamp="2026-05-25 01:10:14 +0000 UTC" firstStartedPulling="2026-05-25 01:10:15.315156709 +0000 UTC m=+475.208261339" lastFinishedPulling="2026-05-25 01:10:16.062666134 +0000 UTC m=+475.955770769" observedRunningTime="2026-05-25 01:10:17.093826337 +0000 UTC m=+476.986930990" watchObservedRunningTime="2026-05-25 01:10:17.094504267 +0000 UTC m=+476.987608926" May 25 01:10:17.520157 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:17.520123 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fzbpg_306748e0-bd1f-4d83-b4ae-7a35930030ba/global-pull-secret-syncer/0.log" May 25 01:10:17.691265 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:17.691170 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mqnbb_00eb2d1b-9bd3-46d0-874a-5312d97f437f/konnectivity-agent/0.log" May 25 01:10:17.729454 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:17.729413 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-154.ec2.internal_66e3b63fecffd8091301d02a57959078/haproxy/0.log" May 25 01:10:21.641588 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:21.641552 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fb4h9_d619d1c7-c3ec-43be-80b5-2952a5e7cdf1/node-exporter/0.log" May 25 01:10:21.663804 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:21.663771 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fb4h9_d619d1c7-c3ec-43be-80b5-2952a5e7cdf1/kube-rbac-proxy/0.log" May 25 01:10:21.686452 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:21.686404 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fb4h9_d619d1c7-c3ec-43be-80b5-2952a5e7cdf1/init-textfile/0.log" May 25 01:10:25.874624 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:25.874582 2563 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947"] May 25 01:10:25.879386 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:25.879361 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:25.884466 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:25.884425 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947"] May 25 01:10:25.915879 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:25.915842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-podres\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:25.916153 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:25.916133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-proc\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:25.916337 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:25.916319 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bccx5\" (UniqueName: \"kubernetes.io/projected/f84a259a-c196-41cc-9c91-cff7119f0018-kube-api-access-bccx5\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:25.916519 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:25.916503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-lib-modules\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:25.916664 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:25.916651 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-sys\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.017467 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.017415 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-proc\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.017867 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.017479 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bccx5\" (UniqueName: \"kubernetes.io/projected/f84a259a-c196-41cc-9c91-cff7119f0018-kube-api-access-bccx5\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.017867 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.017511 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-lib-modules\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.017867 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.017529 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-proc\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.017867 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.017537 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-sys\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.017867 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.017655 2563 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-podres\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.017867 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.017665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-sys\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.017867 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.017665 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-lib-modules\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.017867 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.017807 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f84a259a-c196-41cc-9c91-cff7119f0018-podres\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.027869 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.027839 2563 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bccx5\" (UniqueName: \"kubernetes.io/projected/f84a259a-c196-41cc-9c91-cff7119f0018-kube-api-access-bccx5\") pod \"perf-node-gather-daemonset-nv947\" (UID: \"f84a259a-c196-41cc-9c91-cff7119f0018\") " pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.191358 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.191326 2563 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:26.334068 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.334019 2563 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947"] May 25 01:10:26.338741 ip-10-0-141-154 kubenswrapper[2563]: W0525 01:10:26.338712 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf84a259a_c196_41cc_9c91_cff7119f0018.slice/crio-26a3391be1b3ce9c67c8201a9945a77eff8fd835d902f82b4d36c49d49a2a80e WatchSource:0}: Error finding container 26a3391be1b3ce9c67c8201a9945a77eff8fd835d902f82b4d36c49d49a2a80e: Status 404 returned error can't find the container with id 26a3391be1b3ce9c67c8201a9945a77eff8fd835d902f82b4d36c49d49a2a80e May 25 01:10:26.514138 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.514054 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kghmq_af475045-cb51-4e75-b2f5-5e68681538cc/dns/0.log" May 25 01:10:26.537589 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.537556 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kghmq_af475045-cb51-4e75-b2f5-5e68681538cc/kube-rbac-proxy/0.log" May 25 01:10:26.628111 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:26.628079 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nbqnt_49823412-f0ef-4ded-9c2a-8dbeb2a864f0/dns-node-resolver/0.log" May 25 01:10:27.093311 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:27.093273 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" event={"ID":"f84a259a-c196-41cc-9c91-cff7119f0018","Type":"ContainerStarted","Data":"0d289214d6d721b81682272d6606782c3c31737d3f9c2da7220c6283f3a982e2"} May 25 01:10:27.093311 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:27.093317 2563 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" event={"ID":"f84a259a-c196-41cc-9c91-cff7119f0018","Type":"ContainerStarted","Data":"26a3391be1b3ce9c67c8201a9945a77eff8fd835d902f82b4d36c49d49a2a80e"} May 25 01:10:27.094180 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:27.094137 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:27.110082 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:27.110023 2563 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" podStartSLOduration=2.110005007 podStartE2EDuration="2.110005007s" podCreationTimestamp="2026-05-25 01:10:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:10:27.108894416 +0000 UTC m=+487.001999068" watchObservedRunningTime="2026-05-25 01:10:27.110005007 +0000 UTC m=+487.003109661" May 25 01:10:27.140877 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:27.140845 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g5mj4_db15759d-02bf-4fe6-999a-cc6846b89e74/node-ca/0.log" May 25 01:10:27.984685 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:27.984653 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4btldb7_f097dd21-cadb-4a72-abeb-489afe5308a8/istio-proxy/0.log" May 25 01:10:28.607391 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:28.607360 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s9vfh_5cb43ecb-16f8-46ea-9c92-4bf296452f7b/serve-healthcheck-canary/0.log" May 25 01:10:29.043870 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:29.043841 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9mvh7_4a4cd995-04f9-47c4-bb0f-9151c7590232/kube-rbac-proxy/0.log" May 25 01:10:29.064875 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:29.064848 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9mvh7_4a4cd995-04f9-47c4-bb0f-9151c7590232/exporter/0.log" May 25 01:10:29.086645 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:29.086618 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-9mvh7_4a4cd995-04f9-47c4-bb0f-9151c7590232/extractor/0.log" May 25 01:10:30.955635 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:30.955604 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68d974c4c6-27cj6_b8a00423-a9f7-4d27-9f71-9b303fe4eba0/manager/0.log" May 25 01:10:32.055658 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:32.055625 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dcfffc65c-ltpg2_b8be9577-172e-4ad2-929e-83ffdabc0b51/manager/0.log" May 25 01:10:34.111725 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:34.111687 2563 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-g8phq/perf-node-gather-daemonset-nv947" May 25 01:10:37.497249 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:37.497219 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7h99h_d5d4e155-ec75-4cbf-98ec-453388135cec/kube-multus-additional-cni-plugins/0.log" May 25 01:10:37.527044 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:37.526976 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7h99h_d5d4e155-ec75-4cbf-98ec-453388135cec/egress-router-binary-copy/0.log" May 25 01:10:37.549727 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:37.549703 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7h99h_d5d4e155-ec75-4cbf-98ec-453388135cec/cni-plugins/0.log" May 25 01:10:37.577843 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:37.577788 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7h99h_d5d4e155-ec75-4cbf-98ec-453388135cec/bond-cni-plugin/0.log" May 25 01:10:37.601849 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:37.601822 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7h99h_d5d4e155-ec75-4cbf-98ec-453388135cec/routeoverride-cni/0.log" May 25 01:10:37.624504 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:37.624475 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7h99h_d5d4e155-ec75-4cbf-98ec-453388135cec/whereabouts-cni-bincopy/0.log" May 25 01:10:37.654709 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:37.654673 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7h99h_d5d4e155-ec75-4cbf-98ec-453388135cec/whereabouts-cni/0.log" May 25 01:10:38.216002 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:38.215925 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dfvfw_7512ac5b-aebd-4930-acc8-73f75bcbd2ba/kube-multus/0.log" May 25 01:10:38.352931 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:38.352831 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rk8vg_67bcba76-518c-4f73-96f1-06614f83809a/network-metrics-daemon/0.log" May 25 01:10:38.376704 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:38.376678 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rk8vg_67bcba76-518c-4f73-96f1-06614f83809a/kube-rbac-proxy/0.log" May 25 01:10:39.239494 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:39.239464 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqqzs_fbdb65e9-5cfd-4dd7-b150-bc0447e169ba/ovn-controller/0.log" May 25 01:10:39.260089 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:39.260047 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqqzs_fbdb65e9-5cfd-4dd7-b150-bc0447e169ba/ovn-acl-logging/0.log" May 25 01:10:39.281267 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:39.281226 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqqzs_fbdb65e9-5cfd-4dd7-b150-bc0447e169ba/kube-rbac-proxy-node/0.log" May 25 01:10:39.299898 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:39.299869 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqqzs_fbdb65e9-5cfd-4dd7-b150-bc0447e169ba/kube-rbac-proxy-ovn-metrics/0.log" May 25 01:10:39.333223 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:39.333181 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqqzs_fbdb65e9-5cfd-4dd7-b150-bc0447e169ba/northd/0.log" May 25 01:10:39.350514 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:39.350489 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqqzs_fbdb65e9-5cfd-4dd7-b150-bc0447e169ba/nbdb/0.log" May 25 01:10:39.368474 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:39.368428 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqqzs_fbdb65e9-5cfd-4dd7-b150-bc0447e169ba/sbdb/0.log" May 25 01:10:39.479554 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:39.479516 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hqqzs_fbdb65e9-5cfd-4dd7-b150-bc0447e169ba/ovnkube-controller/0.log" May 25 01:10:41.114207 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:41.114181 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-p7l25_bb056d63-5efc-4375-9448-ed8e8815abc7/network-check-target-container/0.log" May 25 01:10:42.113296 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:42.113251 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-ql2x7_d98f98c4-508f-414e-b38e-43d870947315/iptables-alerter/0.log" May 25 01:10:42.856184 ip-10-0-141-154 kubenswrapper[2563]: I0525 01:10:42.856152 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-pv9qq_57d8aed2-8238-4b0f-9b3e-da1360837ba3/tuned/0.log"