May 29 02:51:54.030600 ip-10-0-138-99 systemd[1]: Starting Kubernetes Kubelet... May 29 02:51:54.535555 ip-10-0-138-99 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 02:51:54.535555 ip-10-0-138-99 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. May 29 02:51:54.535555 ip-10-0-138-99 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 02:51:54.535555 ip-10-0-138-99 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. May 29 02:51:54.535555 ip-10-0-138-99 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. May 29 02:51:54.536958 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.536839 2574 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" May 29 02:51:54.541425 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541398 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 02:51:54.541425 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541424 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 02:51:54.541425 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541429 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 02:51:54.541425 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541432 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 02:51:54.541425 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541436 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541440 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541443 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541447 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541451 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541454 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541457 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541460 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541462 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541465 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541468 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541471 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541474 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541476 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541479 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541483 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541486 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541488 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541491 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541494 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 02:51:54.541570 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541496 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541499 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541502 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541504 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541507 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541510 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541513 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541515 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541518 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541521 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541523 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541526 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541529 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541532 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541537 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541541 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541544 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541547 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541550 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 02:51:54.542052 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541553 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541556 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541559 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541562 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541565 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541567 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541570 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541573 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541576 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541579 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541583 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541587 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541591 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541595 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541600 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541604 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541607 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541610 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541613 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 02:51:54.542546 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541615 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541618 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541621 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541624 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541627 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541630 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541632 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541635 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541639 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541641 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541645 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541648 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541651 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541653 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541656 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541658 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541662 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541664 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541666 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541669 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 02:51:54.543040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541672 2574 feature_gate.go:328] unrecognized feature gate: Example May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541674 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541677 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.541680 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542072 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542077 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542080 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542084 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542086 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542089 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542092 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542095 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542098 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542100 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542104 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542106 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542109 2574 feature_gate.go:328] unrecognized feature gate: Example May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542112 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542116 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542119 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 02:51:54.543543 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542122 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542124 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542127 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542130 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542132 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542135 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542138 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542141 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542143 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542146 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542148 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542151 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542153 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542156 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542159 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542162 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542165 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542168 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542171 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542173 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 02:51:54.544110 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542176 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542178 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542181 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542184 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542187 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542189 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542194 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542198 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542201 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542204 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542207 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542210 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542213 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542216 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542219 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542222 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542225 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542227 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542230 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 02:51:54.544667 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542233 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542235 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542238 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542241 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542243 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542246 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542248 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542251 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542253 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542256 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542258 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542261 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542263 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542266 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542268 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542271 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542274 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542278 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542280 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542283 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 02:51:54.545138 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542286 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542288 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542291 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542294 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542297 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542300 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542303 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542318 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542321 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542323 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.542326 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542406 2574 flags.go:64] FLAG: --address="0.0.0.0" May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542414 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542422 2574 flags.go:64] FLAG: --anonymous-auth="true" May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542429 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542436 2574 flags.go:64] FLAG: --authentication-token-webhook="false" May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542440 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542447 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542452 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542455 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542458 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542462 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" May 29 02:51:54.545649 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542465 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542468 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542472 2574 flags.go:64] FLAG: --cgroup-root="" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542475 2574 flags.go:64] FLAG: --cgroups-per-qos="true" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542477 2574 flags.go:64] FLAG: --client-ca-file="" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542480 2574 flags.go:64] FLAG: --cloud-config="" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542484 2574 flags.go:64] FLAG: --cloud-provider="external" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542487 2574 flags.go:64] FLAG: --cluster-dns="[]" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542491 2574 flags.go:64] FLAG: --cluster-domain="" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542495 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542498 2574 flags.go:64] FLAG: --config-dir="" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542501 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542504 2574 flags.go:64] FLAG: --container-log-max-files="5" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542508 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542512 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542515 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542519 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542522 2574 flags.go:64] FLAG: --contention-profiling="false" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542525 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542528 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542531 2574 flags.go:64] FLAG: --cpu-manager-policy="none" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542534 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542539 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542542 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542545 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" May 29 02:51:54.546186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542547 2574 flags.go:64] FLAG: --enable-load-reader="false" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542551 2574 flags.go:64] FLAG: --enable-server="true" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542554 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542559 2574 flags.go:64] FLAG: --event-burst="100" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542562 2574 flags.go:64] FLAG: --event-qps="50" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542565 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542569 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542572 2574 flags.go:64] FLAG: --eviction-hard="" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542575 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542578 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542582 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542584 2574 flags.go:64] FLAG: --eviction-soft="" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542587 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542591 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542594 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542597 2574 flags.go:64] FLAG: --experimental-mounter-path="" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542600 2574 flags.go:64] FLAG: --fail-cgroupv1="false" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542603 2574 flags.go:64] FLAG: --fail-swap-on="true" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542607 2574 flags.go:64] FLAG: --feature-gates="" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542611 2574 flags.go:64] FLAG: --file-check-frequency="20s" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542614 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542618 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542622 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542625 2574 flags.go:64] FLAG: --healthz-port="10248" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542628 2574 flags.go:64] FLAG: --help="false" May 29 02:51:54.546809 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542631 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-138-99.ec2.internal" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542634 2574 flags.go:64] FLAG: --housekeeping-interval="10s" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542637 2574 flags.go:64] FLAG: --http-check-frequency="20s" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542640 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542644 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542647 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542650 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542653 2574 flags.go:64] FLAG: --image-service-endpoint="" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542655 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542658 2574 flags.go:64] FLAG: --kube-api-burst="100" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542661 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542665 2574 flags.go:64] FLAG: --kube-api-qps="50" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542667 2574 flags.go:64] FLAG: --kube-reserved="" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542670 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542673 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542677 2574 flags.go:64] FLAG: --kubelet-cgroups="" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542679 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542682 2574 flags.go:64] FLAG: --lock-file="" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542685 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542688 2574 flags.go:64] FLAG: --log-flush-frequency="5s" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542691 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542697 2574 flags.go:64] FLAG: --log-json-split-stream="false" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542700 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542702 2574 flags.go:64] FLAG: --log-text-split-stream="false" May 29 02:51:54.547430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542705 2574 flags.go:64] FLAG: --logging-format="text" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542712 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542716 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542719 2574 flags.go:64] FLAG: --manifest-url="" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542722 2574 flags.go:64] FLAG: --manifest-url-header="" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542726 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542730 2574 flags.go:64] FLAG: --max-open-files="1000000" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542734 2574 flags.go:64] FLAG: --max-pods="110" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542737 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542741 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542745 2574 flags.go:64] FLAG: --memory-manager-policy="None" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542748 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542751 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542754 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542757 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542765 2574 flags.go:64] FLAG: --node-status-max-images="50" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542768 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542771 2574 flags.go:64] FLAG: --oom-score-adj="-999" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542775 2574 flags.go:64] FLAG: --pod-cidr="" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542777 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542784 2574 flags.go:64] FLAG: --pod-manifest-path="" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542787 2574 flags.go:64] FLAG: --pod-max-pids="-1" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542790 2574 flags.go:64] FLAG: --pods-per-core="0" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542793 2574 flags.go:64] FLAG: --port="10250" May 29 02:51:54.548004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542796 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542799 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04b64b4467abe07df" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542802 2574 flags.go:64] FLAG: --qos-reserved="" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542805 2574 flags.go:64] FLAG: --read-only-port="10255" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542808 2574 flags.go:64] FLAG: --register-node="true" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542812 2574 flags.go:64] FLAG: --register-schedulable="true" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542814 2574 flags.go:64] FLAG: --register-with-taints="" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542818 2574 flags.go:64] FLAG: --registry-burst="10" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542821 2574 flags.go:64] FLAG: --registry-qps="5" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542824 2574 flags.go:64] FLAG: --reserved-cpus="" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542828 2574 flags.go:64] FLAG: --reserved-memory="" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542832 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542835 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542839 2574 flags.go:64] FLAG: --rotate-certificates="false" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542842 2574 flags.go:64] FLAG: --rotate-server-certificates="false" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542845 2574 flags.go:64] FLAG: --runonce="false" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542848 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542851 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542855 2574 flags.go:64] FLAG: --seccomp-default="false" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542858 2574 flags.go:64] FLAG: --serialize-image-pulls="true" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542861 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542865 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542869 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542871 2574 flags.go:64] FLAG: --storage-driver-password="root" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542874 2574 flags.go:64] FLAG: --storage-driver-secure="false" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542878 2574 flags.go:64] FLAG: --storage-driver-table="stats" May 29 02:51:54.548629 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542881 2574 flags.go:64] FLAG: --storage-driver-user="root" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542884 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542887 2574 flags.go:64] FLAG: --sync-frequency="1m0s" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542890 2574 flags.go:64] FLAG: --system-cgroups="" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542893 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542898 2574 flags.go:64] FLAG: --system-reserved-cgroup="" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542901 2574 flags.go:64] FLAG: --tls-cert-file="" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542904 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542908 2574 flags.go:64] FLAG: --tls-min-version="" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542911 2574 flags.go:64] FLAG: --tls-private-key-file="" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542914 2574 flags.go:64] FLAG: --topology-manager-policy="none" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542917 2574 flags.go:64] FLAG: --topology-manager-policy-options="" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542920 2574 flags.go:64] FLAG: --topology-manager-scope="container" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542923 2574 flags.go:64] FLAG: --v="2" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542927 2574 flags.go:64] FLAG: --version="false" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542931 2574 flags.go:64] FLAG: --vmodule="" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542936 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.542940 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543038 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543042 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543046 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543049 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543053 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543056 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 02:51:54.549263 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543059 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543062 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543064 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543068 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543071 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543074 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543076 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543079 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543083 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543101 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543106 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543110 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543113 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543116 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543118 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543121 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543124 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543127 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543130 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 02:51:54.549859 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543134 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543138 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543141 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543143 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543146 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543151 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543154 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543157 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543160 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543162 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543165 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543167 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543171 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543174 2574 feature_gate.go:328] unrecognized feature gate: Example May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543176 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543179 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543183 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543185 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543188 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543191 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 02:51:54.550343 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543193 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543196 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543199 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543201 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543204 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543206 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543209 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543212 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543214 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543217 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543219 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543222 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543225 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543228 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543230 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543233 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543235 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543240 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543242 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543245 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 02:51:54.550838 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543247 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543250 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543252 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543255 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543258 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543261 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543263 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543266 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543269 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543272 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543275 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543277 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543280 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543282 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543285 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543288 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543291 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543293 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543296 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543298 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 02:51:54.551326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.543301 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.543318 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.549739 2574 server.go:530] "Kubelet version" kubeletVersion="v1.33.11" May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.549757 2574 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549817 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549823 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549827 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549830 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549833 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549836 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549839 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549842 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549844 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549848 2574 feature_gate.go:328] unrecognized feature gate: Example May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549850 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549853 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 02:51:54.551830 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549856 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549858 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549861 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549864 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549866 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549869 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549872 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549875 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549877 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549880 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549883 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549886 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549888 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549891 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549894 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549897 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549899 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549902 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549905 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549909 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 02:51:54.552235 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549912 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549915 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549917 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549921 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549925 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549930 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549935 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549938 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549940 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549943 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549946 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549948 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549951 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549954 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549957 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549960 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549963 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549965 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549968 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 02:51:54.552735 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549971 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549973 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549976 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549978 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549981 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549983 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549986 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549988 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549991 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549994 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549996 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.549999 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550003 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550007 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550010 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550013 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550016 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550018 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550021 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550024 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 02:51:54.553262 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550027 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550029 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550035 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550038 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550041 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550043 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550046 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550048 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550051 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550054 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550056 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550059 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550062 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550064 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550067 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 02:51:54.553816 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.550072 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550190 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550195 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550198 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550201 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550203 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550206 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550209 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550212 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550215 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550218 2574 feature_gate.go:328] unrecognized feature gate: DualReplica May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550221 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550224 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550227 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550229 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550232 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550234 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550237 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550239 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550242 2574 feature_gate.go:328] unrecognized feature gate: NewOLM May 29 02:51:54.554185 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550244 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550247 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550249 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550252 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550254 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550257 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550260 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550262 2574 feature_gate.go:328] unrecognized feature gate: Example2 May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550264 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550267 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550269 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550272 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550274 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550277 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550279 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550282 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550284 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550287 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550289 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550292 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix May 29 02:51:54.554725 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550294 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550297 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550300 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550302 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550317 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550320 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550323 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550326 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550329 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550332 2574 feature_gate.go:328] unrecognized feature gate: Example May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550334 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550337 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550340 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550342 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550345 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550348 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550352 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550356 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550359 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550362 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement May 29 02:51:54.555222 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550365 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550368 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550371 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550374 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550378 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550382 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550385 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550388 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550391 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550393 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550396 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550399 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550401 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550404 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550407 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550410 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550413 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550416 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550419 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses May 29 02:51:54.555714 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550421 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550424 2574 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550426 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550429 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550432 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550435 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550437 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:54.550440 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.550445 2574 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]} May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.551255 2574 server.go:962] "Client rotation is on, will bootstrap in background" May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.553342 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.554326 2574 server.go:1019] "Starting client certificate rotation" May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.554427 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 02:51:54.556177 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.554469 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" May 29 02:51:54.581186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.581157 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 02:51:54.587632 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.587609 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" May 29 02:51:54.607268 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.607244 2574 log.go:25] "Validated CRI v1 runtime API" May 29 02:51:54.613010 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.612992 2574 log.go:25] "Validated CRI v1 image API" May 29 02:51:54.614549 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.614526 2574 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" May 29 02:51:54.615797 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.615777 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 02:51:54.620986 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.620965 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8a7f9a79-0b92-492f-b74b-e10bb058322f:/dev/nvme0n1p3 f180a139-e169-444d-9f0e-acb23256517f:/dev/nvme0n1p4] May 29 02:51:54.621069 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.620987 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] May 29 02:51:54.625295 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.625173 2574 manager.go:217] Machine: {Timestamp:2026-05-29 02:51:54.624686498 +0000 UTC m=+0.461459664 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3111539 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec239539479dafdb84b4aa556e4f9c8c SystemUUID:ec239539-479d-afdb-84b4-aa556e4f9c8c BootID:c5cab13f-66d4-451f-a375-44733e865bd0 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:84:b1:b1:2f:c5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:84:b1:b1:2f:c5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:06:34:22:fa:a7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} May 29 02:51:54.625828 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.625815 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. May 29 02:51:54.625945 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.625928 2574 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} May 29 02:51:54.628012 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.627986 2574 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] May 29 02:51:54.628159 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.628014 2574 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-99.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} May 29 02:51:54.628203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.628166 2574 topology_manager.go:138] "Creating topology manager with none policy" May 29 02:51:54.628203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.628175 2574 container_manager_linux.go:306] "Creating device plugin manager" May 29 02:51:54.628203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.628183 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 02:51:54.629186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.629175 2574 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" May 29 02:51:54.630863 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.630852 2574 state_mem.go:36] "Initialized new in-memory state store" May 29 02:51:54.630972 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.630963 2574 server.go:1267] "Using root directory" path="/var/lib/kubelet" May 29 02:51:54.634594 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.634583 2574 kubelet.go:491] "Attempting to sync node with API server" May 29 02:51:54.634639 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.634599 2574 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests" May 29 02:51:54.634639 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.634616 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" May 29 02:51:54.634639 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.634627 2574 kubelet.go:397] "Adding apiserver pod source" May 29 02:51:54.634639 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.634636 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" May 29 02:51:54.635749 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.635734 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 02:51:54.635826 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.635753 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" May 29 02:51:54.639156 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.639136 2574 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1" May 29 02:51:54.641891 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.641862 2574 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" May 29 02:51:54.643993 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.643972 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" May 29 02:51:54.643993 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.643991 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" May 29 02:51:54.644090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.643998 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" May 29 02:51:54.644090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.644005 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path" May 29 02:51:54.644090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.644014 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs" May 29 02:51:54.644090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.644021 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret" May 29 02:51:54.644090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.644030 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" May 29 02:51:54.644090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.644036 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" May 29 02:51:54.644090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.644044 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc" May 29 02:51:54.644090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.644050 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap" May 29 02:51:54.644090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.644060 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected" May 29 02:51:54.644090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.644066 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" May 29 02:51:54.646496 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.646481 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi" May 29 02:51:54.646535 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.646500 2574 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image" May 29 02:51:54.649245 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.649224 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" May 29 02:51:54.649245 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.649225 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" May 29 02:51:54.650186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.650173 2574 watchdog_linux.go:99] "Systemd watchdog is not enabled" May 29 02:51:54.650225 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.650214 2574 server.go:1295] "Started kubelet" May 29 02:51:54.650320 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.650278 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 May 29 02:51:54.650378 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.650319 2574 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 May 29 02:51:54.650378 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.650376 2574 server_v1.go:47] "podresources" method="list" useActivePods=true May 29 02:51:54.650951 ip-10-0-138-99 systemd[1]: Started Kubernetes Kubelet. May 29 02:51:54.651713 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.651652 2574 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" May 29 02:51:54.654157 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.654143 2574 server.go:317] "Adding debug handlers to kubelet server" May 29 02:51:54.656936 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.656919 2574 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-99.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope May 29 02:51:54.657896 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.656961 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-99.ec2.internal.18b3e99780b574e9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-99.ec2.internal,UID:ip-10-0-138-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-99.ec2.internal,},FirstTimestamp:2026-05-29 02:51:54.650186985 +0000 UTC m=+0.486960151,LastTimestamp:2026-05-29 02:51:54.650186985 +0000 UTC m=+0.486960151,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-99.ec2.internal,}" May 29 02:51:54.659631 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.659616 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" May 29 02:51:54.659631 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.659625 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" May 29 02:51:54.659754 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.659705 2574 volume_manager.go:295] "The desired_state_of_world populator starts" May 29 02:51:54.659754 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.659714 2574 volume_manager.go:297] "Starting Kubelet Volume Manager" May 29 02:51:54.659853 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.659841 2574 desired_state_of_world_populator.go:150] "Desired state populator starts to run" May 29 02:51:54.659920 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.659908 2574 reconstruct.go:97] "Volume reconstruction finished" May 29 02:51:54.659982 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.659920 2574 reconciler.go:26] "Reconciler: start to sync state" May 29 02:51:54.661522 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.660950 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:54.661914 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.661889 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lctx9" May 29 02:51:54.662370 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.662352 2574 factory.go:55] Registering systemd factory May 29 02:51:54.662370 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.662373 2574 factory.go:223] Registration of the systemd container factory successfully May 29 02:51:54.662938 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.662878 2574 factory.go:153] Registering CRI-O factory May 29 02:51:54.662938 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.662896 2574 factory.go:223] Registration of the crio container factory successfully May 29 02:51:54.663067 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.662950 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory May 29 02:51:54.663067 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.662976 2574 factory.go:103] Registering Raw factory May 29 02:51:54.663067 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.662999 2574 manager.go:1196] Started watching for new ooms in manager May 29 02:51:54.663424 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.663405 2574 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" May 29 02:51:54.663497 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.663483 2574 manager.go:319] Starting recovery of all containers May 29 02:51:54.667154 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.667120 2574 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" May 29 02:51:54.667154 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.667123 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-99.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" May 29 02:51:54.670193 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.670171 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lctx9" May 29 02:51:54.674224 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.674208 2574 manager.go:324] Recovery completed May 29 02:51:54.678615 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.678602 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 02:51:54.680681 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.680665 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientMemory" May 29 02:51:54.680740 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.680694 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasNoDiskPressure" May 29 02:51:54.680740 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.680706 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientPID" May 29 02:51:54.681215 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.681202 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" May 29 02:51:54.681215 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.681212 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" May 29 02:51:54.681290 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.681228 2574 state_mem.go:36] "Initialized new in-memory state store" May 29 02:51:54.682715 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.682649 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-99.ec2.internal.18b3e9978286c56c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-99.ec2.internal,UID:ip-10-0-138-99.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-99.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-99.ec2.internal,},FirstTimestamp:2026-05-29 02:51:54.680681836 +0000 UTC m=+0.517455002,LastTimestamp:2026-05-29 02:51:54.680681836 +0000 UTC m=+0.517455002,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-99.ec2.internal,}" May 29 02:51:54.684928 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.684916 2574 policy_none.go:49] "None policy: Start" May 29 02:51:54.684988 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.684933 2574 memory_manager.go:186] "Starting memorymanager" policy="None" May 29 02:51:54.684988 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.684943 2574 state_mem.go:35] "Initializing new in-memory state store" May 29 02:51:54.727901 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.727882 2574 manager.go:341] "Starting Device Plugin manager" May 29 02:51:54.747481 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.727933 2574 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" May 29 02:51:54.747481 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.727948 2574 server.go:85] "Starting device plugin registration server" May 29 02:51:54.747481 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.728171 2574 eviction_manager.go:189] "Eviction manager: starting control loop" May 29 02:51:54.747481 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.728184 2574 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" May 29 02:51:54.747481 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.728281 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" May 29 02:51:54.747481 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.728373 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" May 29 02:51:54.747481 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.728380 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" May 29 02:51:54.747481 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.728993 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" May 29 02:51:54.747481 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.729035 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:54.766199 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.766173 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4" May 29 02:51:54.767349 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.767333 2574 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6" May 29 02:51:54.767417 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.767356 2574 status_manager.go:230] "Starting to sync pod status with apiserver" May 29 02:51:54.767417 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.767378 2574 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." May 29 02:51:54.767417 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.767385 2574 kubelet.go:2451] "Starting kubelet main sync loop" May 29 02:51:54.767517 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.767461 2574 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" May 29 02:51:54.769478 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.769454 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 02:51:54.829206 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.829123 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 02:51:54.830059 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.830041 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientMemory" May 29 02:51:54.830116 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.830076 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasNoDiskPressure" May 29 02:51:54.830116 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.830090 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientPID" May 29 02:51:54.830116 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.830113 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-99.ec2.internal" May 29 02:51:54.838469 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.838455 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-99.ec2.internal" May 29 02:51:54.838514 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.838477 2574 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-99.ec2.internal\": node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:54.853581 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.853565 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:54.867566 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.867528 2574 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-99.ec2.internal"] May 29 02:51:54.867620 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.867606 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 02:51:54.868449 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.868435 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientMemory" May 29 02:51:54.868504 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.868463 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasNoDiskPressure" May 29 02:51:54.868504 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.868473 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientPID" May 29 02:51:54.869891 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.869879 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 02:51:54.870024 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.870010 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" May 29 02:51:54.870062 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.870038 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 02:51:54.870569 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.870553 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientMemory" May 29 02:51:54.870621 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.870583 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientMemory" May 29 02:51:54.870621 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.870607 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasNoDiskPressure" May 29 02:51:54.870621 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.870617 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientPID" May 29 02:51:54.870706 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.870587 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasNoDiskPressure" May 29 02:51:54.870706 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.870665 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientPID" May 29 02:51:54.871959 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.871945 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-99.ec2.internal" May 29 02:51:54.872020 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.871970 2574 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach" May 29 02:51:54.872621 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.872604 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientMemory" May 29 02:51:54.872696 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.872634 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasNoDiskPressure" May 29 02:51:54.872696 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.872644 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeHasSufficientPID" May 29 02:51:54.905212 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.905190 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-99.ec2.internal\" not found" node="ip-10-0-138-99.ec2.internal" May 29 02:51:54.909632 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.909615 2574 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-99.ec2.internal\" not found" node="ip-10-0-138-99.ec2.internal" May 29 02:51:54.953847 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:54.953824 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:54.960793 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:54.960771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2feb28360022789ee58ea29552527bef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal\" (UID: \"2feb28360022789ee58ea29552527bef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" May 29 02:51:55.054294 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:55.054262 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:55.061575 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.061540 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2feb28360022789ee58ea29552527bef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal\" (UID: \"2feb28360022789ee58ea29552527bef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" May 29 02:51:55.061660 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.061592 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2feb28360022789ee58ea29552527bef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal\" (UID: \"2feb28360022789ee58ea29552527bef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" May 29 02:51:55.061660 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.061620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e354e43296421427a44b6f8a2873628d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-99.ec2.internal\" (UID: \"e354e43296421427a44b6f8a2873628d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-99.ec2.internal" May 29 02:51:55.061729 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.061661 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2feb28360022789ee58ea29552527bef-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal\" (UID: \"2feb28360022789ee58ea29552527bef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" May 29 02:51:55.155046 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:55.154975 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:55.162391 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.162368 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2feb28360022789ee58ea29552527bef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal\" (UID: \"2feb28360022789ee58ea29552527bef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" May 29 02:51:55.162449 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.162434 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e354e43296421427a44b6f8a2873628d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-99.ec2.internal\" (UID: \"e354e43296421427a44b6f8a2873628d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-99.ec2.internal" May 29 02:51:55.162492 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.162397 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/e354e43296421427a44b6f8a2873628d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-99.ec2.internal\" (UID: \"e354e43296421427a44b6f8a2873628d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-99.ec2.internal" May 29 02:51:55.162492 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.162453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2feb28360022789ee58ea29552527bef-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal\" (UID: \"2feb28360022789ee58ea29552527bef\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" May 29 02:51:55.208557 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.208515 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" May 29 02:51:55.212170 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.212154 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-99.ec2.internal" May 29 02:51:55.255795 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:55.255765 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:55.356248 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:55.356223 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:55.456773 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:55.456707 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:55.554255 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.554222 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" May 29 02:51:55.554900 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.554396 2574 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" May 29 02:51:55.557360 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:55.557340 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:55.657568 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:55.657395 2574 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-99.ec2.internal\" not found" May 29 02:51:55.660787 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.660765 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" May 29 02:51:55.673105 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.673075 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 02:46:54 +0000 UTC" deadline="2027-11-07 23:29:26.29832089 +0000 UTC" May 29 02:51:55.673105 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.673103 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12668h37m30.625221548s" May 29 02:51:55.676774 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.676752 2574 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" May 29 02:51:55.684532 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.684286 2574 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" May 29 02:51:55.686198 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.686179 2574 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" May 29 02:51:55.716187 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.716113 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x76gz" May 29 02:51:55.721644 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.721610 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x76gz" May 29 02:51:55.753383 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:55.753347 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode354e43296421427a44b6f8a2873628d.slice/crio-baffc0297b71663f905f4d3fb32f2a6a5a9e26d03b99a6a2a591a013118e6ed5 WatchSource:0}: Error finding container baffc0297b71663f905f4d3fb32f2a6a5a9e26d03b99a6a2a591a013118e6ed5: Status 404 returned error can't find the container with id baffc0297b71663f905f4d3fb32f2a6a5a9e26d03b99a6a2a591a013118e6ed5 May 29 02:51:55.753631 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:55.753608 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2feb28360022789ee58ea29552527bef.slice/crio-5f0a4e9a7232a28589f60647973d52e38447468620908966f5df348f4a64de1a WatchSource:0}: Error finding container 5f0a4e9a7232a28589f60647973d52e38447468620908966f5df348f4a64de1a: Status 404 returned error can't find the container with id 5f0a4e9a7232a28589f60647973d52e38447468620908966f5df348f4a64de1a May 29 02:51:55.756708 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.756692 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 02:51:55.760117 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.760095 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" May 29 02:51:55.769685 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.769644 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-99.ec2.internal" event={"ID":"e354e43296421427a44b6f8a2873628d","Type":"ContainerStarted","Data":"baffc0297b71663f905f4d3fb32f2a6a5a9e26d03b99a6a2a591a013118e6ed5"} May 29 02:51:55.770646 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.770626 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" event={"ID":"2feb28360022789ee58ea29552527bef","Type":"ContainerStarted","Data":"5f0a4e9a7232a28589f60647973d52e38447468620908966f5df348f4a64de1a"} May 29 02:51:55.772793 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.772777 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 02:51:55.774092 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.774079 2574 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-99.ec2.internal" May 29 02:51:55.782295 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:55.782281 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" May 29 02:51:56.105302 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.105216 2574 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" May 29 02:51:56.452165 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.452089 2574 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" May 29 02:51:56.635384 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.635359 2574 apiserver.go:52] "Watching apiserver" May 29 02:51:56.645290 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.645258 2574 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" May 29 02:51:56.645722 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.645697 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-pkzpj","kube-system/kube-apiserver-proxy-ip-10-0-138-99.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn","openshift-cluster-node-tuning-operator/tuned-kc9kt","openshift-dns/node-resolver-cjqvf","openshift-image-registry/node-ca-d6f8c","openshift-multus/multus-additional-cni-plugins-bzz2d","openshift-network-diagnostics/network-check-target-gjk6c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal","openshift-multus/multus-dhp4j","openshift-multus/network-metrics-daemon-lrnzd","openshift-network-operator/iptables-alerter-hxfl8","openshift-ovn-kubernetes/ovnkube-node-4shwz"] May 29 02:51:56.648465 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.648441 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dhp4j" May 29 02:51:56.650605 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.650582 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.651191 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.651171 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5bvjx\"" May 29 02:51:56.651191 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.651185 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" May 29 02:51:56.651354 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.651251 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" May 29 02:51:56.651354 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.651323 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" May 29 02:51:56.651462 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.651446 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" May 29 02:51:56.653491 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.652755 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.653491 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.652928 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" May 29 02:51:56.653491 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.652999 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" May 29 02:51:56.653491 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.653124 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" May 29 02:51:56.653491 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.653372 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jnhw7\"" May 29 02:51:56.654785 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.654766 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cjqvf" May 29 02:51:56.655089 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.655070 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" May 29 02:51:56.655209 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.655190 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tw5g8\"" May 29 02:51:56.655451 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.655436 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" May 29 02:51:56.657247 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.656969 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6f8c" May 29 02:51:56.657247 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.657043 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" May 29 02:51:56.657247 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.657046 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cqpcw\"" May 29 02:51:56.657721 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.657511 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" May 29 02:51:56.659349 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.659326 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.660623 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.660600 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" May 29 02:51:56.660791 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.660772 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" May 29 02:51:56.660888 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.660873 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" May 29 02:51:56.662372 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.661720 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:51:56.662372 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:56.661831 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:51:56.662372 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.662225 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bwb9l\"" May 29 02:51:56.663144 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.663003 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c6kpz\"" May 29 02:51:56.663144 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.663117 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" May 29 02:51:56.663271 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.663154 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" May 29 02:51:56.664325 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.664215 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pkzpj" May 29 02:51:56.667023 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.666976 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" May 29 02:51:56.667119 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.667068 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" May 29 02:51:56.667119 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.667070 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-tr5lz\"" May 29 02:51:56.667515 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.667495 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:51:56.667609 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:56.667560 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:51:56.669052 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669030 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-run-netns\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.669142 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669074 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-sysctl-conf\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.669142 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669100 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-lib-modules\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.669142 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669123 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-host\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.669302 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669169 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-tuned\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.669302 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5aeb5e0-0955-4e6f-9b7c-9632860d4206-serviceca\") pod \"node-ca-d6f8c\" (UID: \"d5aeb5e0-0955-4e6f-9b7c-9632860d4206\") " pod="openshift-image-registry/node-ca-d6f8c" May 29 02:51:56.669302 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669234 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-cnibin\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.669302 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bcff68d-54ed-4182-9675-e8ddfe09ca39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.669511 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669354 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-cnibin\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.669511 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-run-k8s-cni-cncf-io\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.669511 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669433 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-hostroot\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.669652 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669518 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhkq2\" (UniqueName: \"kubernetes.io/projected/2c191edb-0947-447b-ace1-bd44282da4f7-kube-api-access-mhkq2\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.669652 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669542 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-sysctl-d\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.669652 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669606 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-systemd\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.669652 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669632 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-tmp\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.669842 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669656 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bcff68d-54ed-4182-9675-e8ddfe09ca39-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.669842 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c191edb-0947-447b-ace1-bd44282da4f7-cni-binary-copy\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.669842 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669706 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-var-lib-cni-multus\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.669842 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669729 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-run\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.669842 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5aeb5e0-0955-4e6f-9b7c-9632860d4206-host\") pod \"node-ca-d6f8c\" (UID: \"d5aeb5e0-0955-4e6f-9b7c-9632860d4206\") " pod="openshift-image-registry/node-ca-d6f8c" May 29 02:51:56.669842 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669800 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5swl\" (UniqueName: \"kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl\") pod \"network-check-target-gjk6c\" (UID: \"50124396-13ed-40a4-846c-81ec95b11af1\") " pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:51:56.670108 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-system-cni-dir\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.670108 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669875 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-os-release\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.670108 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669911 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-multus-conf-dir\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.670108 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669967 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxfl8" May 29 02:51:56.670291 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.669968 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-socket-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.670291 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670195 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.670291 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670223 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-modprobe-d\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.670291 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670248 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdglj\" (UniqueName: \"kubernetes.io/projected/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-kube-api-access-zdglj\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.670291 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670273 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-var-lib-kubelet\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.670523 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670329 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-registration-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.670523 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670360 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-kubernetes\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.670523 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670386 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85de5aa3-4f9f-4ebf-b110-c7651ef3933b-hosts-file\") pod \"node-resolver-cjqvf\" (UID: \"85de5aa3-4f9f-4ebf-b110-c7651ef3933b\") " pod="openshift-dns/node-resolver-cjqvf" May 29 02:51:56.670523 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670429 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnp9r\" (UniqueName: \"kubernetes.io/projected/d5aeb5e0-0955-4e6f-9b7c-9632860d4206-kube-api-access-fnp9r\") pod \"node-ca-d6f8c\" (UID: \"d5aeb5e0-0955-4e6f-9b7c-9632860d4206\") " pod="openshift-image-registry/node-ca-d6f8c" May 29 02:51:56.670706 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670492 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.670706 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bcff68d-54ed-4182-9675-e8ddfe09ca39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.670706 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-multus-cni-dir\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.670706 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670632 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-var-lib-cni-bin\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.670706 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670692 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-etc-kubernetes\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.670948 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670723 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-device-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.670948 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-sys\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.670948 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670781 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-os-release\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.670948 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670808 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c191edb-0947-447b-ace1-bd44282da4f7-multus-daemon-config\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.670948 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670830 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.670948 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670883 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-sys-fs\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.670948 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k85wt\" (UniqueName: \"kubernetes.io/projected/54aedfd3-46e9-430a-a468-25887a7f335e-kube-api-access-k85wt\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.670948 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85de5aa3-4f9f-4ebf-b110-c7651ef3933b-tmp-dir\") pod \"node-resolver-cjqvf\" (UID: \"85de5aa3-4f9f-4ebf-b110-c7651ef3933b\") " pod="openshift-dns/node-resolver-cjqvf" May 29 02:51:56.670948 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670944 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm8pk\" (UniqueName: \"kubernetes.io/projected/3bcff68d-54ed-4182-9675-e8ddfe09ca39-kube-api-access-bm8pk\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.671405 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670963 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-multus-socket-dir-parent\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.671405 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.670986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-run-multus-certs\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.671405 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.671009 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-sysconfig\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.671405 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.671032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-var-lib-kubelet\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.671405 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.671058 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tppsv\" (UniqueName: \"kubernetes.io/projected/85de5aa3-4f9f-4ebf-b110-c7651ef3933b-kube-api-access-tppsv\") pod \"node-resolver-cjqvf\" (UID: \"85de5aa3-4f9f-4ebf-b110-c7651ef3933b\") " pod="openshift-dns/node-resolver-cjqvf" May 29 02:51:56.671405 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.671078 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-system-cni-dir\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.672181 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.672126 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" May 29 02:51:56.672181 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.672136 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wg7m9\"" May 29 02:51:56.672181 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.672171 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" May 29 02:51:56.672482 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.672296 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.672482 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.672416 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" May 29 02:51:56.674585 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.674565 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" May 29 02:51:56.674954 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.674916 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4g58k\"" May 29 02:51:56.675752 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.675732 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" May 29 02:51:56.675850 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.675791 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" May 29 02:51:56.675850 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.675807 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" May 29 02:51:56.676027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.675992 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" May 29 02:51:56.676106 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.676039 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" May 29 02:51:56.722760 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.722733 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 02:46:55 +0000 UTC" deadline="2028-01-28 13:13:31.482667505 +0000 UTC" May 29 02:51:56.722760 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.722757 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14626h21m34.759913325s" May 29 02:51:56.760497 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.760468 2574 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world" May 29 02:51:56.771386 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771357 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-hostroot\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.771547 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771401 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mhkq2\" (UniqueName: \"kubernetes.io/projected/2c191edb-0947-447b-ace1-bd44282da4f7-kube-api-access-mhkq2\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.771547 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-hostroot\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.771547 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771514 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-tmp\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.771547 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771539 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bcff68d-54ed-4182-9675-e8ddfe09ca39-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.771749 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771563 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-run-systemd\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.771749 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771588 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-ovnkube-script-lib\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.771749 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771613 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c191edb-0947-447b-ace1-bd44282da4f7-cni-binary-copy\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.771749 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771671 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-var-lib-cni-multus\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.771749 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771710 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5aeb5e0-0955-4e6f-9b7c-9632860d4206-host\") pod \"node-ca-d6f8c\" (UID: \"d5aeb5e0-0955-4e6f-9b7c-9632860d4206\") " pod="openshift-image-registry/node-ca-d6f8c" May 29 02:51:56.771749 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771741 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-run-netns\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.772029 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771766 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-system-cni-dir\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772029 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-var-lib-cni-multus\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772029 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771794 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zdglj\" (UniqueName: \"kubernetes.io/projected/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-kube-api-access-zdglj\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.772029 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771823 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnrdv\" (UniqueName: \"kubernetes.io/projected/188be971-e394-40d2-839e-47486bbfbe82-kube-api-access-xnrdv\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:51:56.772029 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771859 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-var-lib-kubelet\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772029 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771889 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-system-cni-dir\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772029 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771935 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-var-lib-kubelet\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772029 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771940 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85de5aa3-4f9f-4ebf-b110-c7651ef3933b-hosts-file\") pod \"node-resolver-cjqvf\" (UID: \"85de5aa3-4f9f-4ebf-b110-c7651ef3933b\") " pod="openshift-dns/node-resolver-cjqvf" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772027 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772046 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5aeb5e0-0955-4e6f-9b7c-9632860d4206-host\") pod \"node-ca-d6f8c\" (UID: \"d5aeb5e0-0955-4e6f-9b7c-9632860d4206\") " pod="openshift-image-registry/node-ca-d6f8c" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.771891 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/85de5aa3-4f9f-4ebf-b110-c7651ef3933b-hosts-file\") pod \"node-resolver-cjqvf\" (UID: \"85de5aa3-4f9f-4ebf-b110-c7651ef3933b\") " pod="openshift-dns/node-resolver-cjqvf" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772108 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-multus-cni-dir\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772143 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2c191edb-0947-447b-ace1-bd44282da4f7-cni-binary-copy\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772146 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-var-lib-cni-bin\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772179 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-var-lib-cni-bin\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772182 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-etc-kubernetes\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772224 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-etc-kubernetes\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772216 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-device-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772239 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bcff68d-54ed-4182-9675-e8ddfe09ca39-cni-binary-copy\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772259 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-os-release\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772286 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-844cr\" (UniqueName: \"kubernetes.io/projected/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-kube-api-access-844cr\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772297 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-device-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772189 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-multus-cni-dir\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772337 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-os-release\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-env-overrides\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.772418 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772397 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-run-multus-certs\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772423 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-sysconfig\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772441 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-run-multus-certs\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772443 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-var-lib-kubelet\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-var-lib-kubelet\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772477 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tppsv\" (UniqueName: \"kubernetes.io/projected/85de5aa3-4f9f-4ebf-b110-c7651ef3933b-kube-api-access-tppsv\") pod \"node-resolver-cjqvf\" (UID: \"85de5aa3-4f9f-4ebf-b110-c7651ef3933b\") " pod="openshift-dns/node-resolver-cjqvf" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-sysconfig\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772506 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772539 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-systemd-units\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772558 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-log-socket\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-cni-bin\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772602 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-run-netns\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772624 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-lib-modules\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772657 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-run-netns\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772688 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-host\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772709 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5aeb5e0-0955-4e6f-9b7c-9632860d4206-serviceca\") pod \"node-ca-d6f8c\" (UID: \"d5aeb5e0-0955-4e6f-9b7c-9632860d4206\") " pod="openshift-image-registry/node-ca-d6f8c" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772731 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-cnibin\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772740 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-host\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.773213 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772712 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-lib-modules\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772752 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bcff68d-54ed-4182-9675-e8ddfe09ca39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772780 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-cnibin\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772791 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-node-log\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772813 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-ovnkube-config\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772834 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-cnibin\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772854 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-run-k8s-cni-cncf-io\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772881 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-sysctl-d\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772900 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-systemd\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772921 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5swl\" (UniqueName: \"kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl\") pod \"network-check-target-gjk6c\" (UID: \"50124396-13ed-40a4-846c-81ec95b11af1\") " pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772941 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-cni-netd\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772961 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-run\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.772982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a789f680-4be3-41a1-bc7e-3aee7deab1a7-iptables-alerter-script\") pod \"iptables-alerter-hxfl8\" (UID: \"a789f680-4be3-41a1-bc7e-3aee7deab1a7\") " pod="openshift-network-operator/iptables-alerter-hxfl8" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773017 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-run-ovn\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773089 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-systemd\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773096 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-sysctl-d\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773095 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5aeb5e0-0955-4e6f-9b7c-9632860d4206-serviceca\") pod \"node-ca-d6f8c\" (UID: \"d5aeb5e0-0955-4e6f-9b7c-9632860d4206\") " pod="openshift-image-registry/node-ca-d6f8c" May 29 02:51:56.774025 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773138 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-run-ovn-kubernetes\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773150 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-run\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-ovn-node-metrics-cert\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773225 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-os-release\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773236 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-host-run-k8s-cni-cncf-io\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773239 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bcff68d-54ed-4182-9675-e8ddfe09ca39-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773269 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-multus-conf-dir\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773279 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-cnibin\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773303 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-os-release\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773361 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-multus-conf-dir\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773361 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-socket-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773393 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773459 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-modprobe-d\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773508 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fnp9r\" (UniqueName: \"kubernetes.io/projected/d5aeb5e0-0955-4e6f-9b7c-9632860d4206-kube-api-access-fnp9r\") pod \"node-ca-d6f8c\" (UID: \"d5aeb5e0-0955-4e6f-9b7c-9632860d4206\") " pod="openshift-image-registry/node-ca-d6f8c" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-socket-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773576 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-modprobe-d\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.774763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773624 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773689 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-registration-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773733 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-kubernetes\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773755 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-registration-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773760 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bcff68d-54ed-4182-9675-e8ddfe09ca39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773793 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-kubernetes\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773813 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773843 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-sys\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773868 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bm8pk\" (UniqueName: \"kubernetes.io/projected/3bcff68d-54ed-4182-9675-e8ddfe09ca39-kube-api-access-bm8pk\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773892 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cbcd458a-5ca0-441c-895b-26df96b08e82-konnectivity-ca\") pod \"konnectivity-agent-pkzpj\" (UID: \"cbcd458a-5ca0-441c-895b-26df96b08e82\") " pod="kube-system/konnectivity-agent-pkzpj" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773918 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a789f680-4be3-41a1-bc7e-3aee7deab1a7-host-slash\") pod \"iptables-alerter-hxfl8\" (UID: \"a789f680-4be3-41a1-bc7e-3aee7deab1a7\") " pod="openshift-network-operator/iptables-alerter-hxfl8" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773925 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-sys\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773960 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnz6k\" (UniqueName: \"kubernetes.io/projected/a789f680-4be3-41a1-bc7e-3aee7deab1a7-kube-api-access-dnz6k\") pod \"iptables-alerter-hxfl8\" (UID: \"a789f680-4be3-41a1-bc7e-3aee7deab1a7\") " pod="openshift-network-operator/iptables-alerter-hxfl8" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.773988 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c191edb-0947-447b-ace1-bd44282da4f7-multus-daemon-config\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774013 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.775377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774036 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-sys-fs\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774062 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k85wt\" (UniqueName: \"kubernetes.io/projected/54aedfd3-46e9-430a-a468-25887a7f335e-kube-api-access-k85wt\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774085 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85de5aa3-4f9f-4ebf-b110-c7651ef3933b-tmp-dir\") pod \"node-resolver-cjqvf\" (UID: \"85de5aa3-4f9f-4ebf-b110-c7651ef3933b\") " pod="openshift-dns/node-resolver-cjqvf" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774109 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-kubelet\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-var-lib-openvswitch\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774183 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-etc-openvswitch\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bcff68d-54ed-4182-9675-e8ddfe09ca39-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774223 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-multus-socket-dir-parent\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774248 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-system-cni-dir\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774273 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-sysctl-conf\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774295 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-tuned\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774356 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cbcd458a-5ca0-441c-895b-26df96b08e82-agent-certs\") pod \"konnectivity-agent-pkzpj\" (UID: \"cbcd458a-5ca0-441c-895b-26df96b08e82\") " pod="kube-system/konnectivity-agent-pkzpj" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774381 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-slash\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-run-openvswitch\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774455 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bcff68d-54ed-4182-9675-e8ddfe09ca39-system-cni-dir\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774505 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85de5aa3-4f9f-4ebf-b110-c7651ef3933b-tmp-dir\") pod \"node-resolver-cjqvf\" (UID: \"85de5aa3-4f9f-4ebf-b110-c7651ef3933b\") " pod="openshift-dns/node-resolver-cjqvf" May 29 02:51:56.776027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774567 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2c191edb-0947-447b-ace1-bd44282da4f7-multus-socket-dir-parent\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.776830 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774594 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-sysctl-conf\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.776830 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774611 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/54aedfd3-46e9-430a-a468-25887a7f335e-sys-fs\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.776830 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.774679 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2c191edb-0947-447b-ace1-bd44282da4f7-multus-daemon-config\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.776830 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.775882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-tmp\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.776830 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.776561 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-etc-tuned\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.780085 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:56.780037 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 02:51:56.780085 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:56.780058 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 02:51:56.780085 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:56.780070 2574 projected.go:194] Error preparing data for projected volume kube-api-access-h5swl for pod openshift-network-diagnostics/network-check-target-gjk6c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:51:56.780328 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:56.780139 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl podName:50124396-13ed-40a4-846c-81ec95b11af1 nodeName:}" failed. No retries permitted until 2026-05-29 02:51:57.280120781 +0000 UTC m=+3.116893950 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h5swl" (UniqueName: "kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl") pod "network-check-target-gjk6c" (UID: "50124396-13ed-40a4-846c-81ec95b11af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:51:56.782918 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.782896 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnp9r\" (UniqueName: \"kubernetes.io/projected/d5aeb5e0-0955-4e6f-9b7c-9632860d4206-kube-api-access-fnp9r\") pod \"node-ca-d6f8c\" (UID: \"d5aeb5e0-0955-4e6f-9b7c-9632860d4206\") " pod="openshift-image-registry/node-ca-d6f8c" May 29 02:51:56.783027 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.782924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhkq2\" (UniqueName: \"kubernetes.io/projected/2c191edb-0947-447b-ace1-bd44282da4f7-kube-api-access-mhkq2\") pod \"multus-dhp4j\" (UID: \"2c191edb-0947-447b-ace1-bd44282da4f7\") " pod="openshift-multus/multus-dhp4j" May 29 02:51:56.783675 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.783653 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdglj\" (UniqueName: \"kubernetes.io/projected/c4fa84ee-7679-49fe-a16b-fe58fe6f2be7-kube-api-access-zdglj\") pod \"tuned-kc9kt\" (UID: \"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7\") " pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.783876 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.783850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k85wt\" (UniqueName: \"kubernetes.io/projected/54aedfd3-46e9-430a-a468-25887a7f335e-kube-api-access-k85wt\") pod \"aws-ebs-csi-driver-node-5q5rn\" (UID: \"54aedfd3-46e9-430a-a468-25887a7f335e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.784074 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.784054 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tppsv\" (UniqueName: \"kubernetes.io/projected/85de5aa3-4f9f-4ebf-b110-c7651ef3933b-kube-api-access-tppsv\") pod \"node-resolver-cjqvf\" (UID: \"85de5aa3-4f9f-4ebf-b110-c7651ef3933b\") " pod="openshift-dns/node-resolver-cjqvf" May 29 02:51:56.784487 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.784468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm8pk\" (UniqueName: \"kubernetes.io/projected/3bcff68d-54ed-4182-9675-e8ddfe09ca39-kube-api-access-bm8pk\") pod \"multus-additional-cni-plugins-bzz2d\" (UID: \"3bcff68d-54ed-4182-9675-e8ddfe09ca39\") " pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.874836 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.874795 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-kubelet\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.874836 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.874852 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-var-lib-openvswitch\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875062 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.874874 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-etc-openvswitch\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875062 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.874897 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cbcd458a-5ca0-441c-895b-26df96b08e82-agent-certs\") pod \"konnectivity-agent-pkzpj\" (UID: \"cbcd458a-5ca0-441c-895b-26df96b08e82\") " pod="kube-system/konnectivity-agent-pkzpj" May 29 02:51:56.875062 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.874916 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-slash\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875062 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.874934 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-run-openvswitch\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875062 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.874940 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-var-lib-openvswitch\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875062 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.874960 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-run-systemd\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875062 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875009 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-run-openvswitch\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875062 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875016 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-slash\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875062 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875018 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-ovnkube-script-lib\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875062 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875055 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-run-systemd\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875067 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-run-netns\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875097 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-etc-openvswitch\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875097 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xnrdv\" (UniqueName: \"kubernetes.io/projected/188be971-e394-40d2-839e-47486bbfbe82-kube-api-access-xnrdv\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875139 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-844cr\" (UniqueName: \"kubernetes.io/projected/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-kube-api-access-844cr\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875164 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-env-overrides\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875189 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875211 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-systemd-units\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875235 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-log-socket\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875016 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-kubelet\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875258 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-cni-bin\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875293 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-node-log\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875298 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-run-netns\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875334 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-ovnkube-config\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-systemd-units\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875375 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-cni-netd\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875404 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a789f680-4be3-41a1-bc7e-3aee7deab1a7-iptables-alerter-script\") pod \"iptables-alerter-hxfl8\" (UID: \"a789f680-4be3-41a1-bc7e-3aee7deab1a7\") " pod="openshift-network-operator/iptables-alerter-hxfl8" May 29 02:51:56.875455 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875432 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-run-ovn\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875437 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-log-socket\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875456 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-run-ovn-kubernetes\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875480 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-ovn-node-metrics-cert\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875518 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875544 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cbcd458a-5ca0-441c-895b-26df96b08e82-konnectivity-ca\") pod \"konnectivity-agent-pkzpj\" (UID: \"cbcd458a-5ca0-441c-895b-26df96b08e82\") " pod="kube-system/konnectivity-agent-pkzpj" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875569 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a789f680-4be3-41a1-bc7e-3aee7deab1a7-host-slash\") pod \"iptables-alerter-hxfl8\" (UID: \"a789f680-4be3-41a1-bc7e-3aee7deab1a7\") " pod="openshift-network-operator/iptables-alerter-hxfl8" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875595 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dnz6k\" (UniqueName: \"kubernetes.io/projected/a789f680-4be3-41a1-bc7e-3aee7deab1a7-kube-api-access-dnz6k\") pod \"iptables-alerter-hxfl8\" (UID: \"a789f680-4be3-41a1-bc7e-3aee7deab1a7\") " pod="openshift-network-operator/iptables-alerter-hxfl8" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875673 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-ovnkube-script-lib\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:56.875684 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:56.875748 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs podName:188be971-e394-40d2-839e-47486bbfbe82 nodeName:}" failed. No retries permitted until 2026-05-29 02:51:57.375729444 +0000 UTC m=+3.212502623 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs") pod "network-metrics-daemon-lrnzd" (UID: "188be971-e394-40d2-839e-47486bbfbe82") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875819 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-env-overrides\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875881 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-run-ovn\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875894 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875918 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-node-log\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875954 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-cni-netd\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875958 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-run-ovn-kubernetes\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.876203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.875407 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-host-cni-bin\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.877072 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.876192 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a789f680-4be3-41a1-bc7e-3aee7deab1a7-host-slash\") pod \"iptables-alerter-hxfl8\" (UID: \"a789f680-4be3-41a1-bc7e-3aee7deab1a7\") " pod="openshift-network-operator/iptables-alerter-hxfl8" May 29 02:51:56.877072 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.876469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cbcd458a-5ca0-441c-895b-26df96b08e82-konnectivity-ca\") pod \"konnectivity-agent-pkzpj\" (UID: \"cbcd458a-5ca0-441c-895b-26df96b08e82\") " pod="kube-system/konnectivity-agent-pkzpj" May 29 02:51:56.877072 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.876469 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/a789f680-4be3-41a1-bc7e-3aee7deab1a7-iptables-alerter-script\") pod \"iptables-alerter-hxfl8\" (UID: \"a789f680-4be3-41a1-bc7e-3aee7deab1a7\") " pod="openshift-network-operator/iptables-alerter-hxfl8" May 29 02:51:56.877072 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.876518 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-ovnkube-config\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.878030 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.878005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cbcd458a-5ca0-441c-895b-26df96b08e82-agent-certs\") pod \"konnectivity-agent-pkzpj\" (UID: \"cbcd458a-5ca0-441c-895b-26df96b08e82\") " pod="kube-system/konnectivity-agent-pkzpj" May 29 02:51:56.878553 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.878529 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-ovn-node-metrics-cert\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.884357 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.884302 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-844cr\" (UniqueName: \"kubernetes.io/projected/a74ab30e-b6a3-4f89-83b3-5819e6dc8959-kube-api-access-844cr\") pod \"ovnkube-node-4shwz\" (UID: \"a74ab30e-b6a3-4f89-83b3-5819e6dc8959\") " pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:56.884726 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.884696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnz6k\" (UniqueName: \"kubernetes.io/projected/a789f680-4be3-41a1-bc7e-3aee7deab1a7-kube-api-access-dnz6k\") pod \"iptables-alerter-hxfl8\" (UID: \"a789f680-4be3-41a1-bc7e-3aee7deab1a7\") " pod="openshift-network-operator/iptables-alerter-hxfl8" May 29 02:51:56.884832 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.884738 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnrdv\" (UniqueName: \"kubernetes.io/projected/188be971-e394-40d2-839e-47486bbfbe82-kube-api-access-xnrdv\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:51:56.961781 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.961690 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dhp4j" May 29 02:51:56.969518 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.969494 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" May 29 02:51:56.981133 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.981111 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" May 29 02:51:56.986661 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.986638 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" May 29 02:51:56.993153 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.993119 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-cjqvf" May 29 02:51:56.998694 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:56.998674 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d6f8c" May 29 02:51:57.005200 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.005181 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pkzpj" May 29 02:51:57.012779 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.012758 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxfl8" May 29 02:51:57.018423 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.018385 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:51:57.358396 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:57.358372 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4fa84ee_7679_49fe_a16b_fe58fe6f2be7.slice/crio-b255928c638d6bc94004e905bf182ebff38a4331525ea0de057288b5cede93f6 WatchSource:0}: Error finding container b255928c638d6bc94004e905bf182ebff38a4331525ea0de057288b5cede93f6: Status 404 returned error can't find the container with id b255928c638d6bc94004e905bf182ebff38a4331525ea0de057288b5cede93f6 May 29 02:51:57.359060 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:57.359030 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5aeb5e0_0955_4e6f_9b7c_9632860d4206.slice/crio-6b3731aa639324c14a92d19f8bb8df4e9f246b3dfda87293088e92edc98231f5 WatchSource:0}: Error finding container 6b3731aa639324c14a92d19f8bb8df4e9f246b3dfda87293088e92edc98231f5: Status 404 returned error can't find the container with id 6b3731aa639324c14a92d19f8bb8df4e9f246b3dfda87293088e92edc98231f5 May 29 02:51:57.360326 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:57.360264 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda789f680_4be3_41a1_bc7e_3aee7deab1a7.slice/crio-e06a94e2b67022779b5c32f5c045158574b6c66295327b6c3930416743176895 WatchSource:0}: Error finding container e06a94e2b67022779b5c32f5c045158574b6c66295327b6c3930416743176895: Status 404 returned error can't find the container with id e06a94e2b67022779b5c32f5c045158574b6c66295327b6c3930416743176895 May 29 02:51:57.367679 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:57.367626 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c191edb_0947_447b_ace1_bd44282da4f7.slice/crio-661c1d0c0391971fdd56487008f3c3f80018ce99274caa8e59ba837e6ea83a47 WatchSource:0}: Error finding container 661c1d0c0391971fdd56487008f3c3f80018ce99274caa8e59ba837e6ea83a47: Status 404 returned error can't find the container with id 661c1d0c0391971fdd56487008f3c3f80018ce99274caa8e59ba837e6ea83a47 May 29 02:51:57.368594 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:57.368569 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbcd458a_5ca0_441c_895b_26df96b08e82.slice/crio-ecaf79331ec9f41d427ba876e4911ee961fdce0208c71e8d1cb6bfe0f15c402b WatchSource:0}: Error finding container ecaf79331ec9f41d427ba876e4911ee961fdce0208c71e8d1cb6bfe0f15c402b: Status 404 returned error can't find the container with id ecaf79331ec9f41d427ba876e4911ee961fdce0208c71e8d1cb6bfe0f15c402b May 29 02:51:57.369373 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:57.369353 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda74ab30e_b6a3_4f89_83b3_5819e6dc8959.slice/crio-456c1852b067db6d6be97c3a5ea8f1a3eec99a3c23e1abab26b5c1d123fd1a32 WatchSource:0}: Error finding container 456c1852b067db6d6be97c3a5ea8f1a3eec99a3c23e1abab26b5c1d123fd1a32: Status 404 returned error can't find the container with id 456c1852b067db6d6be97c3a5ea8f1a3eec99a3c23e1abab26b5c1d123fd1a32 May 29 02:51:57.370378 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:57.370358 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bcff68d_54ed_4182_9675_e8ddfe09ca39.slice/crio-8bcd2fb77b63176eeb1aebff332d80334025a1e427c544397381e9be6983e47e WatchSource:0}: Error finding container 8bcd2fb77b63176eeb1aebff332d80334025a1e427c544397381e9be6983e47e: Status 404 returned error can't find the container with id 8bcd2fb77b63176eeb1aebff332d80334025a1e427c544397381e9be6983e47e May 29 02:51:57.371935 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:51:57.371607 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54aedfd3_46e9_430a_a468_25887a7f335e.slice/crio-e19c970f14d418184090123b90e5b4b832b5d8670a072e259bba2aeffa4cfc66 WatchSource:0}: Error finding container e19c970f14d418184090123b90e5b4b832b5d8670a072e259bba2aeffa4cfc66: Status 404 returned error can't find the container with id e19c970f14d418184090123b90e5b4b832b5d8670a072e259bba2aeffa4cfc66 May 29 02:51:57.378804 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.378787 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:51:57.378882 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.378817 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5swl\" (UniqueName: \"kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl\") pod \"network-check-target-gjk6c\" (UID: \"50124396-13ed-40a4-846c-81ec95b11af1\") " pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:51:57.378934 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:57.378919 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:51:57.379024 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:57.378966 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs podName:188be971-e394-40d2-839e-47486bbfbe82 nodeName:}" failed. No retries permitted until 2026-05-29 02:51:58.378953871 +0000 UTC m=+4.215727028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs") pod "network-metrics-daemon-lrnzd" (UID: "188be971-e394-40d2-839e-47486bbfbe82") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:51:57.379024 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:57.378927 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 02:51:57.379024 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:57.378990 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 02:51:57.379024 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:57.379003 2574 projected.go:194] Error preparing data for projected volume kube-api-access-h5swl for pod openshift-network-diagnostics/network-check-target-gjk6c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:51:57.379227 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:57.379036 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl podName:50124396-13ed-40a4-846c-81ec95b11af1 nodeName:}" failed. No retries permitted until 2026-05-29 02:51:58.379026089 +0000 UTC m=+4.215799255 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5swl" (UniqueName: "kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl") pod "network-check-target-gjk6c" (UID: "50124396-13ed-40a4-846c-81ec95b11af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:51:57.723336 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.723138 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 02:46:55 +0000 UTC" deadline="2028-01-17 07:57:40.621526114 +0000 UTC" May 29 02:51:57.723336 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.723329 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14357h5m42.898201617s" May 29 02:51:57.777519 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.776851 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-99.ec2.internal" event={"ID":"e354e43296421427a44b6f8a2873628d","Type":"ContainerStarted","Data":"9400246435e8493e4cd52b65ad4c6b59504728545ed78a631cedd3b1a07304ac"} May 29 02:51:57.781411 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.781360 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cjqvf" event={"ID":"85de5aa3-4f9f-4ebf-b110-c7651ef3933b","Type":"ContainerStarted","Data":"8871edc3369425a1e1911552ebdcfb2adb283dd6683a34dcef1e3efa8ae3151d"} May 29 02:51:57.783004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.782977 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxfl8" event={"ID":"a789f680-4be3-41a1-bc7e-3aee7deab1a7","Type":"ContainerStarted","Data":"e06a94e2b67022779b5c32f5c045158574b6c66295327b6c3930416743176895"} May 29 02:51:57.786591 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.786564 2574 generic.go:358] "Generic (PLEG): container finished" podID="2feb28360022789ee58ea29552527bef" containerID="394cdda0fb62d4f19fd7aba77bdb6e4178fb11225fb639900f9d81fa9985870d" exitCode=0 May 29 02:51:57.786684 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.786631 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" event={"ID":"2feb28360022789ee58ea29552527bef","Type":"ContainerDied","Data":"394cdda0fb62d4f19fd7aba77bdb6e4178fb11225fb639900f9d81fa9985870d"} May 29 02:51:57.792072 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.792041 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" event={"ID":"54aedfd3-46e9-430a-a468-25887a7f335e","Type":"ContainerStarted","Data":"e19c970f14d418184090123b90e5b4b832b5d8670a072e259bba2aeffa4cfc66"} May 29 02:51:57.794783 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.794735 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" event={"ID":"3bcff68d-54ed-4182-9675-e8ddfe09ca39","Type":"ContainerStarted","Data":"8bcd2fb77b63176eeb1aebff332d80334025a1e427c544397381e9be6983e47e"} May 29 02:51:57.800162 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.800104 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" event={"ID":"a74ab30e-b6a3-4f89-83b3-5819e6dc8959","Type":"ContainerStarted","Data":"456c1852b067db6d6be97c3a5ea8f1a3eec99a3c23e1abab26b5c1d123fd1a32"} May 29 02:51:57.804209 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.803587 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-99.ec2.internal" podStartSLOduration=2.803571873 podStartE2EDuration="2.803571873s" podCreationTimestamp="2026-05-29 02:51:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:51:57.802800202 +0000 UTC m=+3.639573379" watchObservedRunningTime="2026-05-29 02:51:57.803571873 +0000 UTC m=+3.640345050" May 29 02:51:57.805415 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.805123 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pkzpj" event={"ID":"cbcd458a-5ca0-441c-895b-26df96b08e82","Type":"ContainerStarted","Data":"ecaf79331ec9f41d427ba876e4911ee961fdce0208c71e8d1cb6bfe0f15c402b"} May 29 02:51:57.808458 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.807434 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dhp4j" event={"ID":"2c191edb-0947-447b-ace1-bd44282da4f7","Type":"ContainerStarted","Data":"661c1d0c0391971fdd56487008f3c3f80018ce99274caa8e59ba837e6ea83a47"} May 29 02:51:57.810615 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.810593 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6f8c" event={"ID":"d5aeb5e0-0955-4e6f-9b7c-9632860d4206","Type":"ContainerStarted","Data":"6b3731aa639324c14a92d19f8bb8df4e9f246b3dfda87293088e92edc98231f5"} May 29 02:51:57.813293 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:57.813115 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" event={"ID":"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7","Type":"ContainerStarted","Data":"b255928c638d6bc94004e905bf182ebff38a4331525ea0de057288b5cede93f6"} May 29 02:51:58.387040 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:58.386222 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:51:58.387040 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:58.386279 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5swl\" (UniqueName: \"kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl\") pod \"network-check-target-gjk6c\" (UID: \"50124396-13ed-40a4-846c-81ec95b11af1\") " pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:51:58.387040 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:58.386427 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 02:51:58.387040 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:58.386444 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 02:51:58.387040 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:58.386457 2574 projected.go:194] Error preparing data for projected volume kube-api-access-h5swl for pod openshift-network-diagnostics/network-check-target-gjk6c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:51:58.387040 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:58.386512 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl podName:50124396-13ed-40a4-846c-81ec95b11af1 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:00.386494429 +0000 UTC m=+6.223267587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5swl" (UniqueName: "kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl") pod "network-check-target-gjk6c" (UID: "50124396-13ed-40a4-846c-81ec95b11af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:51:58.387040 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:58.386901 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:51:58.387040 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:58.386945 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs podName:188be971-e394-40d2-839e-47486bbfbe82 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:00.386931267 +0000 UTC m=+6.223704426 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs") pod "network-metrics-daemon-lrnzd" (UID: "188be971-e394-40d2-839e-47486bbfbe82") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:51:58.771733 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:58.768584 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:51:58.771733 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:58.768702 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:51:58.771733 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:58.771441 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:51:58.771733 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:51:58.771558 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:51:58.831669 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:51:58.831597 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" event={"ID":"2feb28360022789ee58ea29552527bef","Type":"ContainerStarted","Data":"b62795a5134f367eb6d99f120e7db4404f746fd8ed2f4e5206cba592e2f25e2b"} May 29 02:52:00.407278 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:00.407186 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:00.407278 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:00.407257 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5swl\" (UniqueName: \"kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl\") pod \"network-check-target-gjk6c\" (UID: \"50124396-13ed-40a4-846c-81ec95b11af1\") " pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:00.407912 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:00.407442 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:52:00.407912 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:00.407509 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs podName:188be971-e394-40d2-839e-47486bbfbe82 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:04.407488666 +0000 UTC m=+10.244261840 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs") pod "network-metrics-daemon-lrnzd" (UID: "188be971-e394-40d2-839e-47486bbfbe82") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:52:00.407912 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:00.407601 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 02:52:00.407912 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:00.407619 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 02:52:00.407912 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:00.407632 2574 projected.go:194] Error preparing data for projected volume kube-api-access-h5swl for pod openshift-network-diagnostics/network-check-target-gjk6c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:52:00.407912 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:00.407675 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl podName:50124396-13ed-40a4-846c-81ec95b11af1 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:04.407662113 +0000 UTC m=+10.244435281 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5swl" (UniqueName: "kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl") pod "network-check-target-gjk6c" (UID: "50124396-13ed-40a4-846c-81ec95b11af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:52:00.769724 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:00.769125 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:00.769724 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:00.769250 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:00.769724 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:00.769538 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:00.769724 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:00.769654 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:02.769101 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:02.768593 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:02.769101 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:02.768639 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:02.769101 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:02.768761 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:02.769101 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:02.769031 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:04.441934 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:04.441895 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:04.441934 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:04.441953 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5swl\" (UniqueName: \"kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl\") pod \"network-check-target-gjk6c\" (UID: \"50124396-13ed-40a4-846c-81ec95b11af1\") " pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:04.442421 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:04.442068 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:52:04.442421 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:04.442094 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 02:52:04.442421 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:04.442108 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 02:52:04.442421 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:04.442117 2574 projected.go:194] Error preparing data for projected volume kube-api-access-h5swl for pod openshift-network-diagnostics/network-check-target-gjk6c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:52:04.442421 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:04.442150 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs podName:188be971-e394-40d2-839e-47486bbfbe82 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:12.442128649 +0000 UTC m=+18.278901808 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs") pod "network-metrics-daemon-lrnzd" (UID: "188be971-e394-40d2-839e-47486bbfbe82") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:52:04.442421 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:04.442171 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl podName:50124396-13ed-40a4-846c-81ec95b11af1 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:12.442159308 +0000 UTC m=+18.278932467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5swl" (UniqueName: "kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl") pod "network-check-target-gjk6c" (UID: "50124396-13ed-40a4-846c-81ec95b11af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:52:04.774096 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:04.769321 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:04.774096 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:04.769458 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:04.774096 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:04.771336 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:04.774096 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:04.771546 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:06.768405 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:06.768378 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:06.768846 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:06.768378 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:06.768846 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:06.768482 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:06.768846 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:06.768575 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:08.767724 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:08.767669 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:08.768181 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:08.767798 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:08.768181 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:08.767884 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:08.768181 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:08.768007 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:10.768089 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:10.768048 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:10.768504 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:10.768073 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:10.768504 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:10.768190 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:10.768504 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:10.768215 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:12.491252 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:12.491217 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:12.491748 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:12.491265 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5swl\" (UniqueName: \"kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl\") pod \"network-check-target-gjk6c\" (UID: \"50124396-13ed-40a4-846c-81ec95b11af1\") " pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:12.491748 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:12.491397 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:52:12.491748 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:12.491417 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 02:52:12.491748 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:12.491435 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 02:52:12.491748 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:12.491448 2574 projected.go:194] Error preparing data for projected volume kube-api-access-h5swl for pod openshift-network-diagnostics/network-check-target-gjk6c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:52:12.491748 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:12.491473 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs podName:188be971-e394-40d2-839e-47486bbfbe82 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:28.491451904 +0000 UTC m=+34.328225073 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs") pod "network-metrics-daemon-lrnzd" (UID: "188be971-e394-40d2-839e-47486bbfbe82") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:52:12.491748 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:12.491495 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl podName:50124396-13ed-40a4-846c-81ec95b11af1 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:28.491480755 +0000 UTC m=+34.328253911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5swl" (UniqueName: "kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl") pod "network-check-target-gjk6c" (UID: "50124396-13ed-40a4-846c-81ec95b11af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:52:12.768555 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:12.768474 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:12.768716 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:12.768616 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:12.768849 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:12.768816 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:12.768975 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:12.768924 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:14.773371 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:14.773341 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:14.773371 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:14.773369 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:14.773912 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:14.773460 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:14.773912 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:14.773583 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:15.868422 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.868389 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" event={"ID":"a74ab30e-b6a3-4f89-83b3-5819e6dc8959","Type":"ContainerStarted","Data":"cc05e3d53186273c4c541db8d2793d1438e0fcfac5ddc4eec2aa2017acc926d7"} May 29 02:52:15.869050 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.868429 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" event={"ID":"a74ab30e-b6a3-4f89-83b3-5819e6dc8959","Type":"ContainerStarted","Data":"da5327497f256f548a2962e8171e3bede625002dba2ba0643b8f0306c7cdc746"} May 29 02:52:15.870430 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.870265 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pkzpj" event={"ID":"cbcd458a-5ca0-441c-895b-26df96b08e82","Type":"ContainerStarted","Data":"8a774c77ed2a69ee8dceaef4d4a71ef10d4f554b3ba9f2d0dfbd7961d0f32442"} May 29 02:52:15.871867 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.871847 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dhp4j" event={"ID":"2c191edb-0947-447b-ace1-bd44282da4f7","Type":"ContainerStarted","Data":"45ab9c518bd63e56e3f497f94317ff50890936bdc6b6d56b0dcbd759d218680e"} May 29 02:52:15.873147 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.873125 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d6f8c" event={"ID":"d5aeb5e0-0955-4e6f-9b7c-9632860d4206","Type":"ContainerStarted","Data":"d22aab60f7e61e6636f3361c4a7eb348d52161e4f71337b53ca565e687fc3e13"} May 29 02:52:15.874383 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.874350 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" event={"ID":"c4fa84ee-7679-49fe-a16b-fe58fe6f2be7","Type":"ContainerStarted","Data":"03ac1ae3500b695dd1f095cbfb7823c2392acbd36bf8999066fae54a8c8fe2d8"} May 29 02:52:15.875736 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.875716 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-cjqvf" event={"ID":"85de5aa3-4f9f-4ebf-b110-c7651ef3933b","Type":"ContainerStarted","Data":"3e51bacc55acee16cd447dab5c4ca178664afdf6e299176133d798d836c8e29c"} May 29 02:52:15.876999 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.876971 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" event={"ID":"54aedfd3-46e9-430a-a468-25887a7f335e","Type":"ContainerStarted","Data":"5f64300b77461ff346812aedd88aeb7aec79a69ac3343e8ae1c08110e89e4f6c"} May 29 02:52:15.878362 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.878341 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" event={"ID":"3bcff68d-54ed-4182-9675-e8ddfe09ca39","Type":"ContainerStarted","Data":"68489228b905e1c3405ad1b7d32a389dadc699c2146665e79a395d10f6f109bd"} May 29 02:52:15.886042 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.885995 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pkzpj" podStartSLOduration=2.689738159 podStartE2EDuration="20.885981424s" podCreationTimestamp="2026-05-29 02:51:55 +0000 UTC" firstStartedPulling="2026-05-29 02:51:57.370609283 +0000 UTC m=+3.207382436" lastFinishedPulling="2026-05-29 02:52:15.566852546 +0000 UTC m=+21.403625701" observedRunningTime="2026-05-29 02:52:15.885799655 +0000 UTC m=+21.722572832" watchObservedRunningTime="2026-05-29 02:52:15.885981424 +0000 UTC m=+21.722754601" May 29 02:52:15.886465 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.886400 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-99.ec2.internal" podStartSLOduration=20.88639357 podStartE2EDuration="20.88639357s" podCreationTimestamp="2026-05-29 02:51:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:51:58.847381193 +0000 UTC m=+4.684154370" watchObservedRunningTime="2026-05-29 02:52:15.88639357 +0000 UTC m=+21.723166768" May 29 02:52:15.898863 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.898818 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d6f8c" podStartSLOduration=2.693839983 podStartE2EDuration="20.898803414s" podCreationTimestamp="2026-05-29 02:51:55 +0000 UTC" firstStartedPulling="2026-05-29 02:51:57.36226089 +0000 UTC m=+3.199034046" lastFinishedPulling="2026-05-29 02:52:15.567224324 +0000 UTC m=+21.403997477" observedRunningTime="2026-05-29 02:52:15.898775298 +0000 UTC m=+21.735548478" watchObservedRunningTime="2026-05-29 02:52:15.898803414 +0000 UTC m=+21.735576589" May 29 02:52:15.943766 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.943576 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kc9kt" podStartSLOduration=3.737189778 podStartE2EDuration="21.943562649s" podCreationTimestamp="2026-05-29 02:51:54 +0000 UTC" firstStartedPulling="2026-05-29 02:51:57.360550099 +0000 UTC m=+3.197323256" lastFinishedPulling="2026-05-29 02:52:15.566922958 +0000 UTC m=+21.403696127" observedRunningTime="2026-05-29 02:52:15.942530465 +0000 UTC m=+21.779303642" watchObservedRunningTime="2026-05-29 02:52:15.943562649 +0000 UTC m=+21.780335825" May 29 02:52:15.970356 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.970299 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-dhp4j" podStartSLOduration=3.73095015 podStartE2EDuration="21.970285032s" podCreationTimestamp="2026-05-29 02:51:54 +0000 UTC" firstStartedPulling="2026-05-29 02:51:57.369948095 +0000 UTC m=+3.206721252" lastFinishedPulling="2026-05-29 02:52:15.609282971 +0000 UTC m=+21.446056134" observedRunningTime="2026-05-29 02:52:15.970093542 +0000 UTC m=+21.806866719" watchObservedRunningTime="2026-05-29 02:52:15.970285032 +0000 UTC m=+21.807058208" May 29 02:52:15.991532 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:15.991475 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-cjqvf" podStartSLOduration=2.792250507 podStartE2EDuration="20.991455199s" podCreationTimestamp="2026-05-29 02:51:55 +0000 UTC" firstStartedPulling="2026-05-29 02:51:57.36766232 +0000 UTC m=+3.204435480" lastFinishedPulling="2026-05-29 02:52:15.566867014 +0000 UTC m=+21.403640172" observedRunningTime="2026-05-29 02:52:15.989248634 +0000 UTC m=+21.826021810" watchObservedRunningTime="2026-05-29 02:52:15.991455199 +0000 UTC m=+21.828228369" May 29 02:52:16.768584 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:16.768513 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:16.768584 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:16.768512 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:16.768832 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:16.768668 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:16.768832 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:16.768676 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:16.882103 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:16.882064 2574 generic.go:358] "Generic (PLEG): container finished" podID="3bcff68d-54ed-4182-9675-e8ddfe09ca39" containerID="68489228b905e1c3405ad1b7d32a389dadc699c2146665e79a395d10f6f109bd" exitCode=0 May 29 02:52:16.882664 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:16.882133 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" event={"ID":"3bcff68d-54ed-4182-9675-e8ddfe09ca39","Type":"ContainerDied","Data":"68489228b905e1c3405ad1b7d32a389dadc699c2146665e79a395d10f6f109bd"} May 29 02:52:16.885697 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:16.885663 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" event={"ID":"a74ab30e-b6a3-4f89-83b3-5819e6dc8959","Type":"ContainerStarted","Data":"f9dbbea479bb27fd2a7a935588e80f7b8f5b6718353195a97e6386a288b34e5d"} May 29 02:52:16.885697 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:16.885699 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" event={"ID":"a74ab30e-b6a3-4f89-83b3-5819e6dc8959","Type":"ContainerStarted","Data":"6239064b37d41f7f1230a8df79d78687dad74e63c2cd26f2451306cc4b7fb2d1"} May 29 02:52:16.885881 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:16.885713 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" event={"ID":"a74ab30e-b6a3-4f89-83b3-5819e6dc8959","Type":"ContainerStarted","Data":"1240d2e820caa536e9d1c5a0b63b9350c9acae93374ca72fb4f30829c3adb17d"} May 29 02:52:16.885881 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:16.885725 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" event={"ID":"a74ab30e-b6a3-4f89-83b3-5819e6dc8959","Type":"ContainerStarted","Data":"a8d05f8bcfa1eb1115ce331ac533d0a12aa53ca6729210b5bb9634b98bcecfe7"} May 29 02:52:16.930143 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:16.930117 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pkzpj" May 29 02:52:16.930763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:16.930744 2574 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pkzpj" May 29 02:52:16.942878 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:16.942842 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" May 29 02:52:17.742654 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:17.742537 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T02:52:16.942865363Z","UUID":"0f06d60f-865f-4fad-b3ba-27e15852a950","Handler":null,"Name":"","Endpoint":""} May 29 02:52:17.746146 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:17.746109 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 May 29 02:52:17.746146 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:17.746141 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock May 29 02:52:17.888692 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:17.888649 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxfl8" event={"ID":"a789f680-4be3-41a1-bc7e-3aee7deab1a7","Type":"ContainerStarted","Data":"ed1a49354678ba367992387f6f908b099dc86b36e219258eda6400e7765fb904"} May 29 02:52:17.890763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:17.890724 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" event={"ID":"54aedfd3-46e9-430a-a468-25887a7f335e","Type":"ContainerStarted","Data":"e398822949ccbe2efb10e5c1c9ec87c346874b940ee0b72363a9605a1e762d84"} May 29 02:52:17.890763 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:17.890760 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" event={"ID":"54aedfd3-46e9-430a-a468-25887a7f335e","Type":"ContainerStarted","Data":"f36c38d1fa8e954c96aa94e2328ec48dae4b08af1bfcf460738626c06104e08b"} May 29 02:52:17.906203 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:17.906155 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hxfl8" podStartSLOduration=4.696925846 podStartE2EDuration="22.906138571s" podCreationTimestamp="2026-05-29 02:51:55 +0000 UTC" firstStartedPulling="2026-05-29 02:51:57.363443031 +0000 UTC m=+3.200216199" lastFinishedPulling="2026-05-29 02:52:15.572655761 +0000 UTC m=+21.409428924" observedRunningTime="2026-05-29 02:52:17.906073622 +0000 UTC m=+23.742846799" watchObservedRunningTime="2026-05-29 02:52:17.906138571 +0000 UTC m=+23.742911750" May 29 02:52:18.767641 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:18.767607 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:18.767822 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:18.767607 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:18.767822 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:18.767739 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:18.767822 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:18.767793 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:18.896939 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:18.896898 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" event={"ID":"a74ab30e-b6a3-4f89-83b3-5819e6dc8959","Type":"ContainerStarted","Data":"fc270f57bb2cc3662db942c91a8c8a579d82cd08a3c0ee7adf022462f1a638c3"} May 29 02:52:18.897486 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:18.897303 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 29 02:52:20.768375 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:20.768038 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:20.768375 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:20.768090 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:20.768910 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:20.768416 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:20.768910 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:20.768532 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:20.903645 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:20.903603 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" event={"ID":"a74ab30e-b6a3-4f89-83b3-5819e6dc8959","Type":"ContainerStarted","Data":"20e189fa2a1624d36fe160eeb31021d35c93a9bd3bcbf0f0fa976c94213960a0"} May 29 02:52:20.904003 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:20.903974 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:52:20.904138 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:20.904022 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:52:20.905348 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:20.905320 2574 generic.go:358] "Generic (PLEG): container finished" podID="3bcff68d-54ed-4182-9675-e8ddfe09ca39" containerID="7c001f7f2c2ad9febae421a07e8984cb7f94f8de37c835e8dd2139f1b84b19f5" exitCode=0 May 29 02:52:20.905474 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:20.905355 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" event={"ID":"3bcff68d-54ed-4182-9675-e8ddfe09ca39","Type":"ContainerDied","Data":"7c001f7f2c2ad9febae421a07e8984cb7f94f8de37c835e8dd2139f1b84b19f5"} May 29 02:52:20.919533 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:20.919512 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:52:20.919632 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:20.919575 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:52:20.929134 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:20.929098 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" podStartSLOduration=7.646330782 podStartE2EDuration="25.929084322s" podCreationTimestamp="2026-05-29 02:51:55 +0000 UTC" firstStartedPulling="2026-05-29 02:51:57.371271469 +0000 UTC m=+3.208044629" lastFinishedPulling="2026-05-29 02:52:15.654024995 +0000 UTC m=+21.490798169" observedRunningTime="2026-05-29 02:52:20.928431646 +0000 UTC m=+26.765204822" watchObservedRunningTime="2026-05-29 02:52:20.929084322 +0000 UTC m=+26.765857496" May 29 02:52:20.929302 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:20.929283 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5q5rn" podStartSLOduration=6.581667454 podStartE2EDuration="26.929278344s" podCreationTimestamp="2026-05-29 02:51:54 +0000 UTC" firstStartedPulling="2026-05-29 02:51:57.373178766 +0000 UTC m=+3.209951925" lastFinishedPulling="2026-05-29 02:52:17.720789645 +0000 UTC m=+23.557562815" observedRunningTime="2026-05-29 02:52:17.923780933 +0000 UTC m=+23.760554108" watchObservedRunningTime="2026-05-29 02:52:20.929278344 +0000 UTC m=+26.766051521" May 29 02:52:21.907867 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:21.907842 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:52:22.146848 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:22.146678 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pkzpj" May 29 02:52:22.147000 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:22.146978 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" May 29 02:52:22.147230 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:22.147208 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pkzpj" May 29 02:52:22.321116 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:22.321044 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lrnzd"] May 29 02:52:22.321241 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:22.321159 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:22.321285 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:22.321263 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:22.323188 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:22.323165 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gjk6c"] May 29 02:52:22.323296 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:22.323267 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:22.323382 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:22.323356 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:22.910594 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:22.910564 2574 generic.go:358] "Generic (PLEG): container finished" podID="3bcff68d-54ed-4182-9675-e8ddfe09ca39" containerID="87e46843ff7369c6b3b8b20f48a7a75e13f3cdb5f918b2f0d46b4d6238983de2" exitCode=0 May 29 02:52:22.911040 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:22.910651 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" event={"ID":"3bcff68d-54ed-4182-9675-e8ddfe09ca39","Type":"ContainerDied","Data":"87e46843ff7369c6b3b8b20f48a7a75e13f3cdb5f918b2f0d46b4d6238983de2"} May 29 02:52:23.768239 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:23.768160 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:23.768239 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:23.768178 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:23.768427 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:23.768265 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:23.768427 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:23.768392 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:23.914077 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:23.914043 2574 generic.go:358] "Generic (PLEG): container finished" podID="3bcff68d-54ed-4182-9675-e8ddfe09ca39" containerID="c4e1b4e97fbed8b12384eeba14248cc1a90c2ff5b893f80ff250e3d27dc6b26f" exitCode=0 May 29 02:52:23.914491 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:23.914093 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" event={"ID":"3bcff68d-54ed-4182-9675-e8ddfe09ca39","Type":"ContainerDied","Data":"c4e1b4e97fbed8b12384eeba14248cc1a90c2ff5b893f80ff250e3d27dc6b26f"} May 29 02:52:24.414544 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.413359 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nnd5c"] May 29 02:52:24.415572 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.415546 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:24.415711 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:24.415630 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnd5c" podUID="1d65b6ab-1d55-44a1-84a9-d78faf564883" May 29 02:52:24.432355 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.432287 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nnd5c"] May 29 02:52:24.476559 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.476523 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d65b6ab-1d55-44a1-84a9-d78faf564883-kubelet-config\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:24.476713 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.476615 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d65b6ab-1d55-44a1-84a9-d78faf564883-dbus\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:24.476713 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.476652 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:24.577124 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.577084 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d65b6ab-1d55-44a1-84a9-d78faf564883-kubelet-config\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:24.577297 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.577180 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d65b6ab-1d55-44a1-84a9-d78faf564883-dbus\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:24.577297 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.577229 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1d65b6ab-1d55-44a1-84a9-d78faf564883-kubelet-config\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:24.577297 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.577234 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:24.577493 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:24.577346 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 02:52:24.577493 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:24.577409 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret podName:1d65b6ab-1d55-44a1-84a9-d78faf564883 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:25.077390723 +0000 UTC m=+30.914163881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret") pod "global-pull-secret-syncer-nnd5c" (UID: "1d65b6ab-1d55-44a1-84a9-d78faf564883") : object "kube-system"/"original-pull-secret" not registered May 29 02:52:24.577591 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.577494 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1d65b6ab-1d55-44a1-84a9-d78faf564883-dbus\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:24.916022 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:24.915994 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:24.916497 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:24.916126 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnd5c" podUID="1d65b6ab-1d55-44a1-84a9-d78faf564883" May 29 02:52:25.081087 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:25.081044 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:25.081238 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:25.081213 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 02:52:25.081319 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:25.081292 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret podName:1d65b6ab-1d55-44a1-84a9-d78faf564883 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:26.081270776 +0000 UTC m=+31.918043944 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret") pod "global-pull-secret-syncer-nnd5c" (UID: "1d65b6ab-1d55-44a1-84a9-d78faf564883") : object "kube-system"/"original-pull-secret" not registered May 29 02:52:25.768273 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:25.768242 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:25.768444 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:25.768243 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:25.768444 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:25.768371 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:25.768561 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:25.768437 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:26.089594 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:26.089511 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:26.090218 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:26.089666 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 02:52:26.090218 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:26.089737 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret podName:1d65b6ab-1d55-44a1-84a9-d78faf564883 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:28.08972005 +0000 UTC m=+33.926493207 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret") pod "global-pull-secret-syncer-nnd5c" (UID: "1d65b6ab-1d55-44a1-84a9-d78faf564883") : object "kube-system"/"original-pull-secret" not registered May 29 02:52:26.768370 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:26.768340 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:26.768575 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:26.768446 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnd5c" podUID="1d65b6ab-1d55-44a1-84a9-d78faf564883" May 29 02:52:27.767968 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:27.767918 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:27.767968 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:27.767950 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:27.768470 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:27.768024 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lrnzd" podUID="188be971-e394-40d2-839e-47486bbfbe82" May 29 02:52:27.768470 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:27.768169 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-gjk6c" podUID="50124396-13ed-40a4-846c-81ec95b11af1" May 29 02:52:28.104742 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:28.104660 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:28.104894 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:28.104785 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered May 29 02:52:28.104894 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:28.104851 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret podName:1d65b6ab-1d55-44a1-84a9-d78faf564883 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:32.104832432 +0000 UTC m=+37.941605586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret") pod "global-pull-secret-syncer-nnd5c" (UID: "1d65b6ab-1d55-44a1-84a9-d78faf564883") : object "kube-system"/"original-pull-secret" not registered May 29 02:52:28.507845 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:28.507761 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:28.507845 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:28.507802 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5swl\" (UniqueName: \"kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl\") pod \"network-check-target-gjk6c\" (UID: \"50124396-13ed-40a4-846c-81ec95b11af1\") " pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:28.508062 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:28.507937 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered May 29 02:52:28.508062 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:28.507938 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:52:28.508062 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:28.508011 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs podName:188be971-e394-40d2-839e-47486bbfbe82 nodeName:}" failed. No retries permitted until 2026-05-29 02:53:00.507987263 +0000 UTC m=+66.344760420 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs") pod "network-metrics-daemon-lrnzd" (UID: "188be971-e394-40d2-839e-47486bbfbe82") : object "openshift-multus"/"metrics-daemon-secret" not registered May 29 02:52:28.508062 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:28.507950 2574 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered May 29 02:52:28.508062 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:28.508034 2574 projected.go:194] Error preparing data for projected volume kube-api-access-h5swl for pod openshift-network-diagnostics/network-check-target-gjk6c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:52:28.508343 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:28.508084 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl podName:50124396-13ed-40a4-846c-81ec95b11af1 nodeName:}" failed. No retries permitted until 2026-05-29 02:53:00.508068879 +0000 UTC m=+66.344842036 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h5swl" (UniqueName: "kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl") pod "network-check-target-gjk6c" (UID: "50124396-13ed-40a4-846c-81ec95b11af1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] May 29 02:52:28.767839 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:28.767768 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:28.768012 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:28.767900 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nnd5c" podUID="1d65b6ab-1d55-44a1-84a9-d78faf564883" May 29 02:52:29.501531 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.501451 2574 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-99.ec2.internal" event="NodeReady" May 29 02:52:29.501687 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.501615 2574 kubelet_node_status.go:550] "Fast updating node status as it just became ready" May 29 02:52:29.534882 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.534852 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6b75b5f565-fc4n6"] May 29 02:52:29.566446 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.566413 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6b75b5f565-fc4n6"] May 29 02:52:29.566446 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.566451 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qx45f"] May 29 02:52:29.566639 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.566510 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.570268 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.570091 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" May 29 02:52:29.571012 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.570958 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" May 29 02:52:29.571012 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.571000 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5c2jm\"" May 29 02:52:29.571282 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.570964 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" May 29 02:52:29.576360 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.576341 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" May 29 02:52:29.580228 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.580208 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-q8zzr"] May 29 02:52:29.580357 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.580341 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx45f" May 29 02:52:29.583317 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.583281 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" May 29 02:52:29.583554 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.583539 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4sfm2\"" May 29 02:52:29.583795 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.583782 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" May 29 02:52:29.598339 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.598303 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qx45f"] May 29 02:52:29.598426 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.598347 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q8zzr"] May 29 02:52:29.598517 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.598433 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:52:29.601092 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.601071 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" May 29 02:52:29.601186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.601089 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" May 29 02:52:29.601395 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.601377 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2t8gv\"" May 29 02:52:29.601484 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.601469 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" May 29 02:52:29.716807 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.716769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2npqj\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-kube-api-access-2npqj\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.716807 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.716817 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-tmp-dir\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:29.717056 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.716888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.717056 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.716914 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-trusted-ca\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.717056 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.716945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-installation-pull-secrets\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.717056 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.716962 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-config-volume\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:29.717056 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.716987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxbx4\" (UniqueName: \"kubernetes.io/projected/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-kube-api-access-jxbx4\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:52:29.717056 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.717007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-image-registry-private-configuration\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.717056 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.717025 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-certificates\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.717428 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.717070 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-bound-sa-token\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.717428 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.717152 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:52:29.717428 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.717177 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:29.717428 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.717196 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbdkk\" (UniqueName: \"kubernetes.io/projected/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-kube-api-access-hbdkk\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:29.717428 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.717219 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1b29295e-a814-40f1-a1e5-aebb11806cda-ca-trust-extracted\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.767804 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.767723 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:52:29.767969 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.767723 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:52:29.770674 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.770435 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 02:52:29.770674 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.770458 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r7pnj\"" May 29 02:52:29.770674 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.770475 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 02:52:29.770674 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.770546 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 02:52:29.770674 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.770567 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n4b9g\"" May 29 02:52:29.818614 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818579 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.818614 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818614 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-trusted-ca\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.818855 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818646 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-installation-pull-secrets\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.818855 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818696 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-config-volume\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:29.818855 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818759 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxbx4\" (UniqueName: \"kubernetes.io/projected/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-kube-api-access-jxbx4\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:52:29.818855 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818791 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-image-registry-private-configuration\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.818855 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818820 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-certificates\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.818855 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818842 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-bound-sa-token\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.819144 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:29.818854 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 02:52:29.819144 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:29.818871 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b75b5f565-fc4n6: secret "image-registry-tls" not found May 29 02:52:29.819144 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818876 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:52:29.819144 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818900 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:29.819144 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818924 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hbdkk\" (UniqueName: \"kubernetes.io/projected/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-kube-api-access-hbdkk\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:29.819144 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:29.818943 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls podName:1b29295e-a814-40f1-a1e5-aebb11806cda nodeName:}" failed. No retries permitted until 2026-05-29 02:52:30.318922188 +0000 UTC m=+36.155695346 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls") pod "image-registry-6b75b5f565-fc4n6" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda") : secret "image-registry-tls" not found May 29 02:52:29.819144 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.818976 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1b29295e-a814-40f1-a1e5-aebb11806cda-ca-trust-extracted\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.819144 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.819025 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2npqj\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-kube-api-access-2npqj\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.819144 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.819048 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-tmp-dir\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:29.819664 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.819346 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-tmp-dir\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:29.819664 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.819533 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-config-volume\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:29.819764 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.819666 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-trusted-ca\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.819817 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.819801 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-certificates\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.819999 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:29.819976 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 02:52:29.820070 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.820010 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1b29295e-a814-40f1-a1e5-aebb11806cda-ca-trust-extracted\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.820070 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:29.820051 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert podName:ff0a0239-5a87-4894-b455-5f3e6f51f2d9 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:30.320033117 +0000 UTC m=+36.156806286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert") pod "ingress-canary-q8zzr" (UID: "ff0a0239-5a87-4894-b455-5f3e6f51f2d9") : secret "canary-serving-cert" not found May 29 02:52:29.820157 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:29.820087 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 02:52:29.820157 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:29.820150 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls podName:c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:30.320133241 +0000 UTC m=+36.156906400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls") pod "dns-default-qx45f" (UID: "c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18") : secret "dns-default-metrics-tls" not found May 29 02:52:29.823602 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.823576 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-image-registry-private-configuration\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.823602 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.823597 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-installation-pull-secrets\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.830082 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.830018 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2npqj\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-kube-api-access-2npqj\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.830082 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.830021 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxbx4\" (UniqueName: \"kubernetes.io/projected/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-kube-api-access-jxbx4\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:52:29.830292 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.830272 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-bound-sa-token\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:29.830467 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:29.830444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbdkk\" (UniqueName: \"kubernetes.io/projected/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-kube-api-access-hbdkk\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:30.334609 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:30.334568 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:52:30.334741 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:30.334613 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:30.334741 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:30.334711 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:30.334741 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:30.334732 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 02:52:30.334879 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:30.334802 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls podName:c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:31.334781102 +0000 UTC m=+37.171554269 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls") pod "dns-default-qx45f" (UID: "c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18") : secret "dns-default-metrics-tls" not found May 29 02:52:30.334879 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:30.334728 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 02:52:30.334879 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:30.334834 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 02:52:30.334879 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:30.334845 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert podName:ff0a0239-5a87-4894-b455-5f3e6f51f2d9 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:31.334831813 +0000 UTC m=+37.171604970 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert") pod "ingress-canary-q8zzr" (UID: "ff0a0239-5a87-4894-b455-5f3e6f51f2d9") : secret "canary-serving-cert" not found May 29 02:52:30.334879 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:30.334848 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b75b5f565-fc4n6: secret "image-registry-tls" not found May 29 02:52:30.335111 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:30.334891 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls podName:1b29295e-a814-40f1-a1e5-aebb11806cda nodeName:}" failed. No retries permitted until 2026-05-29 02:52:31.334877972 +0000 UTC m=+37.171651125 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls") pod "image-registry-6b75b5f565-fc4n6" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda") : secret "image-registry-tls" not found May 29 02:52:30.768344 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:30.768294 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:30.771251 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:30.771226 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" May 29 02:52:30.939118 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:30.939027 2574 generic.go:358] "Generic (PLEG): container finished" podID="3bcff68d-54ed-4182-9675-e8ddfe09ca39" containerID="de5fdead16965e21f1f0790c502d5d3f91ffb1598ad1c36e6f8b2a0f36c96b6e" exitCode=0 May 29 02:52:30.939118 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:30.939103 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" event={"ID":"3bcff68d-54ed-4182-9675-e8ddfe09ca39","Type":"ContainerDied","Data":"de5fdead16965e21f1f0790c502d5d3f91ffb1598ad1c36e6f8b2a0f36c96b6e"} May 29 02:52:31.342606 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:31.342521 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:52:31.342606 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:31.342560 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:31.342803 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:31.342633 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:31.342803 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:31.342677 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 02:52:31.342803 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:31.342724 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 02:52:31.342803 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:31.342736 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b75b5f565-fc4n6: secret "image-registry-tls" not found May 29 02:52:31.342803 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:31.342742 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert podName:ff0a0239-5a87-4894-b455-5f3e6f51f2d9 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:33.342727223 +0000 UTC m=+39.179500382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert") pod "ingress-canary-q8zzr" (UID: "ff0a0239-5a87-4894-b455-5f3e6f51f2d9") : secret "canary-serving-cert" not found May 29 02:52:31.342803 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:31.342777 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls podName:1b29295e-a814-40f1-a1e5-aebb11806cda nodeName:}" failed. No retries permitted until 2026-05-29 02:52:33.342766155 +0000 UTC m=+39.179539310 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls") pod "image-registry-6b75b5f565-fc4n6" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda") : secret "image-registry-tls" not found May 29 02:52:31.342803 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:31.342724 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 02:52:31.342803 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:31.342809 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls podName:c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:33.342803757 +0000 UTC m=+39.179576911 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls") pod "dns-default-qx45f" (UID: "c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18") : secret "dns-default-metrics-tls" not found May 29 02:52:31.943806 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:31.943769 2574 generic.go:358] "Generic (PLEG): container finished" podID="3bcff68d-54ed-4182-9675-e8ddfe09ca39" containerID="3baa1bd95f2e67ec88cbdf24b94f2f14b228bf313a26021bf6a64fc429035052" exitCode=0 May 29 02:52:31.944129 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:31.943843 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" event={"ID":"3bcff68d-54ed-4182-9675-e8ddfe09ca39","Type":"ContainerDied","Data":"3baa1bd95f2e67ec88cbdf24b94f2f14b228bf313a26021bf6a64fc429035052"} May 29 02:52:32.149405 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:32.149321 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:32.152432 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:32.152402 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1d65b6ab-1d55-44a1-84a9-d78faf564883-original-pull-secret\") pod \"global-pull-secret-syncer-nnd5c\" (UID: \"1d65b6ab-1d55-44a1-84a9-d78faf564883\") " pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:32.276843 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:32.276675 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nnd5c" May 29 02:52:32.425869 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:32.425787 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nnd5c"] May 29 02:52:32.429419 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:52:32.429392 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d65b6ab_1d55_44a1_84a9_d78faf564883.slice/crio-d971d1691cc3af9550d0339347975f413181dc118e4765ee2a8b6cae0813c3c9 WatchSource:0}: Error finding container d971d1691cc3af9550d0339347975f413181dc118e4765ee2a8b6cae0813c3c9: Status 404 returned error can't find the container with id d971d1691cc3af9550d0339347975f413181dc118e4765ee2a8b6cae0813c3c9 May 29 02:52:32.946377 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:32.946345 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nnd5c" event={"ID":"1d65b6ab-1d55-44a1-84a9-d78faf564883","Type":"ContainerStarted","Data":"d971d1691cc3af9550d0339347975f413181dc118e4765ee2a8b6cae0813c3c9"} May 29 02:52:32.949006 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:32.948979 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" event={"ID":"3bcff68d-54ed-4182-9675-e8ddfe09ca39","Type":"ContainerStarted","Data":"b5f815dc70054daa82b136d7851830e98ba946cd5eedf5b00c66ba1ffdca0ea7"} May 29 02:52:32.971893 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:32.971772 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bzz2d" podStartSLOduration=5.052489665 podStartE2EDuration="37.971756273s" podCreationTimestamp="2026-05-29 02:51:55 +0000 UTC" firstStartedPulling="2026-05-29 02:51:57.372363414 +0000 UTC m=+3.209136571" lastFinishedPulling="2026-05-29 02:52:30.291630016 +0000 UTC m=+36.128403179" observedRunningTime="2026-05-29 02:52:32.970214217 +0000 UTC m=+38.806987393" watchObservedRunningTime="2026-05-29 02:52:32.971756273 +0000 UTC m=+38.808529449" May 29 02:52:33.359403 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:33.359370 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:33.359602 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:33.359431 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:52:33.359602 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:33.359459 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:33.359602 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:33.359550 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 02:52:33.359602 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:33.359571 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b75b5f565-fc4n6: secret "image-registry-tls" not found May 29 02:52:33.359822 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:33.359599 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 02:52:33.359822 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:33.359637 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls podName:1b29295e-a814-40f1-a1e5-aebb11806cda nodeName:}" failed. No retries permitted until 2026-05-29 02:52:37.35961491 +0000 UTC m=+43.196388083 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls") pod "image-registry-6b75b5f565-fc4n6" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda") : secret "image-registry-tls" not found May 29 02:52:33.359822 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:33.359651 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert podName:ff0a0239-5a87-4894-b455-5f3e6f51f2d9 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:37.359645147 +0000 UTC m=+43.196418301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert") pod "ingress-canary-q8zzr" (UID: "ff0a0239-5a87-4894-b455-5f3e6f51f2d9") : secret "canary-serving-cert" not found May 29 02:52:33.359822 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:33.359658 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 02:52:33.359822 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:33.359698 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls podName:c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:37.359679664 +0000 UTC m=+43.196452823 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls") pod "dns-default-qx45f" (UID: "c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18") : secret "dns-default-metrics-tls" not found May 29 02:52:37.390271 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:37.390240 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:37.390714 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:37.390292 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:52:37.390714 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:37.390335 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:37.390714 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:37.390412 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 02:52:37.390714 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:37.390427 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b75b5f565-fc4n6: secret "image-registry-tls" not found May 29 02:52:37.390714 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:37.390461 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 02:52:37.390714 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:37.390481 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls podName:1b29295e-a814-40f1-a1e5-aebb11806cda nodeName:}" failed. No retries permitted until 2026-05-29 02:52:45.390462077 +0000 UTC m=+51.227235236 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls") pod "image-registry-6b75b5f565-fc4n6" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda") : secret "image-registry-tls" not found May 29 02:52:37.390714 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:37.390497 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 02:52:37.390714 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:37.390510 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert podName:ff0a0239-5a87-4894-b455-5f3e6f51f2d9 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:45.390497247 +0000 UTC m=+51.227270401 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert") pod "ingress-canary-q8zzr" (UID: "ff0a0239-5a87-4894-b455-5f3e6f51f2d9") : secret "canary-serving-cert" not found May 29 02:52:37.390714 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:37.390528 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls podName:c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18 nodeName:}" failed. No retries permitted until 2026-05-29 02:52:45.390518779 +0000 UTC m=+51.227291941 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls") pod "dns-default-qx45f" (UID: "c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18") : secret "dns-default-metrics-tls" not found May 29 02:52:37.959806 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:37.959770 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nnd5c" event={"ID":"1d65b6ab-1d55-44a1-84a9-d78faf564883","Type":"ContainerStarted","Data":"fc41354cf03ba3e679702b3c03a02237c1319b6fe6fe4a9dad636a083b485a13"} May 29 02:52:37.973923 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:37.973827 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nnd5c" podStartSLOduration=9.206173351 podStartE2EDuration="13.973810395s" podCreationTimestamp="2026-05-29 02:52:24 +0000 UTC" firstStartedPulling="2026-05-29 02:52:32.431014364 +0000 UTC m=+38.267787518" lastFinishedPulling="2026-05-29 02:52:37.198651391 +0000 UTC m=+43.035424562" observedRunningTime="2026-05-29 02:52:37.973227911 +0000 UTC m=+43.810001087" watchObservedRunningTime="2026-05-29 02:52:37.973810395 +0000 UTC m=+43.810583570" May 29 02:52:45.451681 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:45.451640 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:52:45.452131 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:45.451696 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:52:45.452131 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:45.451716 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:52:45.452131 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:45.451796 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 02:52:45.452131 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:45.451858 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls podName:c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18 nodeName:}" failed. No retries permitted until 2026-05-29 02:53:01.451845125 +0000 UTC m=+67.288618278 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls") pod "dns-default-qx45f" (UID: "c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18") : secret "dns-default-metrics-tls" not found May 29 02:52:45.452131 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:45.451796 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 02:52:45.452131 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:45.451896 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b75b5f565-fc4n6: secret "image-registry-tls" not found May 29 02:52:45.452131 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:45.451796 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 02:52:45.452131 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:45.451985 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls podName:1b29295e-a814-40f1-a1e5-aebb11806cda nodeName:}" failed. No retries permitted until 2026-05-29 02:53:01.4519706 +0000 UTC m=+67.288743769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls") pod "image-registry-6b75b5f565-fc4n6" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda") : secret "image-registry-tls" not found May 29 02:52:45.452131 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:52:45.452006 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert podName:ff0a0239-5a87-4894-b455-5f3e6f51f2d9 nodeName:}" failed. No retries permitted until 2026-05-29 02:53:01.451991287 +0000 UTC m=+67.288764441 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert") pod "ingress-canary-q8zzr" (UID: "ff0a0239-5a87-4894-b455-5f3e6f51f2d9") : secret "canary-serving-cert" not found May 29 02:52:52.925298 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:52.925269 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4shwz" May 29 02:52:56.511068 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.511024 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x"] May 29 02:52:56.513819 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.513802 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:52:56.516196 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.516168 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" May 29 02:52:56.516407 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.516377 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" May 29 02:52:56.517473 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.517448 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" May 29 02:52:56.517473 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.517467 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" May 29 02:52:56.518322 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.518285 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb"] May 29 02:52:56.520214 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.519972 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb" May 29 02:52:56.522407 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.522383 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" May 29 02:52:56.522503 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.522426 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5jmzr\"" May 29 02:52:56.524288 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.524267 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x"] May 29 02:52:56.530031 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.530009 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb"] May 29 02:52:56.538624 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.538604 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq"] May 29 02:52:56.540532 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.540517 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.542861 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.542846 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" May 29 02:52:56.543001 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.542850 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" May 29 02:52:56.543206 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.543173 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" May 29 02:52:56.543302 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.543287 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" May 29 02:52:56.552004 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.551985 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq"] May 29 02:52:56.631410 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.631373 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/062adcb8-38ee-4f80-a8ed-4ef13d021684-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b5456b7b-hk5pb\" (UID: \"062adcb8-38ee-4f80-a8ed-4ef13d021684\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb" May 29 02:52:56.631410 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.631412 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddhh2\" (UniqueName: \"kubernetes.io/projected/062adcb8-38ee-4f80-a8ed-4ef13d021684-kube-api-access-ddhh2\") pod \"managed-serviceaccount-addon-agent-b5456b7b-hk5pb\" (UID: \"062adcb8-38ee-4f80-a8ed-4ef13d021684\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb" May 29 02:52:56.631618 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.631434 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7hdn\" (UniqueName: \"kubernetes.io/projected/3906134b-25e6-4c15-970e-b55fb58ecd98-kube-api-access-s7hdn\") pod \"klusterlet-addon-workmgr-6ff9948b77-fgq7x\" (UID: \"3906134b-25e6-4c15-970e-b55fb58ecd98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:52:56.631618 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.631540 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3906134b-25e6-4c15-970e-b55fb58ecd98-klusterlet-config\") pod \"klusterlet-addon-workmgr-6ff9948b77-fgq7x\" (UID: \"3906134b-25e6-4c15-970e-b55fb58ecd98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:52:56.631728 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.631624 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3906134b-25e6-4c15-970e-b55fb58ecd98-tmp\") pod \"klusterlet-addon-workmgr-6ff9948b77-fgq7x\" (UID: \"3906134b-25e6-4c15-970e-b55fb58ecd98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:52:56.732742 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.732709 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-ca\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.732858 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.732768 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/062adcb8-38ee-4f80-a8ed-4ef13d021684-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b5456b7b-hk5pb\" (UID: \"062adcb8-38ee-4f80-a8ed-4ef13d021684\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb" May 29 02:52:56.732858 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.732789 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ddhh2\" (UniqueName: \"kubernetes.io/projected/062adcb8-38ee-4f80-a8ed-4ef13d021684-kube-api-access-ddhh2\") pod \"managed-serviceaccount-addon-agent-b5456b7b-hk5pb\" (UID: \"062adcb8-38ee-4f80-a8ed-4ef13d021684\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb" May 29 02:52:56.732858 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.732807 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s7hdn\" (UniqueName: \"kubernetes.io/projected/3906134b-25e6-4c15-970e-b55fb58ecd98-kube-api-access-s7hdn\") pod \"klusterlet-addon-workmgr-6ff9948b77-fgq7x\" (UID: \"3906134b-25e6-4c15-970e-b55fb58ecd98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:52:56.732858 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.732825 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/957f9539-77dd-4a20-ab27-7c3b0f55286b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.732858 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.732845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-hub\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.733092 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.732861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.733092 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.732877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkpzx\" (UniqueName: \"kubernetes.io/projected/957f9539-77dd-4a20-ab27-7c3b0f55286b-kube-api-access-kkpzx\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.733092 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.732904 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3906134b-25e6-4c15-970e-b55fb58ecd98-klusterlet-config\") pod \"klusterlet-addon-workmgr-6ff9948b77-fgq7x\" (UID: \"3906134b-25e6-4c15-970e-b55fb58ecd98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:52:56.733092 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.732929 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.733092 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.732963 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3906134b-25e6-4c15-970e-b55fb58ecd98-tmp\") pod \"klusterlet-addon-workmgr-6ff9948b77-fgq7x\" (UID: \"3906134b-25e6-4c15-970e-b55fb58ecd98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:52:56.733401 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.733383 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3906134b-25e6-4c15-970e-b55fb58ecd98-tmp\") pod \"klusterlet-addon-workmgr-6ff9948b77-fgq7x\" (UID: \"3906134b-25e6-4c15-970e-b55fb58ecd98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:52:56.735555 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.735532 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/3906134b-25e6-4c15-970e-b55fb58ecd98-klusterlet-config\") pod \"klusterlet-addon-workmgr-6ff9948b77-fgq7x\" (UID: \"3906134b-25e6-4c15-970e-b55fb58ecd98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:52:56.735648 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.735588 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/062adcb8-38ee-4f80-a8ed-4ef13d021684-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-b5456b7b-hk5pb\" (UID: \"062adcb8-38ee-4f80-a8ed-4ef13d021684\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb" May 29 02:52:56.740479 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.740450 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddhh2\" (UniqueName: \"kubernetes.io/projected/062adcb8-38ee-4f80-a8ed-4ef13d021684-kube-api-access-ddhh2\") pod \"managed-serviceaccount-addon-agent-b5456b7b-hk5pb\" (UID: \"062adcb8-38ee-4f80-a8ed-4ef13d021684\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb" May 29 02:52:56.740814 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.740796 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7hdn\" (UniqueName: \"kubernetes.io/projected/3906134b-25e6-4c15-970e-b55fb58ecd98-kube-api-access-s7hdn\") pod \"klusterlet-addon-workmgr-6ff9948b77-fgq7x\" (UID: \"3906134b-25e6-4c15-970e-b55fb58ecd98\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:52:56.822740 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.822706 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:52:56.833718 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.833680 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-ca\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.833849 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.833773 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/957f9539-77dd-4a20-ab27-7c3b0f55286b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.833849 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.833821 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-hub\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.833959 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.833849 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.833959 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.833877 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kkpzx\" (UniqueName: \"kubernetes.io/projected/957f9539-77dd-4a20-ab27-7c3b0f55286b-kube-api-access-kkpzx\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.833959 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.833908 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.834492 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.834464 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/957f9539-77dd-4a20-ab27-7c3b0f55286b-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.836868 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.836848 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-ca\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.836951 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.836888 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.837064 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.837050 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.837173 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.837151 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/957f9539-77dd-4a20-ab27-7c3b0f55286b-hub\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.839867 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.839848 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb" May 29 02:52:56.842347 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.842323 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkpzx\" (UniqueName: \"kubernetes.io/projected/957f9539-77dd-4a20-ab27-7c3b0f55286b-kube-api-access-kkpzx\") pod \"cluster-proxy-proxy-agent-767c57dc47-ph4sq\" (UID: \"957f9539-77dd-4a20-ab27-7c3b0f55286b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.849141 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.849116 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:52:56.956837 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.956784 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x"] May 29 02:52:56.960557 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:52:56.960293 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3906134b_25e6_4c15_970e_b55fb58ecd98.slice/crio-0c116415699538063831b0bc5a2db318a03085f60e816812de97ac8a914b72d5 WatchSource:0}: Error finding container 0c116415699538063831b0bc5a2db318a03085f60e816812de97ac8a914b72d5: Status 404 returned error can't find the container with id 0c116415699538063831b0bc5a2db318a03085f60e816812de97ac8a914b72d5 May 29 02:52:56.976134 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.976110 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb"] May 29 02:52:56.978973 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:52:56.978949 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod062adcb8_38ee_4f80_a8ed_4ef13d021684.slice/crio-12d6275cc50ab5b48b3e5e098753dd63638021d477d47b5c397fb1e39676f9d7 WatchSource:0}: Error finding container 12d6275cc50ab5b48b3e5e098753dd63638021d477d47b5c397fb1e39676f9d7: Status 404 returned error can't find the container with id 12d6275cc50ab5b48b3e5e098753dd63638021d477d47b5c397fb1e39676f9d7 May 29 02:52:56.991204 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.991163 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq"] May 29 02:52:56.993842 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:52:56.993817 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod957f9539_77dd_4a20_ab27_7c3b0f55286b.slice/crio-3156b6f4661573fd4d10bd67b957b0d3a35844baf044618cb5ad42aa5d5b372c WatchSource:0}: Error finding container 3156b6f4661573fd4d10bd67b957b0d3a35844baf044618cb5ad42aa5d5b372c: Status 404 returned error can't find the container with id 3156b6f4661573fd4d10bd67b957b0d3a35844baf044618cb5ad42aa5d5b372c May 29 02:52:56.995905 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.995882 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb" event={"ID":"062adcb8-38ee-4f80-a8ed-4ef13d021684","Type":"ContainerStarted","Data":"12d6275cc50ab5b48b3e5e098753dd63638021d477d47b5c397fb1e39676f9d7"} May 29 02:52:56.996869 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:56.996832 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" event={"ID":"3906134b-25e6-4c15-970e-b55fb58ecd98","Type":"ContainerStarted","Data":"0c116415699538063831b0bc5a2db318a03085f60e816812de97ac8a914b72d5"} May 29 02:52:58.001576 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:52:58.001472 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" event={"ID":"957f9539-77dd-4a20-ab27-7c3b0f55286b","Type":"ContainerStarted","Data":"3156b6f4661573fd4d10bd67b957b0d3a35844baf044618cb5ad42aa5d5b372c"} May 29 02:53:00.567487 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:00.567438 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:53:00.567958 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:00.567585 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h5swl\" (UniqueName: \"kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl\") pod \"network-check-target-gjk6c\" (UID: \"50124396-13ed-40a4-846c-81ec95b11af1\") " pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:53:00.570257 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:00.570238 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" May 29 02:53:00.570347 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:00.570330 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" May 29 02:53:00.578422 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:00.578400 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found May 29 02:53:00.578535 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:00.578498 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs podName:188be971-e394-40d2-839e-47486bbfbe82 nodeName:}" failed. No retries permitted until 2026-05-29 02:54:04.578476289 +0000 UTC m=+130.415249454 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs") pod "network-metrics-daemon-lrnzd" (UID: "188be971-e394-40d2-839e-47486bbfbe82") : secret "metrics-daemon-secret" not found May 29 02:53:00.580951 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:00.580934 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" May 29 02:53:00.590935 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:00.590910 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5swl\" (UniqueName: \"kubernetes.io/projected/50124396-13ed-40a4-846c-81ec95b11af1-kube-api-access-h5swl\") pod \"network-check-target-gjk6c\" (UID: \"50124396-13ed-40a4-846c-81ec95b11af1\") " pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:53:00.681606 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:00.681570 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r7pnj\"" May 29 02:53:00.689295 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:00.689269 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:53:01.474495 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:01.474458 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:53:01.474710 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:01.474506 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:53:01.474710 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:01.474576 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:53:01.474710 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:01.474648 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 02:53:01.474710 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:01.474665 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 02:53:01.474710 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:01.474676 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b75b5f565-fc4n6: secret "image-registry-tls" not found May 29 02:53:01.474921 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:01.474649 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 02:53:01.474921 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:01.474724 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert podName:ff0a0239-5a87-4894-b455-5f3e6f51f2d9 nodeName:}" failed. No retries permitted until 2026-05-29 02:53:33.474701965 +0000 UTC m=+99.311475122 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert") pod "ingress-canary-q8zzr" (UID: "ff0a0239-5a87-4894-b455-5f3e6f51f2d9") : secret "canary-serving-cert" not found May 29 02:53:01.474921 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:01.474745 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls podName:1b29295e-a814-40f1-a1e5-aebb11806cda nodeName:}" failed. No retries permitted until 2026-05-29 02:53:33.474734826 +0000 UTC m=+99.311507984 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls") pod "image-registry-6b75b5f565-fc4n6" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda") : secret "image-registry-tls" not found May 29 02:53:01.474921 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:01.474760 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls podName:c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18 nodeName:}" failed. No retries permitted until 2026-05-29 02:53:33.4747514 +0000 UTC m=+99.311524561 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls") pod "dns-default-qx45f" (UID: "c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18") : secret "dns-default-metrics-tls" not found May 29 02:53:03.683179 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:03.683136 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-gjk6c"] May 29 02:53:03.687742 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:53:03.687710 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50124396_13ed_40a4_846c_81ec95b11af1.slice/crio-f93e24a7b12e1ca1e4afcdfac64db6fe9a75429c7778e9e21dadd261ee9f8a33 WatchSource:0}: Error finding container f93e24a7b12e1ca1e4afcdfac64db6fe9a75429c7778e9e21dadd261ee9f8a33: Status 404 returned error can't find the container with id f93e24a7b12e1ca1e4afcdfac64db6fe9a75429c7778e9e21dadd261ee9f8a33 May 29 02:53:04.013171 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:04.013134 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" event={"ID":"957f9539-77dd-4a20-ab27-7c3b0f55286b","Type":"ContainerStarted","Data":"3c094f50b15e1b3d07d7a578d012ac39b8365bea41dc176b7d5f23733455fc9c"} May 29 02:53:04.014089 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:04.014058 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gjk6c" event={"ID":"50124396-13ed-40a4-846c-81ec95b11af1","Type":"ContainerStarted","Data":"f93e24a7b12e1ca1e4afcdfac64db6fe9a75429c7778e9e21dadd261ee9f8a33"} May 29 02:53:04.015138 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:04.015117 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb" event={"ID":"062adcb8-38ee-4f80-a8ed-4ef13d021684","Type":"ContainerStarted","Data":"1e344771bc1cf2cd852f00a6a622b4fd508c81c462a12dd72adcb6e65928c1e4"} May 29 02:53:04.016384 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:04.016365 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" event={"ID":"3906134b-25e6-4c15-970e-b55fb58ecd98","Type":"ContainerStarted","Data":"c5ff744aeb3a8b4582335e4dc22687207e8d695478be46bd7cc1692f489a5aed"} May 29 02:53:04.016596 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:04.016580 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:53:04.018287 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:04.018269 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" May 29 02:53:04.031777 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:04.031734 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-b5456b7b-hk5pb" podStartSLOduration=1.465359955 podStartE2EDuration="8.031721284s" podCreationTimestamp="2026-05-29 02:52:56 +0000 UTC" firstStartedPulling="2026-05-29 02:52:56.980749656 +0000 UTC m=+62.817522810" lastFinishedPulling="2026-05-29 02:53:03.547110971 +0000 UTC m=+69.383884139" observedRunningTime="2026-05-29 02:53:04.031064506 +0000 UTC m=+69.867837683" watchObservedRunningTime="2026-05-29 02:53:04.031721284 +0000 UTC m=+69.868494460" May 29 02:53:04.051545 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:04.051503 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6ff9948b77-fgq7x" podStartSLOduration=1.449779761 podStartE2EDuration="8.051485123s" podCreationTimestamp="2026-05-29 02:52:56 +0000 UTC" firstStartedPulling="2026-05-29 02:52:56.963071108 +0000 UTC m=+62.799844265" lastFinishedPulling="2026-05-29 02:53:03.564776458 +0000 UTC m=+69.401549627" observedRunningTime="2026-05-29 02:53:04.050373652 +0000 UTC m=+69.887146828" watchObservedRunningTime="2026-05-29 02:53:04.051485123 +0000 UTC m=+69.888258301" May 29 02:53:07.025327 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:07.025220 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" event={"ID":"957f9539-77dd-4a20-ab27-7c3b0f55286b","Type":"ContainerStarted","Data":"35691cf61b4c86bae2d2733b75350e7eb7b7189d61b9b2029cff8bcafa01a1a9"} May 29 02:53:07.025327 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:07.025263 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" event={"ID":"957f9539-77dd-4a20-ab27-7c3b0f55286b","Type":"ContainerStarted","Data":"aeff133652c669594f2e421df5b891ea7863871415f7bae540b8f8829c840833"} May 29 02:53:07.026569 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:07.026540 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-gjk6c" event={"ID":"50124396-13ed-40a4-846c-81ec95b11af1","Type":"ContainerStarted","Data":"14dd2df6260b84a6341ed6fff92b51b8789fc119824cde0734a46535e789116f"} May 29 02:53:07.026696 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:07.026685 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:53:07.047225 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:07.047173 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" podStartSLOduration=1.309082177 podStartE2EDuration="11.047158672s" podCreationTimestamp="2026-05-29 02:52:56 +0000 UTC" firstStartedPulling="2026-05-29 02:52:56.995570593 +0000 UTC m=+62.832343747" lastFinishedPulling="2026-05-29 02:53:06.733647088 +0000 UTC m=+72.570420242" observedRunningTime="2026-05-29 02:53:07.046462167 +0000 UTC m=+72.883235340" watchObservedRunningTime="2026-05-29 02:53:07.047158672 +0000 UTC m=+72.883931878" May 29 02:53:07.065641 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:07.065594 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-gjk6c" podStartSLOduration=69.015655341 podStartE2EDuration="1m12.065577611s" podCreationTimestamp="2026-05-29 02:51:55 +0000 UTC" firstStartedPulling="2026-05-29 02:53:03.689750355 +0000 UTC m=+69.526523522" lastFinishedPulling="2026-05-29 02:53:06.739672635 +0000 UTC m=+72.576445792" observedRunningTime="2026-05-29 02:53:07.065347355 +0000 UTC m=+72.902120530" watchObservedRunningTime="2026-05-29 02:53:07.065577611 +0000 UTC m=+72.902350788" May 29 02:53:33.524049 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:33.524007 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:53:33.524049 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:33.524051 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:53:33.524615 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:33.524119 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls\") pod \"image-registry-6b75b5f565-fc4n6\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:53:33.524615 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:33.524168 2574 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found May 29 02:53:33.524615 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:33.524209 2574 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found May 29 02:53:33.524615 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:33.524221 2574 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6b75b5f565-fc4n6: secret "image-registry-tls" not found May 29 02:53:33.524615 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:33.524251 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert podName:ff0a0239-5a87-4894-b455-5f3e6f51f2d9 nodeName:}" failed. No retries permitted until 2026-05-29 02:54:37.524231744 +0000 UTC m=+163.361004912 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert") pod "ingress-canary-q8zzr" (UID: "ff0a0239-5a87-4894-b455-5f3e6f51f2d9") : secret "canary-serving-cert" not found May 29 02:53:33.524615 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:33.524281 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls podName:1b29295e-a814-40f1-a1e5-aebb11806cda nodeName:}" failed. No retries permitted until 2026-05-29 02:54:37.524271508 +0000 UTC m=+163.361044663 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls") pod "image-registry-6b75b5f565-fc4n6" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda") : secret "image-registry-tls" not found May 29 02:53:33.524615 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:33.524283 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found May 29 02:53:33.524615 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:53:33.524394 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls podName:c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18 nodeName:}" failed. No retries permitted until 2026-05-29 02:54:37.524373294 +0000 UTC m=+163.361146461 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls") pod "dns-default-qx45f" (UID: "c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18") : secret "dns-default-metrics-tls" not found May 29 02:53:34.691881 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:34.691845 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q8qcm"] May 29 02:53:34.700410 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:34.700386 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q8qcm" May 29 02:53:34.703095 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:34.703078 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-phln8\"" May 29 02:53:34.705562 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:34.705541 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q8qcm"] May 29 02:53:34.835274 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:34.835236 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwwl9\" (UniqueName: \"kubernetes.io/projected/6392ae45-f3e7-4317-af82-9fd80efe6cf2-kube-api-access-bwwl9\") pod \"network-check-source-7f44b6dd87-q8qcm\" (UID: \"6392ae45-f3e7-4317-af82-9fd80efe6cf2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q8qcm" May 29 02:53:34.936648 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:34.936611 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bwwl9\" (UniqueName: \"kubernetes.io/projected/6392ae45-f3e7-4317-af82-9fd80efe6cf2-kube-api-access-bwwl9\") pod \"network-check-source-7f44b6dd87-q8qcm\" (UID: \"6392ae45-f3e7-4317-af82-9fd80efe6cf2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q8qcm" May 29 02:53:34.946516 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:34.946464 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwwl9\" (UniqueName: \"kubernetes.io/projected/6392ae45-f3e7-4317-af82-9fd80efe6cf2-kube-api-access-bwwl9\") pod \"network-check-source-7f44b6dd87-q8qcm\" (UID: \"6392ae45-f3e7-4317-af82-9fd80efe6cf2\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q8qcm" May 29 02:53:35.009104 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:35.009065 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q8qcm" May 29 02:53:35.130282 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:35.130248 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-q8qcm"] May 29 02:53:35.133497 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:53:35.133455 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6392ae45_f3e7_4317_af82_9fd80efe6cf2.slice/crio-474b03f0bf210adf1a2f4fd6ea7944f6ef8a3c70b8d507b3b5a66a564bd16f03 WatchSource:0}: Error finding container 474b03f0bf210adf1a2f4fd6ea7944f6ef8a3c70b8d507b3b5a66a564bd16f03: Status 404 returned error can't find the container with id 474b03f0bf210adf1a2f4fd6ea7944f6ef8a3c70b8d507b3b5a66a564bd16f03 May 29 02:53:36.096905 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:36.096867 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q8qcm" event={"ID":"6392ae45-f3e7-4317-af82-9fd80efe6cf2","Type":"ContainerStarted","Data":"c7646bb3fa79e46895d66549f3adad2d9887a6cc69f51c7d55e3eafea88c90f6"} May 29 02:53:36.096905 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:36.096905 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q8qcm" event={"ID":"6392ae45-f3e7-4317-af82-9fd80efe6cf2","Type":"ContainerStarted","Data":"474b03f0bf210adf1a2f4fd6ea7944f6ef8a3c70b8d507b3b5a66a564bd16f03"} May 29 02:53:36.111749 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:36.111687 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-q8qcm" podStartSLOduration=2.111670717 podStartE2EDuration="2.111670717s" podCreationTimestamp="2026-05-29 02:53:34 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:53:36.111236299 +0000 UTC m=+101.948009476" watchObservedRunningTime="2026-05-29 02:53:36.111670717 +0000 UTC m=+101.948443896" May 29 02:53:38.030477 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:38.030445 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-gjk6c" May 29 02:53:38.410262 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:38.410236 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjqvf_85de5aa3-4f9f-4ebf-b110-c7651ef3933b/dns-node-resolver/0.log" May 29 02:53:39.410378 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:39.410353 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6f8c_d5aeb5e0-0955-4e6f-9b7c-9632860d4206/node-ca/0.log" May 29 02:53:57.620595 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.620561 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jlzfg"] May 29 02:53:57.622758 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.622735 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.626588 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.626559 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n4d48\"" May 29 02:53:57.626588 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.626585 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" May 29 02:53:57.626779 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.626598 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" May 29 02:53:57.626779 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.626626 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" May 29 02:53:57.626779 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.626568 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" May 29 02:53:57.634786 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.634759 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jlzfg"] May 29 02:53:57.809118 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.809082 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62e283a9-156c-40d1-a01a-c09032747465-data-volume\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.809118 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.809118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62e283a9-156c-40d1-a01a-c09032747465-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.809428 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.809148 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62e283a9-156c-40d1-a01a-c09032747465-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.809428 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.809262 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtmgw\" (UniqueName: \"kubernetes.io/projected/62e283a9-156c-40d1-a01a-c09032747465-kube-api-access-mtmgw\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.809428 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.809333 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62e283a9-156c-40d1-a01a-c09032747465-crio-socket\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.910555 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.910480 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62e283a9-156c-40d1-a01a-c09032747465-crio-socket\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.910689 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.910560 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62e283a9-156c-40d1-a01a-c09032747465-data-volume\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.910689 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.910583 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62e283a9-156c-40d1-a01a-c09032747465-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.910689 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.910600 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/62e283a9-156c-40d1-a01a-c09032747465-crio-socket\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.910689 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.910608 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62e283a9-156c-40d1-a01a-c09032747465-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.910876 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.910690 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mtmgw\" (UniqueName: \"kubernetes.io/projected/62e283a9-156c-40d1-a01a-c09032747465-kube-api-access-mtmgw\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.910982 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.910963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/62e283a9-156c-40d1-a01a-c09032747465-data-volume\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.911101 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.911085 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/62e283a9-156c-40d1-a01a-c09032747465-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.912938 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.912922 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/62e283a9-156c-40d1-a01a-c09032747465-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.930346 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.930303 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtmgw\" (UniqueName: \"kubernetes.io/projected/62e283a9-156c-40d1-a01a-c09032747465-kube-api-access-mtmgw\") pod \"insights-runtime-extractor-jlzfg\" (UID: \"62e283a9-156c-40d1-a01a-c09032747465\") " pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:57.931081 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:57.931066 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jlzfg" May 29 02:53:58.092683 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:58.092643 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jlzfg"] May 29 02:53:58.097298 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:53:58.097269 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62e283a9_156c_40d1_a01a_c09032747465.slice/crio-551a0c8889dce2500048445b37a20173cecf8c4ae99c5a6dd90cddacc2c81fea WatchSource:0}: Error finding container 551a0c8889dce2500048445b37a20173cecf8c4ae99c5a6dd90cddacc2c81fea: Status 404 returned error can't find the container with id 551a0c8889dce2500048445b37a20173cecf8c4ae99c5a6dd90cddacc2c81fea May 29 02:53:58.153165 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:58.153136 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jlzfg" event={"ID":"62e283a9-156c-40d1-a01a-c09032747465","Type":"ContainerStarted","Data":"917661a4dbdb4023c409760c42e9b1eec1d8c5cbf49957ac76d88aff5a95b8cf"} May 29 02:53:58.153271 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:58.153178 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jlzfg" event={"ID":"62e283a9-156c-40d1-a01a-c09032747465","Type":"ContainerStarted","Data":"551a0c8889dce2500048445b37a20173cecf8c4ae99c5a6dd90cddacc2c81fea"} May 29 02:53:59.156495 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:53:59.156460 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jlzfg" event={"ID":"62e283a9-156c-40d1-a01a-c09032747465","Type":"ContainerStarted","Data":"586b28b7e663e01078cbd6a3b3d8797602588e94473aebd2fa0c22946e07e17c"} May 29 02:54:00.160732 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:00.160699 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jlzfg" event={"ID":"62e283a9-156c-40d1-a01a-c09032747465","Type":"ContainerStarted","Data":"4bb07b410e0dfc3f85c0015e6824a1bbb35366da4547e1fedd1c4652aa39402b"} May 29 02:54:00.182632 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:00.182586 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jlzfg" podStartSLOduration=1.251077473 podStartE2EDuration="3.182570975s" podCreationTimestamp="2026-05-29 02:53:57 +0000 UTC" firstStartedPulling="2026-05-29 02:53:58.148743319 +0000 UTC m=+123.985516490" lastFinishedPulling="2026-05-29 02:54:00.080236839 +0000 UTC m=+125.917009992" observedRunningTime="2026-05-29 02:54:00.181884336 +0000 UTC m=+126.018657512" watchObservedRunningTime="2026-05-29 02:54:00.182570975 +0000 UTC m=+126.019344150" May 29 02:54:03.789323 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.789265 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xjzpp"] May 29 02:54:03.791484 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.791467 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.794242 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.794221 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-m9bld\"" May 29 02:54:03.794532 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.794514 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" May 29 02:54:03.794601 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.794540 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" May 29 02:54:03.795407 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.795385 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" May 29 02:54:03.795407 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.795396 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" May 29 02:54:03.795550 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.795397 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" May 29 02:54:03.795550 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.795446 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" May 29 02:54:03.854492 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.854442 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-wtmp\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.854492 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.854497 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-accelerators-collector-config\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.854712 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.854530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.854712 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.854549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b843b8a7-12d6-4211-b0a3-c4d0d472324a-metrics-client-ca\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.854712 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.854576 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b843b8a7-12d6-4211-b0a3-c4d0d472324a-root\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.854712 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.854591 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-tls\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.854712 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.854667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b843b8a7-12d6-4211-b0a3-c4d0d472324a-sys\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.854712 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.854696 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67ns2\" (UniqueName: \"kubernetes.io/projected/b843b8a7-12d6-4211-b0a3-c4d0d472324a-kube-api-access-67ns2\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.854905 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.854718 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-textfile\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.955731 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.955689 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b843b8a7-12d6-4211-b0a3-c4d0d472324a-metrics-client-ca\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.955931 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.955753 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b843b8a7-12d6-4211-b0a3-c4d0d472324a-root\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.955931 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.955779 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-tls\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.955931 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.955817 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b843b8a7-12d6-4211-b0a3-c4d0d472324a-sys\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.955931 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.955855 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b843b8a7-12d6-4211-b0a3-c4d0d472324a-root\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.955931 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.955881 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-67ns2\" (UniqueName: \"kubernetes.io/projected/b843b8a7-12d6-4211-b0a3-c4d0d472324a-kube-api-access-67ns2\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.955931 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.955862 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b843b8a7-12d6-4211-b0a3-c4d0d472324a-sys\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.956224 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.955911 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-textfile\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.956224 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.956053 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-wtmp\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.956224 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.956084 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-accelerators-collector-config\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.956224 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:54:03.955911 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found May 29 02:54:03.956224 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.956171 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-wtmp\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.956224 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.956128 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.956224 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.956193 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-textfile\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.956224 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:54:03.956212 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-tls podName:b843b8a7-12d6-4211-b0a3-c4d0d472324a nodeName:}" failed. No retries permitted until 2026-05-29 02:54:04.456192092 +0000 UTC m=+130.292965263 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-tls") pod "node-exporter-xjzpp" (UID: "b843b8a7-12d6-4211-b0a3-c4d0d472324a") : secret "node-exporter-tls" not found May 29 02:54:03.956517 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.956362 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b843b8a7-12d6-4211-b0a3-c4d0d472324a-metrics-client-ca\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.956670 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.956649 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-accelerators-collector-config\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.958292 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.958276 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:03.966906 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:03.966884 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67ns2\" (UniqueName: \"kubernetes.io/projected/b843b8a7-12d6-4211-b0a3-c4d0d472324a-kube-api-access-67ns2\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:04.461090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:04.461049 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-tls\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:04.463303 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:04.463270 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b843b8a7-12d6-4211-b0a3-c4d0d472324a-node-exporter-tls\") pod \"node-exporter-xjzpp\" (UID: \"b843b8a7-12d6-4211-b0a3-c4d0d472324a\") " pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:04.662523 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:04.662475 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:54:04.664743 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:04.664714 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/188be971-e394-40d2-839e-47486bbfbe82-metrics-certs\") pod \"network-metrics-daemon-lrnzd\" (UID: \"188be971-e394-40d2-839e-47486bbfbe82\") " pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:54:04.699958 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:04.699924 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xjzpp" May 29 02:54:04.707882 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:54:04.707853 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb843b8a7_12d6_4211_b0a3_c4d0d472324a.slice/crio-db3c19ed6912643edd327aa4f0ed779f194ffc59eb1ca2ca99f6a7b80d35d3e2 WatchSource:0}: Error finding container db3c19ed6912643edd327aa4f0ed779f194ffc59eb1ca2ca99f6a7b80d35d3e2: Status 404 returned error can't find the container with id db3c19ed6912643edd327aa4f0ed779f194ffc59eb1ca2ca99f6a7b80d35d3e2 May 29 02:54:04.887543 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:04.887511 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n4b9g\"" May 29 02:54:04.895587 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:04.895563 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lrnzd" May 29 02:54:05.014269 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:05.014235 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lrnzd"] May 29 02:54:05.017442 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:54:05.017412 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188be971_e394_40d2_839e_47486bbfbe82.slice/crio-aa3a6cc6cde27a7d7bd768e1d1a4590e5240842e06c8430cc133b37fd1c4f9bd WatchSource:0}: Error finding container aa3a6cc6cde27a7d7bd768e1d1a4590e5240842e06c8430cc133b37fd1c4f9bd: Status 404 returned error can't find the container with id aa3a6cc6cde27a7d7bd768e1d1a4590e5240842e06c8430cc133b37fd1c4f9bd May 29 02:54:05.174163 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:05.174124 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrnzd" event={"ID":"188be971-e394-40d2-839e-47486bbfbe82","Type":"ContainerStarted","Data":"aa3a6cc6cde27a7d7bd768e1d1a4590e5240842e06c8430cc133b37fd1c4f9bd"} May 29 02:54:05.175186 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:05.175159 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xjzpp" event={"ID":"b843b8a7-12d6-4211-b0a3-c4d0d472324a","Type":"ContainerStarted","Data":"db3c19ed6912643edd327aa4f0ed779f194ffc59eb1ca2ca99f6a7b80d35d3e2"} May 29 02:54:06.179028 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:06.178936 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrnzd" event={"ID":"188be971-e394-40d2-839e-47486bbfbe82","Type":"ContainerStarted","Data":"4ff465400b785d11536c09f3a38281b36912cd469961b29d10c03331b74075b3"} May 29 02:54:06.179028 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:06.178983 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lrnzd" event={"ID":"188be971-e394-40d2-839e-47486bbfbe82","Type":"ContainerStarted","Data":"429b8f1ad20f8269c29d3934c5b19b5e4fcaf413b8b2e19d501139814d8f88b5"} May 29 02:54:06.180462 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:06.180434 2574 generic.go:358] "Generic (PLEG): container finished" podID="b843b8a7-12d6-4211-b0a3-c4d0d472324a" containerID="a1f653a4f1d72d54dcd693d7392b0be03509130945179020c8f00c0669203671" exitCode=0 May 29 02:54:06.180603 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:06.180495 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xjzpp" event={"ID":"b843b8a7-12d6-4211-b0a3-c4d0d472324a","Type":"ContainerDied","Data":"a1f653a4f1d72d54dcd693d7392b0be03509130945179020c8f00c0669203671"} May 29 02:54:06.196567 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:06.196527 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lrnzd" podStartSLOduration=130.291744169 podStartE2EDuration="2m11.196510641s" podCreationTimestamp="2026-05-29 02:51:55 +0000 UTC" firstStartedPulling="2026-05-29 02:54:05.019346571 +0000 UTC m=+130.856119725" lastFinishedPulling="2026-05-29 02:54:05.924113037 +0000 UTC m=+131.760886197" observedRunningTime="2026-05-29 02:54:06.195767193 +0000 UTC m=+132.032540369" watchObservedRunningTime="2026-05-29 02:54:06.196510641 +0000 UTC m=+132.033283816" May 29 02:54:07.185153 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:07.185117 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xjzpp" event={"ID":"b843b8a7-12d6-4211-b0a3-c4d0d472324a","Type":"ContainerStarted","Data":"d0e0f1f75096ea56674b61f1ebe5a5b748f27bb987c079e20539774520635762"} May 29 02:54:07.185153 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:07.185158 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xjzpp" event={"ID":"b843b8a7-12d6-4211-b0a3-c4d0d472324a","Type":"ContainerStarted","Data":"3b4bf4153295b2aaede947a7d78661e928abbc7e9e30c98f8c85a30484ba8f75"} May 29 02:54:07.207670 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:07.207624 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xjzpp" podStartSLOduration=3.022369779 podStartE2EDuration="4.207608255s" podCreationTimestamp="2026-05-29 02:54:03 +0000 UTC" firstStartedPulling="2026-05-29 02:54:04.711940537 +0000 UTC m=+130.548713695" lastFinishedPulling="2026-05-29 02:54:05.897179014 +0000 UTC m=+131.733952171" observedRunningTime="2026-05-29 02:54:07.206299135 +0000 UTC m=+133.043072310" watchObservedRunningTime="2026-05-29 02:54:07.207608255 +0000 UTC m=+133.044381431" May 29 02:54:16.850460 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:16.850411 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" podUID="957f9539-77dd-4a20-ab27-7c3b0f55286b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 29 02:54:19.602108 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:19.602073 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b75b5f565-fc4n6"] May 29 02:54:19.602493 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:54:19.602273 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" podUID="1b29295e-a814-40f1-a1e5-aebb11806cda" May 29 02:54:20.218600 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.218574 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:54:20.222525 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.222505 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:54:20.289660 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.289616 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-image-registry-private-configuration\") pod \"1b29295e-a814-40f1-a1e5-aebb11806cda\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " May 29 02:54:20.289841 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.289708 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-installation-pull-secrets\") pod \"1b29295e-a814-40f1-a1e5-aebb11806cda\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " May 29 02:54:20.289841 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.289739 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2npqj\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-kube-api-access-2npqj\") pod \"1b29295e-a814-40f1-a1e5-aebb11806cda\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " May 29 02:54:20.289841 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.289755 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-bound-sa-token\") pod \"1b29295e-a814-40f1-a1e5-aebb11806cda\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " May 29 02:54:20.289841 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.289774 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-certificates\") pod \"1b29295e-a814-40f1-a1e5-aebb11806cda\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " May 29 02:54:20.289841 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.289800 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1b29295e-a814-40f1-a1e5-aebb11806cda-ca-trust-extracted\") pod \"1b29295e-a814-40f1-a1e5-aebb11806cda\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " May 29 02:54:20.290096 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.289899 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-trusted-ca\") pod \"1b29295e-a814-40f1-a1e5-aebb11806cda\" (UID: \"1b29295e-a814-40f1-a1e5-aebb11806cda\") " May 29 02:54:20.290219 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.290118 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b29295e-a814-40f1-a1e5-aebb11806cda-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1b29295e-a814-40f1-a1e5-aebb11806cda" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" May 29 02:54:20.290219 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.290184 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1b29295e-a814-40f1-a1e5-aebb11806cda" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 02:54:20.290476 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.290453 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1b29295e-a814-40f1-a1e5-aebb11806cda" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" May 29 02:54:20.292085 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.292057 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1b29295e-a814-40f1-a1e5-aebb11806cda" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 02:54:20.292185 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.292125 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1b29295e-a814-40f1-a1e5-aebb11806cda" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" May 29 02:54:20.292367 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.292345 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-kube-api-access-2npqj" (OuterVolumeSpecName: "kube-api-access-2npqj") pod "1b29295e-a814-40f1-a1e5-aebb11806cda" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda"). InnerVolumeSpecName "kube-api-access-2npqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 02:54:20.292416 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.292397 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1b29295e-a814-40f1-a1e5-aebb11806cda" (UID: "1b29295e-a814-40f1-a1e5-aebb11806cda"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 02:54:20.390667 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.390629 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-certificates\") on node \"ip-10-0-138-99.ec2.internal\" DevicePath \"\"" May 29 02:54:20.390667 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.390658 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1b29295e-a814-40f1-a1e5-aebb11806cda-ca-trust-extracted\") on node \"ip-10-0-138-99.ec2.internal\" DevicePath \"\"" May 29 02:54:20.390667 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.390669 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1b29295e-a814-40f1-a1e5-aebb11806cda-trusted-ca\") on node \"ip-10-0-138-99.ec2.internal\" DevicePath \"\"" May 29 02:54:20.390897 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.390679 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-image-registry-private-configuration\") on node \"ip-10-0-138-99.ec2.internal\" DevicePath \"\"" May 29 02:54:20.390897 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.390690 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1b29295e-a814-40f1-a1e5-aebb11806cda-installation-pull-secrets\") on node \"ip-10-0-138-99.ec2.internal\" DevicePath \"\"" May 29 02:54:20.390897 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.390699 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2npqj\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-kube-api-access-2npqj\") on node \"ip-10-0-138-99.ec2.internal\" DevicePath \"\"" May 29 02:54:20.390897 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:20.390707 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-bound-sa-token\") on node \"ip-10-0-138-99.ec2.internal\" DevicePath \"\"" May 29 02:54:21.220626 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:21.220589 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6b75b5f565-fc4n6" May 29 02:54:21.283557 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:21.283510 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6b75b5f565-fc4n6"] May 29 02:54:21.294448 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:21.294413 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6b75b5f565-fc4n6"] May 29 02:54:21.398953 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:21.398922 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1b29295e-a814-40f1-a1e5-aebb11806cda-registry-tls\") on node \"ip-10-0-138-99.ec2.internal\" DevicePath \"\"" May 29 02:54:22.771140 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:22.771104 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b29295e-a814-40f1-a1e5-aebb11806cda" path="/var/lib/kubelet/pods/1b29295e-a814-40f1-a1e5-aebb11806cda/volumes" May 29 02:54:26.850023 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:26.849985 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" podUID="957f9539-77dd-4a20-ab27-7c3b0f55286b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 29 02:54:32.592992 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:54:32.592948 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qx45f" podUID="c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18" May 29 02:54:32.608151 ip-10-0-138-99 kubenswrapper[2574]: E0529 02:54:32.608112 2574 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-q8zzr" podUID="ff0a0239-5a87-4894-b455-5f3e6f51f2d9" May 29 02:54:33.253565 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:33.253528 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:54:33.253767 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:33.253534 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx45f" May 29 02:54:36.850758 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:36.850713 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" podUID="957f9539-77dd-4a20-ab27-7c3b0f55286b" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" May 29 02:54:36.851130 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:36.850793 2574 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" May 29 02:54:36.851334 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:36.851282 2574 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"35691cf61b4c86bae2d2733b75350e7eb7b7189d61b9b2029cff8bcafa01a1a9"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" containerMessage="Container service-proxy failed liveness probe, will be restarted" May 29 02:54:36.851379 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:36.851368 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" podUID="957f9539-77dd-4a20-ab27-7c3b0f55286b" containerName="service-proxy" containerID="cri-o://35691cf61b4c86bae2d2733b75350e7eb7b7189d61b9b2029cff8bcafa01a1a9" gracePeriod=30 May 29 02:54:37.266179 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.266095 2574 generic.go:358] "Generic (PLEG): container finished" podID="957f9539-77dd-4a20-ab27-7c3b0f55286b" containerID="35691cf61b4c86bae2d2733b75350e7eb7b7189d61b9b2029cff8bcafa01a1a9" exitCode=2 May 29 02:54:37.266179 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.266138 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" event={"ID":"957f9539-77dd-4a20-ab27-7c3b0f55286b","Type":"ContainerDied","Data":"35691cf61b4c86bae2d2733b75350e7eb7b7189d61b9b2029cff8bcafa01a1a9"} May 29 02:54:37.266179 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.266168 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-767c57dc47-ph4sq" event={"ID":"957f9539-77dd-4a20-ab27-7c3b0f55286b","Type":"ContainerStarted","Data":"aafe8706a473175d4ad182592d77cf561c8b521b448a635fa8e84c7b561f4587"} May 29 02:54:37.622840 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.622805 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:54:37.623147 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.622857 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:54:37.625182 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.625157 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18-metrics-tls\") pod \"dns-default-qx45f\" (UID: \"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18\") " pod="openshift-dns/dns-default-qx45f" May 29 02:54:37.625346 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.625328 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff0a0239-5a87-4894-b455-5f3e6f51f2d9-cert\") pod \"ingress-canary-q8zzr\" (UID: \"ff0a0239-5a87-4894-b455-5f3e6f51f2d9\") " pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:54:37.758052 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.758023 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4sfm2\"" May 29 02:54:37.759000 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.758983 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2t8gv\"" May 29 02:54:37.765090 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.765074 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-q8zzr" May 29 02:54:37.765142 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.765101 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qx45f" May 29 02:54:37.919767 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.919608 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qx45f"] May 29 02:54:37.923745 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:54:37.923718 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e3ecfa_ffb7_4dcd_a75d_8e009e125d18.slice/crio-e106ae291d585294d8a3300663c701a592d651e528d001566e1c2e6df6f4c07b WatchSource:0}: Error finding container e106ae291d585294d8a3300663c701a592d651e528d001566e1c2e6df6f4c07b: Status 404 returned error can't find the container with id e106ae291d585294d8a3300663c701a592d651e528d001566e1c2e6df6f4c07b May 29 02:54:37.934028 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:37.934005 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-q8zzr"] May 29 02:54:37.937040 ip-10-0-138-99 kubenswrapper[2574]: W0529 02:54:37.937010 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff0a0239_5a87_4894_b455_5f3e6f51f2d9.slice/crio-06af5693a2b819347ee050d1ae8d9e03d93595c268484b9b4e5a582888cd96d3 WatchSource:0}: Error finding container 06af5693a2b819347ee050d1ae8d9e03d93595c268484b9b4e5a582888cd96d3: Status 404 returned error can't find the container with id 06af5693a2b819347ee050d1ae8d9e03d93595c268484b9b4e5a582888cd96d3 May 29 02:54:38.269861 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:38.269768 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q8zzr" event={"ID":"ff0a0239-5a87-4894-b455-5f3e6f51f2d9","Type":"ContainerStarted","Data":"06af5693a2b819347ee050d1ae8d9e03d93595c268484b9b4e5a582888cd96d3"} May 29 02:54:38.270728 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:38.270693 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx45f" event={"ID":"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18","Type":"ContainerStarted","Data":"e106ae291d585294d8a3300663c701a592d651e528d001566e1c2e6df6f4c07b"} May 29 02:54:40.276902 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:40.276867 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-q8zzr" event={"ID":"ff0a0239-5a87-4894-b455-5f3e6f51f2d9","Type":"ContainerStarted","Data":"f74028215272349513e50d45894db2b9d9d3e168ecccf9124d840fcf0f46ccd2"} May 29 02:54:40.278354 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:40.278329 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx45f" event={"ID":"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18","Type":"ContainerStarted","Data":"c9dd49c81cde4c4b8a4d88aac57b80d8537259f76563b7dc561392d7a60d2c48"} May 29 02:54:40.278460 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:40.278360 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qx45f" event={"ID":"c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18","Type":"ContainerStarted","Data":"6a2b3bf1799609596f243f7dc63d0443cca600eeefda48e694e91729f0f14f99"} May 29 02:54:40.278460 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:40.278439 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qx45f" May 29 02:54:40.297491 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:40.297446 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-q8zzr" podStartSLOduration=129.459341342 podStartE2EDuration="2m11.297432771s" podCreationTimestamp="2026-05-29 02:52:29 +0000 UTC" firstStartedPulling="2026-05-29 02:54:37.938871808 +0000 UTC m=+163.775644965" lastFinishedPulling="2026-05-29 02:54:39.776963237 +0000 UTC m=+165.613736394" observedRunningTime="2026-05-29 02:54:40.295506102 +0000 UTC m=+166.132279277" watchObservedRunningTime="2026-05-29 02:54:40.297432771 +0000 UTC m=+166.134205947" May 29 02:54:40.328376 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:40.328295 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-qx45f" podStartSLOduration=129.480851333 podStartE2EDuration="2m11.328279434s" podCreationTimestamp="2026-05-29 02:52:29 +0000 UTC" firstStartedPulling="2026-05-29 02:54:37.925626749 +0000 UTC m=+163.762399916" lastFinishedPulling="2026-05-29 02:54:39.77305486 +0000 UTC m=+165.609828017" observedRunningTime="2026-05-29 02:54:40.327180846 +0000 UTC m=+166.163954021" watchObservedRunningTime="2026-05-29 02:54:40.328279434 +0000 UTC m=+166.165052609" May 29 02:54:50.283650 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:50.283566 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qx45f" May 29 02:54:51.532230 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:54:51.532200 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q8zzr_ff0a0239-5a87-4894-b455-5f3e6f51f2d9/serve-healthcheck-canary/0.log" May 29 02:56:54.680899 ip-10-0-138-99 kubenswrapper[2574]: I0529 02:56:54.680866 2574 kubelet.go:1628] "Image garbage collection succeeded" May 29 03:05:29.034260 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.034177 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-brk4t"] May 29 03:05:29.037345 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.037324 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-brk4t" May 29 03:05:29.039868 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.039842 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\"" May 29 03:05:29.039980 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.039848 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\"" May 29 03:05:29.039980 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.039896 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-wctn5\"" May 29 03:05:29.040849 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.040834 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\"" May 29 03:05:29.044111 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.044090 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-brk4t"] May 29 03:05:29.174176 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.174128 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqhhg\" (UniqueName: \"kubernetes.io/projected/ebc7962a-9ba6-4c66-a2ac-008920e6c412-kube-api-access-pqhhg\") pod \"feast-test-apply-brk4t\" (UID: \"ebc7962a-9ba6-4c66-a2ac-008920e6c412\") " pod="test-ns-feast/feast-test-apply-brk4t" May 29 03:05:29.274795 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.274761 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqhhg\" (UniqueName: \"kubernetes.io/projected/ebc7962a-9ba6-4c66-a2ac-008920e6c412-kube-api-access-pqhhg\") pod \"feast-test-apply-brk4t\" (UID: \"ebc7962a-9ba6-4c66-a2ac-008920e6c412\") " pod="test-ns-feast/feast-test-apply-brk4t" May 29 03:05:29.282956 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.282932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqhhg\" (UniqueName: \"kubernetes.io/projected/ebc7962a-9ba6-4c66-a2ac-008920e6c412-kube-api-access-pqhhg\") pod \"feast-test-apply-brk4t\" (UID: \"ebc7962a-9ba6-4c66-a2ac-008920e6c412\") " pod="test-ns-feast/feast-test-apply-brk4t" May 29 03:05:29.346430 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.346402 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-brk4t" May 29 03:05:29.465735 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.465711 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-brk4t"] May 29 03:05:29.468035 ip-10-0-138-99 kubenswrapper[2574]: W0529 03:05:29.468010 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podebc7962a_9ba6_4c66_a2ac_008920e6c412.slice/crio-3cdf806b7f0e25515bdf4752c216d14aca16dae94f4bb086885b8c410911247d WatchSource:0}: Error finding container 3cdf806b7f0e25515bdf4752c216d14aca16dae94f4bb086885b8c410911247d: Status 404 returned error can't find the container with id 3cdf806b7f0e25515bdf4752c216d14aca16dae94f4bb086885b8c410911247d May 29 03:05:29.469716 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.469699 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 03:05:29.915447 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:29.915416 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-brk4t" event={"ID":"ebc7962a-9ba6-4c66-a2ac-008920e6c412","Type":"ContainerStarted","Data":"3cdf806b7f0e25515bdf4752c216d14aca16dae94f4bb086885b8c410911247d"} May 29 03:05:35.936212 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:35.936176 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-brk4t" event={"ID":"ebc7962a-9ba6-4c66-a2ac-008920e6c412","Type":"ContainerStarted","Data":"07f66d99703ccf9653bd81ccad5b326eef5e201b9a96b600a801a8fe64c0af96"} May 29 03:05:41.952877 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:41.952841 2574 generic.go:358] "Generic (PLEG): container finished" podID="ebc7962a-9ba6-4c66-a2ac-008920e6c412" containerID="07f66d99703ccf9653bd81ccad5b326eef5e201b9a96b600a801a8fe64c0af96" exitCode=0 May 29 03:05:41.953292 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:41.952921 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-brk4t" event={"ID":"ebc7962a-9ba6-4c66-a2ac-008920e6c412","Type":"ContainerDied","Data":"07f66d99703ccf9653bd81ccad5b326eef5e201b9a96b600a801a8fe64c0af96"} May 29 03:05:42.961419 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:42.961384 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-brk4t" event={"ID":"ebc7962a-9ba6-4c66-a2ac-008920e6c412","Type":"ContainerStarted","Data":"e442858452478011be862031afb8d6b6c897548bc35acf57545d5c4703cc48e4"} May 29 03:05:42.980339 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:42.980273 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-brk4t" podStartSLOduration=8.098535409 podStartE2EDuration="13.980258649s" podCreationTimestamp="2026-05-29 03:05:29 +0000 UTC" firstStartedPulling="2026-05-29 03:05:29.469829953 +0000 UTC m=+815.306603107" lastFinishedPulling="2026-05-29 03:05:35.351553191 +0000 UTC m=+821.188326347" observedRunningTime="2026-05-29 03:05:42.979416633 +0000 UTC m=+828.816189809" watchObservedRunningTime="2026-05-29 03:05:42.980258649 +0000 UTC m=+828.817031826" May 29 03:05:50.982734 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:50.982699 2574 generic.go:358] "Generic (PLEG): container finished" podID="ebc7962a-9ba6-4c66-a2ac-008920e6c412" containerID="e442858452478011be862031afb8d6b6c897548bc35acf57545d5c4703cc48e4" exitCode=0 May 29 03:05:50.983116 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:50.982776 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-brk4t" event={"ID":"ebc7962a-9ba6-4c66-a2ac-008920e6c412","Type":"ContainerDied","Data":"e442858452478011be862031afb8d6b6c897548bc35acf57545d5c4703cc48e4"} May 29 03:05:52.108102 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:52.108080 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-brk4t" May 29 03:05:52.143714 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:52.143680 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqhhg\" (UniqueName: \"kubernetes.io/projected/ebc7962a-9ba6-4c66-a2ac-008920e6c412-kube-api-access-pqhhg\") pod \"ebc7962a-9ba6-4c66-a2ac-008920e6c412\" (UID: \"ebc7962a-9ba6-4c66-a2ac-008920e6c412\") " May 29 03:05:52.145781 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:52.145749 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebc7962a-9ba6-4c66-a2ac-008920e6c412-kube-api-access-pqhhg" (OuterVolumeSpecName: "kube-api-access-pqhhg") pod "ebc7962a-9ba6-4c66-a2ac-008920e6c412" (UID: "ebc7962a-9ba6-4c66-a2ac-008920e6c412"). InnerVolumeSpecName "kube-api-access-pqhhg". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 03:05:52.244293 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:52.244203 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqhhg\" (UniqueName: \"kubernetes.io/projected/ebc7962a-9ba6-4c66-a2ac-008920e6c412-kube-api-access-pqhhg\") on node \"ip-10-0-138-99.ec2.internal\" DevicePath \"\"" May 29 03:05:52.989589 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:52.989554 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-brk4t" event={"ID":"ebc7962a-9ba6-4c66-a2ac-008920e6c412","Type":"ContainerDied","Data":"3cdf806b7f0e25515bdf4752c216d14aca16dae94f4bb086885b8c410911247d"} May 29 03:05:52.989589 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:52.989584 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-brk4t" May 29 03:05:52.989836 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:52.989587 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3cdf806b7f0e25515bdf4752c216d14aca16dae94f4bb086885b8c410911247d" May 29 03:05:53.168922 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:53.168897 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-brk4t_ebc7962a-9ba6-4c66-a2ac-008920e6c412/feast-0/0.log" May 29 03:05:53.175774 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:05:53.175755 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-brk4t_ebc7962a-9ba6-4c66-a2ac-008920e6c412/feast-1/0.log" May 29 03:06:28.120025 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:06:28.119992 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-brk4t"] May 29 03:06:28.125902 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:06:28.125873 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-brk4t"] May 29 03:06:28.771625 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:06:28.771592 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebc7962a-9ba6-4c66-a2ac-008920e6c412" path="/var/lib/kubelet/pods/ebc7962a-9ba6-4c66-a2ac-008920e6c412/volumes" May 29 03:08:43.673608 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.673575 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-854544c579-24zmc"] May 29 03:08:43.674867 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.673793 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc7962a-9ba6-4c66-a2ac-008920e6c412" containerName="feast-1" May 29 03:08:43.674867 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.673804 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc7962a-9ba6-4c66-a2ac-008920e6c412" containerName="feast-1" May 29 03:08:43.674867 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.673825 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebc7962a-9ba6-4c66-a2ac-008920e6c412" containerName="feast-0" May 29 03:08:43.674867 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.673831 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebc7962a-9ba6-4c66-a2ac-008920e6c412" containerName="feast-0" May 29 03:08:43.674867 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.673905 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="ebc7962a-9ba6-4c66-a2ac-008920e6c412" containerName="feast-1" May 29 03:08:43.675687 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.675667 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-24zmc" May 29 03:08:43.678615 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.678594 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-rmqxj\"" May 29 03:08:43.678724 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.678670 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\"" May 29 03:08:43.679790 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.679769 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\"" May 29 03:08:43.690556 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.690530 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-24zmc"] May 29 03:08:43.712587 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.712558 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2x7m\" (UniqueName: \"kubernetes.io/projected/24c57c50-9ecb-47ba-8814-023175fe7f11-kube-api-access-t2x7m\") pod \"redis-854544c579-24zmc\" (UID: \"24c57c50-9ecb-47ba-8814-023175fe7f11\") " pod="test-ns-feast-rest/redis-854544c579-24zmc" May 29 03:08:43.812955 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.812917 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t2x7m\" (UniqueName: \"kubernetes.io/projected/24c57c50-9ecb-47ba-8814-023175fe7f11-kube-api-access-t2x7m\") pod \"redis-854544c579-24zmc\" (UID: \"24c57c50-9ecb-47ba-8814-023175fe7f11\") " pod="test-ns-feast-rest/redis-854544c579-24zmc" May 29 03:08:43.821713 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.821678 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2x7m\" (UniqueName: \"kubernetes.io/projected/24c57c50-9ecb-47ba-8814-023175fe7f11-kube-api-access-t2x7m\") pod \"redis-854544c579-24zmc\" (UID: \"24c57c50-9ecb-47ba-8814-023175fe7f11\") " pod="test-ns-feast-rest/redis-854544c579-24zmc" May 29 03:08:43.985242 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:43.985147 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-24zmc" May 29 03:08:44.103977 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:44.103942 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-854544c579-24zmc"] May 29 03:08:44.107060 ip-10-0-138-99 kubenswrapper[2574]: W0529 03:08:44.107036 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod24c57c50_9ecb_47ba_8814_023175fe7f11.slice/crio-9a5c9a977e8b3e43a9e45b8c20d4e96fe984a394fb43c19b95850fe7a1dab86a WatchSource:0}: Error finding container 9a5c9a977e8b3e43a9e45b8c20d4e96fe984a394fb43c19b95850fe7a1dab86a: Status 404 returned error can't find the container with id 9a5c9a977e8b3e43a9e45b8c20d4e96fe984a394fb43c19b95850fe7a1dab86a May 29 03:08:44.418432 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:44.418396 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-24zmc" event={"ID":"24c57c50-9ecb-47ba-8814-023175fe7f11","Type":"ContainerStarted","Data":"9a5c9a977e8b3e43a9e45b8c20d4e96fe984a394fb43c19b95850fe7a1dab86a"} May 29 03:08:46.425956 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:46.425920 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-24zmc" event={"ID":"24c57c50-9ecb-47ba-8814-023175fe7f11","Type":"ContainerStarted","Data":"412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe"} May 29 03:08:46.441955 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:08:46.441906 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast-rest/redis-854544c579-24zmc" podStartSLOduration=1.847922864 podStartE2EDuration="3.44189259s" podCreationTimestamp="2026-05-29 03:08:43 +0000 UTC" firstStartedPulling="2026-05-29 03:08:44.109088061 +0000 UTC m=+1009.945861220" lastFinishedPulling="2026-05-29 03:08:45.703057792 +0000 UTC m=+1011.539830946" observedRunningTime="2026-05-29 03:08:46.441058122 +0000 UTC m=+1012.277831300" watchObservedRunningTime="2026-05-29 03:08:46.44189259 +0000 UTC m=+1012.278665765" May 29 03:11:01.696639 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:01.696600 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-24zmc"] May 29 03:11:01.697155 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:01.696816 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast-rest/redis-854544c579-24zmc" podUID="24c57c50-9ecb-47ba-8814-023175fe7f11" containerName="redis" containerID="cri-o://412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe" gracePeriod=30 May 29 03:11:01.926398 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:01.926374 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-24zmc" May 29 03:11:01.976284 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:01.976193 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2x7m\" (UniqueName: \"kubernetes.io/projected/24c57c50-9ecb-47ba-8814-023175fe7f11-kube-api-access-t2x7m\") pod \"24c57c50-9ecb-47ba-8814-023175fe7f11\" (UID: \"24c57c50-9ecb-47ba-8814-023175fe7f11\") " May 29 03:11:01.978342 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:01.978300 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24c57c50-9ecb-47ba-8814-023175fe7f11-kube-api-access-t2x7m" (OuterVolumeSpecName: "kube-api-access-t2x7m") pod "24c57c50-9ecb-47ba-8814-023175fe7f11" (UID: "24c57c50-9ecb-47ba-8814-023175fe7f11"). InnerVolumeSpecName "kube-api-access-t2x7m". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 03:11:02.076777 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:02.076736 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2x7m\" (UniqueName: \"kubernetes.io/projected/24c57c50-9ecb-47ba-8814-023175fe7f11-kube-api-access-t2x7m\") on node \"ip-10-0-138-99.ec2.internal\" DevicePath \"\"" May 29 03:11:02.765156 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:02.765121 2574 generic.go:358] "Generic (PLEG): container finished" podID="24c57c50-9ecb-47ba-8814-023175fe7f11" containerID="412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe" exitCode=0 May 29 03:11:02.765571 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:02.765175 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-854544c579-24zmc" May 29 03:11:02.765571 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:02.765213 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-24zmc" event={"ID":"24c57c50-9ecb-47ba-8814-023175fe7f11","Type":"ContainerDied","Data":"412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe"} May 29 03:11:02.765571 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:02.765254 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-854544c579-24zmc" event={"ID":"24c57c50-9ecb-47ba-8814-023175fe7f11","Type":"ContainerDied","Data":"9a5c9a977e8b3e43a9e45b8c20d4e96fe984a394fb43c19b95850fe7a1dab86a"} May 29 03:11:02.765571 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:02.765288 2574 scope.go:117] "RemoveContainer" containerID="412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe" May 29 03:11:02.773806 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:02.773787 2574 scope.go:117] "RemoveContainer" containerID="412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe" May 29 03:11:02.774143 ip-10-0-138-99 kubenswrapper[2574]: E0529 03:11:02.774113 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe\": container with ID starting with 412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe not found: ID does not exist" containerID="412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe" May 29 03:11:02.774235 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:02.774152 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe"} err="failed to get container status \"412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe\": rpc error: code = NotFound desc = could not find container \"412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe\": container with ID starting with 412edab245992bc0e1b5f1a80a3ae23829cf8403ee6f93203b62359e50ea24fe not found: ID does not exist" May 29 03:11:02.786849 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:02.786821 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-854544c579-24zmc"] May 29 03:11:02.792815 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:02.792794 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-854544c579-24zmc"] May 29 03:11:04.771740 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:04.771707 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24c57c50-9ecb-47ba-8814-023175fe7f11" path="/var/lib/kubelet/pods/24c57c50-9ecb-47ba-8814-023175fe7f11/volumes" May 29 03:11:11.182101 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.182068 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd"] May 29 03:11:11.182504 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.182337 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24c57c50-9ecb-47ba-8814-023175fe7f11" containerName="redis" May 29 03:11:11.182504 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.182351 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="24c57c50-9ecb-47ba-8814-023175fe7f11" containerName="redis" May 29 03:11:11.182504 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.182396 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="24c57c50-9ecb-47ba-8814-023175fe7f11" containerName="redis" May 29 03:11:11.186386 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.186370 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" May 29 03:11:11.189398 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.189378 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" May 29 03:11:11.190609 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.190588 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" May 29 03:11:11.190722 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.190588 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-7jqdn\"" May 29 03:11:11.196357 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.196271 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd"] May 29 03:11:11.240123 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.240082 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtjrx\" (UniqueName: \"kubernetes.io/projected/ce3d4313-1186-4fca-96f8-6c8b2998b358-kube-api-access-qtjrx\") pod \"feast-operator-controller-manager-cf99db75-54zkd\" (UID: \"ce3d4313-1186-4fca-96f8-6c8b2998b358\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" May 29 03:11:11.341496 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.341457 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtjrx\" (UniqueName: \"kubernetes.io/projected/ce3d4313-1186-4fca-96f8-6c8b2998b358-kube-api-access-qtjrx\") pod \"feast-operator-controller-manager-cf99db75-54zkd\" (UID: \"ce3d4313-1186-4fca-96f8-6c8b2998b358\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" May 29 03:11:11.352585 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.352561 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtjrx\" (UniqueName: \"kubernetes.io/projected/ce3d4313-1186-4fca-96f8-6c8b2998b358-kube-api-access-qtjrx\") pod \"feast-operator-controller-manager-cf99db75-54zkd\" (UID: \"ce3d4313-1186-4fca-96f8-6c8b2998b358\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" May 29 03:11:11.496325 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.496224 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" May 29 03:11:11.621353 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.621330 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd"] May 29 03:11:11.623717 ip-10-0-138-99 kubenswrapper[2574]: W0529 03:11:11.623689 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce3d4313_1186_4fca_96f8_6c8b2998b358.slice/crio-d26a114b29fa15d5186075994c220b6a86ded22c2783d5e82263f464ecbf9022 WatchSource:0}: Error finding container d26a114b29fa15d5186075994c220b6a86ded22c2783d5e82263f464ecbf9022: Status 404 returned error can't find the container with id d26a114b29fa15d5186075994c220b6a86ded22c2783d5e82263f464ecbf9022 May 29 03:11:11.625397 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.625377 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 03:11:11.787834 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:11.787748 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" event={"ID":"ce3d4313-1186-4fca-96f8-6c8b2998b358","Type":"ContainerStarted","Data":"d26a114b29fa15d5186075994c220b6a86ded22c2783d5e82263f464ecbf9022"} May 29 03:11:14.800495 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:14.800462 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" event={"ID":"ce3d4313-1186-4fca-96f8-6c8b2998b358","Type":"ContainerStarted","Data":"60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad"} May 29 03:11:14.800836 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:14.800520 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" May 29 03:11:14.817012 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:14.816963 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" podStartSLOduration=0.825057315 podStartE2EDuration="3.816950016s" podCreationTimestamp="2026-05-29 03:11:11 +0000 UTC" firstStartedPulling="2026-05-29 03:11:11.625537507 +0000 UTC m=+1157.462310664" lastFinishedPulling="2026-05-29 03:11:14.617430208 +0000 UTC m=+1160.454203365" observedRunningTime="2026-05-29 03:11:14.816506108 +0000 UTC m=+1160.653279321" watchObservedRunningTime="2026-05-29 03:11:14.816950016 +0000 UTC m=+1160.653723191" May 29 03:11:25.806088 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:25.806058 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" May 29 03:11:54.737188 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:54.737158 2574 scope.go:117] "RemoveContainer" containerID="e442858452478011be862031afb8d6b6c897548bc35acf57545d5c4703cc48e4" May 29 03:11:54.745731 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:11:54.745711 2574 scope.go:117] "RemoveContainer" containerID="07f66d99703ccf9653bd81ccad5b326eef5e201b9a96b600a801a8fe64c0af96" May 29 03:16:37.721085 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:37.721051 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd"] May 29 03:16:37.721559 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:37.721271 2574 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" podUID="ce3d4313-1186-4fca-96f8-6c8b2998b358" containerName="manager" containerID="cri-o://60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad" gracePeriod=10 May 29 03:16:37.960145 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:37.960123 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" May 29 03:16:38.017585 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.017496 2574 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtjrx\" (UniqueName: \"kubernetes.io/projected/ce3d4313-1186-4fca-96f8-6c8b2998b358-kube-api-access-qtjrx\") pod \"ce3d4313-1186-4fca-96f8-6c8b2998b358\" (UID: \"ce3d4313-1186-4fca-96f8-6c8b2998b358\") " May 29 03:16:38.019575 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.019545 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce3d4313-1186-4fca-96f8-6c8b2998b358-kube-api-access-qtjrx" (OuterVolumeSpecName: "kube-api-access-qtjrx") pod "ce3d4313-1186-4fca-96f8-6c8b2998b358" (UID: "ce3d4313-1186-4fca-96f8-6c8b2998b358"). InnerVolumeSpecName "kube-api-access-qtjrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" May 29 03:16:38.118940 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.118893 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtjrx\" (UniqueName: \"kubernetes.io/projected/ce3d4313-1186-4fca-96f8-6c8b2998b358-kube-api-access-qtjrx\") on node \"ip-10-0-138-99.ec2.internal\" DevicePath \"\"" May 29 03:16:38.602092 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.602053 2574 generic.go:358] "Generic (PLEG): container finished" podID="ce3d4313-1186-4fca-96f8-6c8b2998b358" containerID="60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad" exitCode=0 May 29 03:16:38.602274 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.602105 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" event={"ID":"ce3d4313-1186-4fca-96f8-6c8b2998b358","Type":"ContainerDied","Data":"60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad"} May 29 03:16:38.602274 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.602117 2574 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" May 29 03:16:38.602274 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.602128 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd" event={"ID":"ce3d4313-1186-4fca-96f8-6c8b2998b358","Type":"ContainerDied","Data":"d26a114b29fa15d5186075994c220b6a86ded22c2783d5e82263f464ecbf9022"} May 29 03:16:38.602274 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.602142 2574 scope.go:117] "RemoveContainer" containerID="60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad" May 29 03:16:38.609919 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.609899 2574 scope.go:117] "RemoveContainer" containerID="60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad" May 29 03:16:38.610196 ip-10-0-138-99 kubenswrapper[2574]: E0529 03:16:38.610175 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad\": container with ID starting with 60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad not found: ID does not exist" containerID="60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad" May 29 03:16:38.610282 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.610203 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad"} err="failed to get container status \"60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad\": rpc error: code = NotFound desc = could not find container \"60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad\": container with ID starting with 60234b5b2df5dc5cab7eb3eee496e39654d78b8e2b61d8d08c9a45eb4d07e4ad not found: ID does not exist" May 29 03:16:38.627810 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.627781 2574 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd"] May 29 03:16:38.629943 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.629917 2574 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-54zkd"] May 29 03:16:38.773943 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:38.773910 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce3d4313-1186-4fca-96f8-6c8b2998b358" path="/var/lib/kubelet/pods/ce3d4313-1186-4fca-96f8-6c8b2998b358/volumes" May 29 03:16:42.143898 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.143864 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9"] May 29 03:16:42.144263 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.144131 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce3d4313-1186-4fca-96f8-6c8b2998b358" containerName="manager" May 29 03:16:42.144263 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.144142 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce3d4313-1186-4fca-96f8-6c8b2998b358" containerName="manager" May 29 03:16:42.144263 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.144182 2574 memory_manager.go:356] "RemoveStaleState removing state" podUID="ce3d4313-1186-4fca-96f8-6c8b2998b358" containerName="manager" May 29 03:16:42.148148 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.148132 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9" May 29 03:16:42.150681 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.150663 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\"" May 29 03:16:42.151860 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.151844 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\"" May 29 03:16:42.151921 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.151896 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-7jqdn\"" May 29 03:16:42.156967 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.156943 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9"] May 29 03:16:42.248804 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.248771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2cfg\" (UniqueName: \"kubernetes.io/projected/d2e1cd06-1b2d-47dd-aed9-44dd6fd71118-kube-api-access-g2cfg\") pod \"feast-operator-controller-manager-cf99db75-sgrl9\" (UID: \"d2e1cd06-1b2d-47dd-aed9-44dd6fd71118\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9" May 29 03:16:42.349155 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.349116 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2cfg\" (UniqueName: \"kubernetes.io/projected/d2e1cd06-1b2d-47dd-aed9-44dd6fd71118-kube-api-access-g2cfg\") pod \"feast-operator-controller-manager-cf99db75-sgrl9\" (UID: \"d2e1cd06-1b2d-47dd-aed9-44dd6fd71118\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9" May 29 03:16:42.358038 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.358008 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2cfg\" (UniqueName: \"kubernetes.io/projected/d2e1cd06-1b2d-47dd-aed9-44dd6fd71118-kube-api-access-g2cfg\") pod \"feast-operator-controller-manager-cf99db75-sgrl9\" (UID: \"d2e1cd06-1b2d-47dd-aed9-44dd6fd71118\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9" May 29 03:16:42.457847 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.457759 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9" May 29 03:16:42.579968 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.579937 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9"] May 29 03:16:42.583368 ip-10-0-138-99 kubenswrapper[2574]: W0529 03:16:42.583302 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e1cd06_1b2d_47dd_aed9_44dd6fd71118.slice/crio-a397b0a0702530318086a8dea9926db11cc5b0ecbf1f2daa4a9ab874629862ab WatchSource:0}: Error finding container a397b0a0702530318086a8dea9926db11cc5b0ecbf1f2daa4a9ab874629862ab: Status 404 returned error can't find the container with id a397b0a0702530318086a8dea9926db11cc5b0ecbf1f2daa4a9ab874629862ab May 29 03:16:42.585325 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.585290 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 03:16:42.613194 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:42.613166 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9" event={"ID":"d2e1cd06-1b2d-47dd-aed9-44dd6fd71118","Type":"ContainerStarted","Data":"a397b0a0702530318086a8dea9926db11cc5b0ecbf1f2daa4a9ab874629862ab"} May 29 03:16:43.617300 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:43.617265 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9" event={"ID":"d2e1cd06-1b2d-47dd-aed9-44dd6fd71118","Type":"ContainerStarted","Data":"e17c1a630911adc591d49e62059d428757063ab05e5fa8d8f8edf9def83d99db"} May 29 03:16:43.617779 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:43.617454 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9" May 29 03:16:43.636427 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:43.636378 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9" podStartSLOduration=1.6363608570000001 podStartE2EDuration="1.636360857s" podCreationTimestamp="2026-05-29 03:16:42 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 03:16:43.635265522 +0000 UTC m=+1489.472038699" watchObservedRunningTime="2026-05-29 03:16:43.636360857 +0000 UTC m=+1489.473134033" May 29 03:16:54.623117 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:16:54.623087 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-sgrl9" May 29 03:22:12.570643 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.570609 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-89vx4/must-gather-c5rhs"] May 29 03:22:12.573776 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.573757 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89vx4/must-gather-c5rhs" May 29 03:22:12.576625 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.576596 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-89vx4\"/\"openshift-service-ca.crt\"" May 29 03:22:12.576747 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.576654 2574 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-89vx4\"/\"kube-root-ca.crt\"" May 29 03:22:12.576747 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.576735 2574 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-89vx4\"/\"default-dockercfg-cqj8h\"" May 29 03:22:12.587715 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.587691 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89vx4/must-gather-c5rhs"] May 29 03:22:12.677408 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.677370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4gl5\" (UniqueName: \"kubernetes.io/projected/62eeacfc-546b-4ffa-b672-b1ebb2fd09a3-kube-api-access-x4gl5\") pod \"must-gather-c5rhs\" (UID: \"62eeacfc-546b-4ffa-b672-b1ebb2fd09a3\") " pod="openshift-must-gather-89vx4/must-gather-c5rhs" May 29 03:22:12.677408 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.677416 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/62eeacfc-546b-4ffa-b672-b1ebb2fd09a3-must-gather-output\") pod \"must-gather-c5rhs\" (UID: \"62eeacfc-546b-4ffa-b672-b1ebb2fd09a3\") " pod="openshift-must-gather-89vx4/must-gather-c5rhs" May 29 03:22:12.777945 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.777905 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4gl5\" (UniqueName: \"kubernetes.io/projected/62eeacfc-546b-4ffa-b672-b1ebb2fd09a3-kube-api-access-x4gl5\") pod \"must-gather-c5rhs\" (UID: \"62eeacfc-546b-4ffa-b672-b1ebb2fd09a3\") " pod="openshift-must-gather-89vx4/must-gather-c5rhs" May 29 03:22:12.777945 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.777954 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/62eeacfc-546b-4ffa-b672-b1ebb2fd09a3-must-gather-output\") pod \"must-gather-c5rhs\" (UID: \"62eeacfc-546b-4ffa-b672-b1ebb2fd09a3\") " pod="openshift-must-gather-89vx4/must-gather-c5rhs" May 29 03:22:12.778358 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.778343 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/62eeacfc-546b-4ffa-b672-b1ebb2fd09a3-must-gather-output\") pod \"must-gather-c5rhs\" (UID: \"62eeacfc-546b-4ffa-b672-b1ebb2fd09a3\") " pod="openshift-must-gather-89vx4/must-gather-c5rhs" May 29 03:22:12.787736 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.787708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4gl5\" (UniqueName: \"kubernetes.io/projected/62eeacfc-546b-4ffa-b672-b1ebb2fd09a3-kube-api-access-x4gl5\") pod \"must-gather-c5rhs\" (UID: \"62eeacfc-546b-4ffa-b672-b1ebb2fd09a3\") " pod="openshift-must-gather-89vx4/must-gather-c5rhs" May 29 03:22:12.883143 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:12.883056 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89vx4/must-gather-c5rhs" May 29 03:22:13.006195 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:13.006165 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89vx4/must-gather-c5rhs"] May 29 03:22:13.009737 ip-10-0-138-99 kubenswrapper[2574]: W0529 03:22:13.009710 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod62eeacfc_546b_4ffa_b672_b1ebb2fd09a3.slice/crio-886f23e90a14b67d6f21d01a568a022eec9393f4a01b0ec47615fd5bb4dbf32f WatchSource:0}: Error finding container 886f23e90a14b67d6f21d01a568a022eec9393f4a01b0ec47615fd5bb4dbf32f: Status 404 returned error can't find the container with id 886f23e90a14b67d6f21d01a568a022eec9393f4a01b0ec47615fd5bb4dbf32f May 29 03:22:13.011476 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:13.011457 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider May 29 03:22:13.450524 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:13.450480 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89vx4/must-gather-c5rhs" event={"ID":"62eeacfc-546b-4ffa-b672-b1ebb2fd09a3","Type":"ContainerStarted","Data":"886f23e90a14b67d6f21d01a568a022eec9393f4a01b0ec47615fd5bb4dbf32f"} May 29 03:22:14.456401 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:14.456359 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89vx4/must-gather-c5rhs" event={"ID":"62eeacfc-546b-4ffa-b672-b1ebb2fd09a3","Type":"ContainerStarted","Data":"adf2c3ed3e50921a018ebca274a6dd825c2bb548f36801c5ca32b09fa8b211dc"} May 29 03:22:14.456401 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:14.456407 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89vx4/must-gather-c5rhs" event={"ID":"62eeacfc-546b-4ffa-b672-b1ebb2fd09a3","Type":"ContainerStarted","Data":"c5944f24d06d82b4f4f69b1162a832caddf8be123d0c3745dd3abcc305e6606d"} May 29 03:22:15.337026 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:15.336995 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nnd5c_1d65b6ab-1d55-44a1-84a9-d78faf564883/global-pull-secret-syncer/0.log" May 29 03:22:15.449714 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:15.449638 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pkzpj_cbcd458a-5ca0-441c-895b-26df96b08e82/konnectivity-agent/0.log" May 29 03:22:15.545159 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:15.545123 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-99.ec2.internal_e354e43296421427a44b6f8a2873628d/haproxy/0.log" May 29 03:22:19.322911 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:19.322877 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xjzpp_b843b8a7-12d6-4211-b0a3-c4d0d472324a/node-exporter/0.log" May 29 03:22:19.345258 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:19.345232 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xjzpp_b843b8a7-12d6-4211-b0a3-c4d0d472324a/kube-rbac-proxy/0.log" May 29 03:22:19.370594 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:19.370418 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xjzpp_b843b8a7-12d6-4211-b0a3-c4d0d472324a/init-textfile/0.log" May 29 03:22:21.524154 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.524091 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-89vx4/must-gather-c5rhs" podStartSLOduration=8.687648724 podStartE2EDuration="9.524072391s" podCreationTimestamp="2026-05-29 03:22:12 +0000 UTC" firstStartedPulling="2026-05-29 03:22:13.011579315 +0000 UTC m=+1818.848352468" lastFinishedPulling="2026-05-29 03:22:13.848002982 +0000 UTC m=+1819.684776135" observedRunningTime="2026-05-29 03:22:14.47445898 +0000 UTC m=+1820.311232159" watchObservedRunningTime="2026-05-29 03:22:21.524072391 +0000 UTC m=+1827.360845566" May 29 03:22:21.524640 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.524423 2574 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r"] May 29 03:22:21.530885 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.530856 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.539321 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.539283 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r"] May 29 03:22:21.654117 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.654031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrjwr\" (UniqueName: \"kubernetes.io/projected/36cb03e5-d100-42fa-94c7-d48f0e342fef-kube-api-access-hrjwr\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.654293 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.654158 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-podres\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.654293 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.654241 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-sys\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.654293 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.654264 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-lib-modules\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.654293 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.654292 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-proc\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.755377 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.755345 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-proc\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.755534 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.755419 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hrjwr\" (UniqueName: \"kubernetes.io/projected/36cb03e5-d100-42fa-94c7-d48f0e342fef-kube-api-access-hrjwr\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.755534 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.755458 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-podres\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.755534 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.755468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-proc\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.755534 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.755487 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-sys\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.755534 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.755510 2574 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-lib-modules\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.755736 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.755572 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-sys\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.755736 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.755609 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-lib-modules\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.755736 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.755617 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/36cb03e5-d100-42fa-94c7-d48f0e342fef-podres\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.764536 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.764488 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrjwr\" (UniqueName: \"kubernetes.io/projected/36cb03e5-d100-42fa-94c7-d48f0e342fef-kube-api-access-hrjwr\") pod \"perf-node-gather-daemonset-jff9r\" (UID: \"36cb03e5-d100-42fa-94c7-d48f0e342fef\") " pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.842575 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.842543 2574 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:21.974576 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:21.974545 2574 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r"] May 29 03:22:21.978203 ip-10-0-138-99 kubenswrapper[2574]: W0529 03:22:21.978174 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod36cb03e5_d100_42fa_94c7_d48f0e342fef.slice/crio-37c386123733ddeddadd19ffd5ab37f87a0b7407a9135966fc8c4a5a30089aaa WatchSource:0}: Error finding container 37c386123733ddeddadd19ffd5ab37f87a0b7407a9135966fc8c4a5a30089aaa: Status 404 returned error can't find the container with id 37c386123733ddeddadd19ffd5ab37f87a0b7407a9135966fc8c4a5a30089aaa May 29 03:22:22.483803 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:22.482861 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" event={"ID":"36cb03e5-d100-42fa-94c7-d48f0e342fef","Type":"ContainerStarted","Data":"775d87023152f026b93a335217a21c26f19c6cb13e9d66fc7dbace6c096b1897"} May 29 03:22:22.483803 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:22.482909 2574 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" event={"ID":"36cb03e5-d100-42fa-94c7-d48f0e342fef","Type":"ContainerStarted","Data":"37c386123733ddeddadd19ffd5ab37f87a0b7407a9135966fc8c4a5a30089aaa"} May 29 03:22:22.483803 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:22.483655 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:22.501240 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:22.500903 2574 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" podStartSLOduration=1.5008857 podStartE2EDuration="1.5008857s" podCreationTimestamp="2026-05-29 03:22:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 03:22:22.499403107 +0000 UTC m=+1828.336176304" watchObservedRunningTime="2026-05-29 03:22:22.5008857 +0000 UTC m=+1828.337658878" May 29 03:22:22.849933 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:22.849883 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qx45f_c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18/dns/0.log" May 29 03:22:22.872518 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:22.872494 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qx45f_c5e3ecfa-ffb7-4dcd-a75d-8e009e125d18/kube-rbac-proxy/0.log" May 29 03:22:22.896113 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:22.896086 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-cjqvf_85de5aa3-4f9f-4ebf-b110-c7651ef3933b/dns-node-resolver/0.log" May 29 03:22:23.396606 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:23.396577 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d6f8c_d5aeb5e0-0955-4e6f-9b7c-9632860d4206/node-ca/0.log" May 29 03:22:24.472927 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:24.472898 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-q8zzr_ff0a0239-5a87-4894-b455-5f3e6f51f2d9/serve-healthcheck-canary/0.log" May 29 03:22:24.892745 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:24.892714 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jlzfg_62e283a9-156c-40d1-a01a-c09032747465/kube-rbac-proxy/0.log" May 29 03:22:24.915698 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:24.915670 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jlzfg_62e283a9-156c-40d1-a01a-c09032747465/exporter/0.log" May 29 03:22:24.940922 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:24.940895 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jlzfg_62e283a9-156c-40d1-a01a-c09032747465/extractor/0.log" May 29 03:22:29.500272 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:29.500240 2574 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-89vx4/perf-node-gather-daemonset-jff9r" May 29 03:22:30.475862 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:30.475831 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzz2d_3bcff68d-54ed-4182-9675-e8ddfe09ca39/kube-multus-additional-cni-plugins/0.log" May 29 03:22:30.499376 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:30.499351 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzz2d_3bcff68d-54ed-4182-9675-e8ddfe09ca39/egress-router-binary-copy/0.log" May 29 03:22:30.523296 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:30.523274 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzz2d_3bcff68d-54ed-4182-9675-e8ddfe09ca39/cni-plugins/0.log" May 29 03:22:30.553190 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:30.553161 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzz2d_3bcff68d-54ed-4182-9675-e8ddfe09ca39/bond-cni-plugin/0.log" May 29 03:22:30.578300 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:30.578271 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzz2d_3bcff68d-54ed-4182-9675-e8ddfe09ca39/routeoverride-cni/0.log" May 29 03:22:30.605903 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:30.605831 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzz2d_3bcff68d-54ed-4182-9675-e8ddfe09ca39/whereabouts-cni-bincopy/0.log" May 29 03:22:30.629262 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:30.629236 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bzz2d_3bcff68d-54ed-4182-9675-e8ddfe09ca39/whereabouts-cni/0.log" May 29 03:22:30.833611 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:30.833578 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dhp4j_2c191edb-0947-447b-ace1-bd44282da4f7/kube-multus/0.log" May 29 03:22:30.936485 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:30.936429 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lrnzd_188be971-e394-40d2-839e-47486bbfbe82/network-metrics-daemon/0.log" May 29 03:22:30.960450 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:30.960417 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lrnzd_188be971-e394-40d2-839e-47486bbfbe82/kube-rbac-proxy/0.log" May 29 03:22:31.829664 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:31.829618 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4shwz_a74ab30e-b6a3-4f89-83b3-5819e6dc8959/ovn-controller/0.log" May 29 03:22:31.867353 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:31.867322 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4shwz_a74ab30e-b6a3-4f89-83b3-5819e6dc8959/ovn-acl-logging/0.log" May 29 03:22:31.891686 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:31.891657 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4shwz_a74ab30e-b6a3-4f89-83b3-5819e6dc8959/kube-rbac-proxy-node/0.log" May 29 03:22:31.915250 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:31.915216 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4shwz_a74ab30e-b6a3-4f89-83b3-5819e6dc8959/kube-rbac-proxy-ovn-metrics/0.log" May 29 03:22:31.935767 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:31.935735 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4shwz_a74ab30e-b6a3-4f89-83b3-5819e6dc8959/northd/0.log" May 29 03:22:31.962556 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:31.962525 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4shwz_a74ab30e-b6a3-4f89-83b3-5819e6dc8959/nbdb/0.log" May 29 03:22:31.987682 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:31.987658 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4shwz_a74ab30e-b6a3-4f89-83b3-5819e6dc8959/sbdb/0.log" May 29 03:22:32.148691 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:32.148654 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-4shwz_a74ab30e-b6a3-4f89-83b3-5819e6dc8959/ovnkube-controller/0.log" May 29 03:22:33.820725 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:33.820695 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-q8qcm_6392ae45-f3e7-4317-af82-9fd80efe6cf2/check-endpoints/0.log" May 29 03:22:33.867557 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:33.867531 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-gjk6c_50124396-13ed-40a4-846c-81ec95b11af1/network-check-target-container/0.log" May 29 03:22:34.772456 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:34.772430 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-hxfl8_a789f680-4be3-41a1-bc7e-3aee7deab1a7/iptables-alerter/0.log" May 29 03:22:35.461897 ip-10-0-138-99 kubenswrapper[2574]: I0529 03:22:35.461853 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-kc9kt_c4fa84ee-7679-49fe-a16b-fe58fe6f2be7/tuned/0.log"