Jun 06 22:00:20.852464 ip-10-0-141-122 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 06 22:00:20.852477 ip-10-0-141-122 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 06 22:00:20.852485 ip-10-0-141-122 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 06 22:00:20.852751 ip-10-0-141-122 systemd[1]: Failed to start Kubernetes Kubelet. Jun 06 22:00:30.308198 ip-10-0-141-122 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 06 22:00:30.308215 ip-10-0-141-122 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 0aba7c675ddd4e58aaa964acc2123bc5 -- Jun 06 22:02:52.689394 ip-10-0-141-122 systemd[1]: Starting Kubernetes Kubelet... Jun 06 22:02:53.047552 ip-10-0-141-122 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 22:02:53.047552 ip-10-0-141-122 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 06 22:02:53.047552 ip-10-0-141-122 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 22:02:53.047552 ip-10-0-141-122 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 06 22:02:53.047552 ip-10-0-141-122 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 06 22:02:53.048226 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.047549 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 06 22:02:53.052868 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052850 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 22:02:53.052868 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052867 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052873 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052877 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052882 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052885 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052888 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052891 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052894 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052897 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052900 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052903 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052905 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052908 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052910 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052913 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052916 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052918 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052921 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052923 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052927 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 22:02:53.052941 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052930 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052933 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052935 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052938 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052940 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052943 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052945 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052948 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052951 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052954 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052957 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052959 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052962 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052964 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052967 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052969 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052972 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052974 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052976 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 22:02:53.053454 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052979 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052981 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052984 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052987 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052990 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052992 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.052997 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053000 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053003 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053006 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053009 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053012 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053015 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053019 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053022 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053025 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053028 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053033 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053036 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 22:02:53.053924 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053039 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053042 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053045 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053048 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053051 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053053 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053056 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053059 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053061 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053079 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053082 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053084 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053087 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053090 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053092 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053095 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053097 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053100 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053103 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053105 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 22:02:53.054441 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053108 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053110 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053113 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053115 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053118 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053120 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053124 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053127 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053130 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053133 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053136 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053138 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053141 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053144 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053147 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053149 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053151 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053154 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053156 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053159 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 22:02:53.054928 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053894 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053900 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053903 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053906 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053909 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053912 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053914 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053917 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053919 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053922 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053926 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053929 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053931 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053934 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053936 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053939 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053942 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053945 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053948 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 22:02:53.055506 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053951 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053954 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053957 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053959 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053962 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053965 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053967 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053970 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053972 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053975 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053979 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053983 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053986 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053989 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053991 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053994 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.053997 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054001 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054005 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 22:02:53.055981 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054007 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054011 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054013 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054016 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054020 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054023 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054026 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054029 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054031 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054034 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054037 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054040 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054042 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054045 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054049 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054055 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054057 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054060 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054062 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054080 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 22:02:53.056467 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054082 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054085 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054088 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054090 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054093 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054096 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054098 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054101 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054103 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054106 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054108 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054111 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054114 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054116 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054119 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054121 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054124 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054127 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054130 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054132 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 22:02:53.056953 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054135 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054137 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054140 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054143 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054145 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054148 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054151 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054153 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054157 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054159 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054162 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054165 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054167 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054170 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054172 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054175 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054177 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054179 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054182 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054185 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 22:02:53.057469 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054187 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054558 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054563 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054565 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054568 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054570 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054573 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054578 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054582 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054585 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054588 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054590 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054593 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054596 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054602 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054605 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054608 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054610 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054613 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 22:02:53.057968 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054615 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054619 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054621 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054624 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054627 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054630 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054633 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054635 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054638 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054640 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054643 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054645 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054649 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054652 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054654 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054657 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054659 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054662 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054665 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 22:02:53.058458 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054669 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054672 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054675 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054678 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054681 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054683 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054686 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054689 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054693 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054696 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054698 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054701 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054704 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054706 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054709 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054712 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054714 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054717 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054719 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054722 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 22:02:53.058930 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054725 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054727 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054730 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054732 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054736 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054738 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054746 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054749 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054751 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054754 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054757 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054759 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054762 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054765 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054767 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054770 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054772 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054775 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054777 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054780 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 22:02:53.059448 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054783 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054786 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054788 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054791 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054793 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054796 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054799 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054801 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054804 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054807 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054809 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054812 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054815 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054817 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054820 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054822 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054825 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054827 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054831 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054834 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 22:02:53.059932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054836 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.054839 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054909 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054916 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054923 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054928 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054932 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054936 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054940 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054945 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054948 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054951 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054955 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054958 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054961 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054964 2574 flags.go:64] FLAG: --cgroup-root="" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054967 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054970 2574 flags.go:64] FLAG: --client-ca-file="" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054974 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054977 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054981 2574 flags.go:64] FLAG: --cluster-domain="" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054984 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054988 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054991 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 06 22:02:53.060437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054994 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.054998 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055001 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055004 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055007 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055010 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055015 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055018 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055021 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055024 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055028 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055031 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055033 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055037 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055040 2574 flags.go:64] FLAG: --enable-server="true" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055043 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055047 2574 flags.go:64] FLAG: --event-burst="100" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055050 2574 flags.go:64] FLAG: --event-qps="50" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055053 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055056 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055059 2574 flags.go:64] FLAG: --eviction-hard="" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055077 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055080 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055083 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055086 2574 flags.go:64] FLAG: --eviction-soft="" Jun 06 22:02:53.061029 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055089 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055092 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055095 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055098 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055101 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055104 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055107 2574 flags.go:64] FLAG: --feature-gates="" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055111 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055114 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055117 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055120 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055123 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055126 2574 flags.go:64] FLAG: --help="false" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055131 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055134 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055137 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055140 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055143 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055146 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055149 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055152 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055155 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055159 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 06 22:02:53.061649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055161 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055164 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055167 2574 flags.go:64] FLAG: --kube-reserved="" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055170 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055173 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055176 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055179 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055182 2574 flags.go:64] FLAG: --lock-file="" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055185 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055188 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055191 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055196 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055199 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055202 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055206 2574 flags.go:64] FLAG: --logging-format="text" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055209 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055212 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055215 2574 flags.go:64] FLAG: --manifest-url="" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055218 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055222 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055225 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055230 2574 flags.go:64] FLAG: --max-pods="110" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055234 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055237 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055240 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 06 22:02:53.062747 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055243 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055246 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055249 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055252 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055260 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055263 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055266 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055270 2574 flags.go:64] FLAG: --pod-cidr="" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055273 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055283 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055286 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055289 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055292 2574 flags.go:64] FLAG: --port="10250" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055295 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055298 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07aafe7f05f10ce81" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055301 2574 flags.go:64] FLAG: --qos-reserved="" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055304 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055307 2574 flags.go:64] FLAG: --register-node="true" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055310 2574 flags.go:64] FLAG: --register-with-taints="" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055318 2574 flags.go:64] FLAG: --registry-burst="10" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055320 2574 flags.go:64] FLAG: --registry-qps="5" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055323 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055326 2574 flags.go:64] FLAG: --reserved-memory="" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055330 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055333 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 06 22:02:53.063821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055336 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055339 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055342 2574 flags.go:64] FLAG: --runonce="false" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055344 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055349 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055352 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055354 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055357 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055360 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055363 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055366 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055369 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055372 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055374 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055378 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055381 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055383 2574 flags.go:64] FLAG: --system-cgroups="" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055388 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055393 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055396 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055399 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055403 2574 flags.go:64] FLAG: --tls-min-version="" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055405 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055408 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055411 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 06 22:02:53.064515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055414 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055417 2574 flags.go:64] FLAG: --v="2" Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055421 2574 flags.go:64] FLAG: --version="false" Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055425 2574 flags.go:64] FLAG: --vmodule="" Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055429 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.055432 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055542 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055546 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055549 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055552 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055555 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055560 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055562 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055566 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055569 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055571 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055574 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055577 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055580 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055582 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055585 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 22:02:53.065210 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055587 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055590 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055593 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055598 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055600 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055603 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055606 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055608 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055611 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055614 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055616 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055619 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055622 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055625 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055628 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055630 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055633 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055635 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055638 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055641 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 22:02:53.065736 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055643 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055646 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055650 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055653 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055655 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055658 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055661 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055663 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055666 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055668 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055670 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055673 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055675 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055678 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055680 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055685 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055687 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055690 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055694 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055698 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 22:02:53.066248 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055701 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055704 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055706 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055709 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055712 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055715 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055718 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055721 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055724 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055727 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055731 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055735 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055738 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055741 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055746 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055748 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055751 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055754 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055757 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 22:02:53.066745 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055759 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055763 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055766 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055770 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055772 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055775 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055777 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055779 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055783 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055786 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055789 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055792 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055794 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055797 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055799 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055802 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055804 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055807 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055809 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055812 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 22:02:53.067233 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055815 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055817 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055820 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055822 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.055825 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.056427 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.064639 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.064654 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.065173 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.065181 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065254 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065260 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065263 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065267 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065270 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 22:02:53.067724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065272 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065275 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065278 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065280 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065283 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065286 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065289 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065291 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065294 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065297 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065300 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065303 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065306 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065309 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065311 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065314 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065317 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065319 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065322 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065325 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 22:02:53.068117 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065328 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065331 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065333 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065338 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065342 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065345 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065348 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065351 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065354 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065357 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065359 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065362 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065365 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065367 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065370 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065372 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065375 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065378 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065380 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065383 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 22:02:53.068654 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065385 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065394 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065397 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065400 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065402 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065405 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065408 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065411 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065413 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065416 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065419 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065422 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065426 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065430 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065432 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065435 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065438 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065441 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065443 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 22:02:53.069165 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065446 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065448 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065451 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065454 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065456 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065459 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065461 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065464 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065466 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065469 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065471 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065474 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065477 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065479 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065482 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065486 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065488 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065491 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065493 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065496 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 22:02:53.069773 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065498 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065501 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065510 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065514 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065518 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065522 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065525 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065528 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065531 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065534 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065537 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065540 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065542 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065545 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 22:02:53.070395 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065548 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.065553 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065668 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065673 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065676 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065679 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065682 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065684 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065687 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065690 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065692 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065695 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065698 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065700 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065703 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 06 22:02:53.070792 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065706 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065709 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065712 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065715 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065717 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065720 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065722 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065725 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065728 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065730 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065733 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065736 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065739 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065742 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065744 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065747 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065750 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065753 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065755 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065758 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 06 22:02:53.071322 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065760 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065763 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065765 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065768 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065770 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065773 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065775 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065778 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065780 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065783 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065785 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065788 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065790 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065793 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065796 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065799 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065801 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065804 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065807 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065809 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 06 22:02:53.072159 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065812 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065814 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065817 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065819 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065822 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065825 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065827 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065831 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065833 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065836 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065839 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065841 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065845 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065848 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065851 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065854 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065857 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065859 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065862 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 06 22:02:53.072724 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065865 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065868 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065870 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065873 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065875 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065878 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065881 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065884 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065886 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065889 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065892 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065895 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065897 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065900 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065902 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065905 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065908 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065910 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065914 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 06 22:02:53.073412 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065918 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065921 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065924 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065927 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065929 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065932 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065935 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:53.065937 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.065942 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.066043 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.067956 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.069193 2574 server.go:1019] "Starting client certificate rotation" Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.069309 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.069408 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 06 22:02:53.074281 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.071578 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 22:02:53.074654 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.072819 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 06 22:02:53.086306 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.086280 2574 log.go:25] "Validated CRI v1 runtime API" Jun 06 22:02:53.088686 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.088669 2574 log.go:25] "Validated CRI v1 image API" Jun 06 22:02:53.090642 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.090622 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 06 22:02:53.093012 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.092993 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 cbdd22b9-b912-4112-ae5f-542aae283826:/dev/nvme0n1p3 f33ccc4e-839b-4749-ba91-5152f3542e33:/dev/nvme0n1p4] Jun 06 22:02:53.093060 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.093015 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 06 22:02:53.098452 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.098338 2574 manager.go:216] Machine: {Timestamp:2026-06-06 22:02:53.096949714 +0000 UTC m=+0.299176421 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099786 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec204da422c2c3c086f154aba601937f SystemUUID:ec204da4-22c2-c3c0-86f1-54aba601937f BootID:0aba7c67-5ddd-4e58-aaa9-64acc2123bc5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:03:eb:fb:69 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:03:eb:fb:69 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:56:8c:3a:38:2e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 06 22:02:53.098452 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.098450 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 06 22:02:53.098575 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.098532 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 06 22:02:53.099921 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.099888 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 22:02:53.101135 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.100910 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 06 22:02:53.101276 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.101141 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-122.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 06 22:02:53.102435 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.102423 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 06 22:02:53.102479 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.102438 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 06 22:02:53.102479 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.102447 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 22:02:53.103675 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.103665 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 06 22:02:53.104457 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.104448 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 06 22:02:53.107257 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.107245 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 06 22:02:53.107572 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.107561 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 06 22:02:53.107611 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.107596 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 06 22:02:53.107611 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.107606 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 06 22:02:53.107672 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.107622 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 06 22:02:53.107672 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.107632 2574 kubelet.go:398] "Adding apiserver pod source" Jun 06 22:02:53.107672 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.107641 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 06 22:02:53.108668 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.108651 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 22:02:53.108751 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.108676 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 06 22:02:53.110751 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.110735 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 06 22:02:53.112102 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.112088 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 06 22:02:53.112154 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.112118 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 06 22:02:53.113588 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113575 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 06 22:02:53.113635 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113592 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 06 22:02:53.113635 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113598 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 06 22:02:53.113635 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113603 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 06 22:02:53.113635 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113612 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 06 22:02:53.113635 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113618 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 06 22:02:53.113816 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113807 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 06 22:02:53.113816 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113816 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 06 22:02:53.113903 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113823 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 06 22:02:53.113903 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113830 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 06 22:02:53.113903 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113838 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 06 22:02:53.113903 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.113847 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 06 22:02:53.115120 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.115106 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 06 22:02:53.115120 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.115116 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 06 22:02:53.117194 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.117166 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-122.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 06 22:02:53.117885 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.117866 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-122.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 06 22:02:53.117938 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.117868 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 06 22:02:53.118640 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.118627 2574 server.go:1268] "Started kubelet" Jun 06 22:02:53.118758 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.118725 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 06 22:02:53.118758 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.118714 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 06 22:02:53.118908 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.118792 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 06 22:02:53.119715 ip-10-0-141-122 systemd[1]: Started Kubernetes Kubelet. Jun 06 22:02:53.120413 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.120396 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 06 22:02:53.120776 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.120725 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 06 22:02:53.125848 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.125813 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 06 22:02:53.127560 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.127539 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 06 22:02:53.127671 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.127544 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 06 22:02:53.127720 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.127695 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:53.128681 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.128535 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 06 22:02:53.128681 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.128553 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 06 22:02:53.128681 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.128583 2574 factory.go:55] Registering systemd factory Jun 06 22:02:53.128681 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.128600 2574 factory.go:223] Registration of the systemd container factory successfully Jun 06 22:02:53.128871 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.128722 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 06 22:02:53.128871 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.128732 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 06 22:02:53.129185 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.127193 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-122.ec2.internal.18b69d0af8a7ec3e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-122.ec2.internal,UID:ip-10-0-141-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-122.ec2.internal,},FirstTimestamp:2026-06-06 22:02:53.118598206 +0000 UTC m=+0.320824917,LastTimestamp:2026-06-06 22:02:53.118598206 +0000 UTC m=+0.320824917,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-122.ec2.internal,}" Jun 06 22:02:53.129302 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.129230 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 06 22:02:53.129528 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.129513 2574 factory.go:153] Registering CRI-O factory Jun 06 22:02:53.129579 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.129531 2574 factory.go:223] Registration of the crio container factory successfully Jun 06 22:02:53.129625 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.129606 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 06 22:02:53.129660 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.129638 2574 factory.go:103] Registering Raw factory Jun 06 22:02:53.129660 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.129656 2574 manager.go:1196] Started watching for new ooms in manager Jun 06 22:02:53.130461 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.130442 2574 manager.go:349] Starting recovery of all containers Jun 06 22:02:53.131359 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.131334 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-122.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 06 22:02:53.131435 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.131354 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 06 22:02:53.143114 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.142952 2574 manager.go:354] Recovery completed Jun 06 22:02:53.145137 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.145116 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cgpzp" Jun 06 22:02:53.147637 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.147623 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 22:02:53.149680 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.149655 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientMemory" Jun 06 22:02:53.149757 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.149692 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 22:02:53.149757 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.149706 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientPID" Jun 06 22:02:53.150260 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.150246 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 06 22:02:53.150260 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.150257 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 22:02:53.150362 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.150258 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 06 22:02:53.150362 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.150310 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 06 22:02:53.150609 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.150592 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cgpzp" Jun 06 22:02:53.151150 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.151117 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientMemory" Jun 06 22:02:53.151220 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.151163 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 22:02:53.151220 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.151180 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientPID" Jun 06 22:02:53.151408 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.151395 2574 policy_none.go:49] "None policy: Start" Jun 06 22:02:53.151442 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.151412 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 06 22:02:53.151442 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.151422 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 06 22:02:53.151899 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.151811 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-122.ec2.internal.18b69d0afa820f2e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-122.ec2.internal,UID:ip-10-0-141-122.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-122.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-122.ec2.internal,},FirstTimestamp:2026-06-06 22:02:53.149671214 +0000 UTC m=+0.351897925,LastTimestamp:2026-06-06 22:02:53.149671214 +0000 UTC m=+0.351897925,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-122.ec2.internal,}" Jun 06 22:02:53.152858 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.152847 2574 policy_none.go:47] "Start" Jun 06 22:02:53.197724 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.197707 2574 manager.go:337] "Starting Device Plugin manager" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.197752 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.197762 2574 server.go:87] "Starting device plugin registration server" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.198103 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.198115 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.198193 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.198280 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.198288 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.198902 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.198965 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.200453 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.201615 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.201654 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.201708 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 06 22:02:53.202404 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.201748 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 06 22:02:53.204216 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.204191 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 22:02:53.298745 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.298643 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 22:02:53.300256 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.300237 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientMemory" Jun 06 22:02:53.300341 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.300272 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 22:02:53.300341 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.300285 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientPID" Jun 06 22:02:53.300341 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.300308 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.302533 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.302512 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-122.ec2.internal"] Jun 06 22:02:53.302607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.302589 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 22:02:53.303950 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.303934 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientMemory" Jun 06 22:02:53.304017 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.303960 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 22:02:53.304017 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.303969 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientPID" Jun 06 22:02:53.305119 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.305107 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 22:02:53.305233 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.305214 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.305268 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.305244 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 22:02:53.307648 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.307636 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientMemory" Jun 06 22:02:53.307696 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.307660 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 22:02:53.307696 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.307670 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientPID" Jun 06 22:02:53.307758 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.307635 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientMemory" Jun 06 22:02:53.307758 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.307734 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 22:02:53.307758 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.307744 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientPID" Jun 06 22:02:53.308774 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.308760 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.308827 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.308785 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 06 22:02:53.309602 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.309582 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientMemory" Jun 06 22:02:53.309694 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.309614 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasNoDiskPressure" Jun 06 22:02:53.309694 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.309625 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeHasSufficientPID" Jun 06 22:02:53.310676 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.310662 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.310750 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.310686 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-122.ec2.internal\": node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:53.329720 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.329699 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-122.ec2.internal\" not found" node="ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.331584 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.331568 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:53.335856 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.335842 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-122.ec2.internal\" not found" node="ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.430328 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.430294 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1316253b60e3f4aae52aa3f3fa4a3e33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal\" (UID: \"1316253b60e3f4aae52aa3f3fa4a3e33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.430451 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.430334 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a87311d29ccf74442080aeb2ab4f1c4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-122.ec2.internal\" (UID: \"0a87311d29ccf74442080aeb2ab4f1c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.430451 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.430358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1316253b60e3f4aae52aa3f3fa4a3e33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal\" (UID: \"1316253b60e3f4aae52aa3f3fa4a3e33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.432404 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.432385 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:53.530831 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.530803 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1316253b60e3f4aae52aa3f3fa4a3e33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal\" (UID: \"1316253b60e3f4aae52aa3f3fa4a3e33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.530911 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.530833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1316253b60e3f4aae52aa3f3fa4a3e33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal\" (UID: \"1316253b60e3f4aae52aa3f3fa4a3e33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.530911 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.530851 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a87311d29ccf74442080aeb2ab4f1c4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-122.ec2.internal\" (UID: \"0a87311d29ccf74442080aeb2ab4f1c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.530911 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.530888 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1316253b60e3f4aae52aa3f3fa4a3e33-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal\" (UID: \"1316253b60e3f4aae52aa3f3fa4a3e33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.531017 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.530913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1316253b60e3f4aae52aa3f3fa4a3e33-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal\" (UID: \"1316253b60e3f4aae52aa3f3fa4a3e33\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.531017 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.530963 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/0a87311d29ccf74442080aeb2ab4f1c4-config\") pod \"kube-apiserver-proxy-ip-10-0-141-122.ec2.internal\" (UID: \"0a87311d29ccf74442080aeb2ab4f1c4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.532918 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.532901 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:53.633762 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.633691 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:53.633762 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.633715 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.640109 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:53.640089 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-122.ec2.internal" Jun 06 22:02:53.734234 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.734191 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:53.834789 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.834751 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:53.935444 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:53.935373 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:54.035967 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:54.035936 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:54.069147 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.069118 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 06 22:02:54.069661 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.069290 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 06 22:02:54.099488 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.099461 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 22:02:54.136414 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:54.136391 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:54.153579 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.153534 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-05 21:57:53 +0000 UTC" deadline="2028-01-16 03:43:36.723288459 +0000 UTC" Jun 06 22:02:54.153579 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.153575 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14117h40m42.569716756s" Jun 06 22:02:54.237539 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:54.237462 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-122.ec2.internal\" not found" Jun 06 22:02:54.241889 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.240577 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 22:02:54.266509 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:54.266473 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a87311d29ccf74442080aeb2ab4f1c4.slice/crio-0863caf9b3c6042c107755fb2aaa3c8369d6343ae8532cbabe2c0b924d899035 WatchSource:0}: Error finding container 0863caf9b3c6042c107755fb2aaa3c8369d6343ae8532cbabe2c0b924d899035: Status 404 returned error can't find the container with id 0863caf9b3c6042c107755fb2aaa3c8369d6343ae8532cbabe2c0b924d899035 Jun 06 22:02:54.266703 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:54.266688 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1316253b60e3f4aae52aa3f3fa4a3e33.slice/crio-10b5ac60b44662e142f7f7e7289ebc9b3c11f94a7a5b0e86564798978d6f4d1f WatchSource:0}: Error finding container 10b5ac60b44662e142f7f7e7289ebc9b3c11f94a7a5b0e86564798978d6f4d1f: Status 404 returned error can't find the container with id 10b5ac60b44662e142f7f7e7289ebc9b3c11f94a7a5b0e86564798978d6f4d1f Jun 06 22:02:54.270636 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.270619 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 22:02:54.327953 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.327916 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" Jun 06 22:02:54.340012 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.339992 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 22:02:54.343174 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.343161 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-122.ec2.internal" Jun 06 22:02:54.351655 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.351638 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 06 22:02:54.707274 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:54.707191 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 22:02:55.088306 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.088224 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 06 22:02:55.109625 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.109589 2574 apiserver.go:52] "Watching apiserver" Jun 06 22:02:55.114906 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.114876 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 06 22:02:55.116271 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.116246 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-pmp7g","openshift-multus/multus-additional-cni-plugins-q9fww","openshift-multus/multus-w64sb","openshift-multus/network-metrics-daemon-hr9ch","kube-system/konnectivity-agent-lpzdk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z","openshift-dns/node-resolver-x87wj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal","openshift-network-diagnostics/network-check-target-7k8nh","openshift-network-operator/iptables-alerter-rmrkv","openshift-ovn-kubernetes/ovnkube-node-d7rct","kube-system/global-pull-secret-syncer-44sh9","kube-system/kube-apiserver-proxy-ip-10-0-141-122.ec2.internal","openshift-cluster-node-tuning-operator/tuned-lj46z"] Jun 06 22:02:55.118741 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.118723 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x87wj" Jun 06 22:02:55.120533 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.120513 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 06 22:02:55.120623 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.120595 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 06 22:02:55.120680 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.120650 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.120731 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.120697 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-txkvz\"" Jun 06 22:02:55.122018 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.121995 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 06 22:02:55.122355 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.122338 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 06 22:02:55.122808 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.122560 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 06 22:02:55.122808 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.122580 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 06 22:02:55.122808 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.122611 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 06 22:02:55.122808 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.122614 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 06 22:02:55.122808 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.122711 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fqxbh\"" Jun 06 22:02:55.123333 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.123316 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.124657 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.124638 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 06 22:02:55.124876 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.124848 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 06 22:02:55.124951 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.124935 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xb4wr\"" Jun 06 22:02:55.125208 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.125186 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 06 22:02:55.125325 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.125206 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 06 22:02:55.125665 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.125569 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:02:55.125665 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.125656 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:02:55.127873 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.127856 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:02:55.128565 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.128135 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 06 22:02:55.130625 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.130151 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dp5xn\"" Jun 06 22:02:55.130625 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.130276 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 06 22:02:55.130625 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.130360 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 06 22:02:55.130869 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.130705 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.133240 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.132648 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 06 22:02:55.133240 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.132932 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 06 22:02:55.133240 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.132953 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 06 22:02:55.133781 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.133359 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5nr5x\"" Jun 06 22:02:55.133781 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.133639 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:02:55.133781 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.133739 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:02:55.136190 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.136172 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.138383 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.138352 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 06 22:02:55.138478 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.138388 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 06 22:02:55.138630 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.138613 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xk8f8\"" Jun 06 22:02:55.138693 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.138620 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.140301 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140265 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 06 22:02:55.140301 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140292 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 06 22:02:55.140448 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140292 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-s9wd7\"" Jun 06 22:02:55.140634 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140616 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6060cc52-d6aa-4840-a8ea-bf2cc720751c-cni-binary-copy\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.140742 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-var-lib-cni-multus\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.140742 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-var-lib-kubelet\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.140742 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140680 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r79ff\" (UniqueName: \"kubernetes.io/projected/6060cc52-d6aa-4840-a8ea-bf2cc720751c-kube-api-access-r79ff\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.140854 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140760 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-registration-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.140854 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140800 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfzsk\" (UniqueName: \"kubernetes.io/projected/1516a48e-3746-4869-b2c4-4df9eb7c34f4-kube-api-access-rfzsk\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.140854 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-run-ovn\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.140945 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140851 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-cnibin\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.140945 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-var-lib-cni-bin\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.140945 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-log-socket\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141086 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140943 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-socket-dir-parent\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.141086 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140966 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-run-multus-certs\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.141086 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.140989 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmgxm\" (UniqueName: \"kubernetes.io/projected/1bb2a002-a9ac-4494-b7b1-57d94a96711b-kube-api-access-lmgxm\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:02:55.141086 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141029 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d7697b0-6e56-40c9-ae24-47f612e0a2b0-konnectivity-ca\") pod \"konnectivity-agent-lpzdk\" (UID: \"4d7697b0-6e56-40c9-ae24-47f612e0a2b0\") " pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:02:55.141086 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141054 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-etc-openvswitch\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141339 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141093 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-879cd\" (UniqueName: \"kubernetes.io/projected/511a926e-4880-4520-be94-6bb456910f1a-kube-api-access-879cd\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141339 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141118 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-hostroot\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.141339 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141149 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-daemon-config\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.141339 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141185 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d7697b0-6e56-40c9-ae24-47f612e0a2b0-agent-certs\") pod \"konnectivity-agent-lpzdk\" (UID: \"4d7697b0-6e56-40c9-ae24-47f612e0a2b0\") " pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:02:55.141339 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141213 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-sys-fs\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.141339 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141246 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12f3564-b124-43da-a185-597650b9b6f7-tmp-dir\") pod \"node-resolver-x87wj\" (UID: \"b12f3564-b124-43da-a185-597650b9b6f7\") " pod="openshift-dns/node-resolver-x87wj" Jun 06 22:02:55.141339 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141262 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rmrkv" Jun 06 22:02:55.141339 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141273 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-kubelet\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141339 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141293 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-slash\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141339 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141315 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-run-openvswitch\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141339 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/511a926e-4880-4520-be94-6bb456910f1a-env-overrides\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141359 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-run-netns\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141407 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-run-netns\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141428 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/511a926e-4880-4520-be94-6bb456910f1a-ovnkube-config\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-system-cni-dir\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141470 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-cni-dir\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141495 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-run-k8s-cni-cncf-io\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141533 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-etc-kubernetes\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141556 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-socket-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141612 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-device-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141680 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-systemd-units\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141721 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-run-systemd\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141745 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-node-log\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141800 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-cni-bin\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.141904 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141821 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-cni-netd\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.142440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141845 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/511a926e-4880-4520-be94-6bb456910f1a-ovn-node-metrics-cert\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.142440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141866 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b12f3564-b124-43da-a185-597650b9b6f7-hosts-file\") pod \"node-resolver-x87wj\" (UID: \"b12f3564-b124-43da-a185-597650b9b6f7\") " pod="openshift-dns/node-resolver-x87wj" Jun 06 22:02:55.142440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141889 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4xhq\" (UniqueName: \"kubernetes.io/projected/b12f3564-b124-43da-a185-597650b9b6f7-kube-api-access-k4xhq\") pod \"node-resolver-x87wj\" (UID: \"b12f3564-b124-43da-a185-597650b9b6f7\") " pod="openshift-dns/node-resolver-x87wj" Jun 06 22:02:55.142440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141917 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-var-lib-openvswitch\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.142440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141940 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/511a926e-4880-4520-be94-6bb456910f1a-ovnkube-script-lib\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.142440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141964 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-os-release\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.142440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141986 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-conf-dir\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.142440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.141982 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 06 22:02:55.142440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.142010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.142440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.142048 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.142440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.142108 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.142940 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.142920 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 06 22:02:55.143021 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.142978 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jmsq8\"" Jun 06 22:02:55.143102 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.143086 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 06 22:02:55.143238 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.143224 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 06 22:02:55.144182 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.144163 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pmp7g" Jun 06 22:02:55.145643 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.145622 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 06 22:02:55.145784 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.145655 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 06 22:02:55.145784 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.145745 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 06 22:02:55.146516 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.146424 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xcg98\"" Jun 06 22:02:55.146628 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.146607 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:55.146696 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.146671 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:02:55.161241 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.161222 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gllkl" Jun 06 22:02:55.168435 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.168418 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gllkl" Jun 06 22:02:55.207275 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.207216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" event={"ID":"1316253b60e3f4aae52aa3f3fa4a3e33","Type":"ContainerStarted","Data":"10b5ac60b44662e142f7f7e7289ebc9b3c11f94a7a5b0e86564798978d6f4d1f"} Jun 06 22:02:55.208503 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.208479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-122.ec2.internal" event={"ID":"0a87311d29ccf74442080aeb2ab4f1c4","Type":"ContainerStarted","Data":"0863caf9b3c6042c107755fb2aaa3c8369d6343ae8532cbabe2c0b924d899035"} Jun 06 22:02:55.230881 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.230852 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 06 22:02:55.242490 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242466 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-var-lib-kubelet\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.242638 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242505 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-log-socket\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.242638 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242538 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-socket-dir-parent\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.242638 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-run-multus-certs\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.242638 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242588 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-log-socket\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.242843 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242640 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmgxm\" (UniqueName: \"kubernetes.io/projected/1bb2a002-a9ac-4494-b7b1-57d94a96711b-kube-api-access-lmgxm\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:02:55.242843 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242679 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-socket-dir-parent\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.242843 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242720 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d7697b0-6e56-40c9-ae24-47f612e0a2b0-konnectivity-ca\") pod \"konnectivity-agent-lpzdk\" (UID: \"4d7697b0-6e56-40c9-ae24-47f612e0a2b0\") " pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:02:55.242843 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242774 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-cnibin\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.242843 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242802 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-run-multus-certs\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.242843 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-os-release\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.242843 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242839 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk4g6\" (UniqueName: \"kubernetes.io/projected/b18ed7df-bfef-43ca-af32-7693909a4d7f-kube-api-access-gk4g6\") pod \"node-ca-pmp7g\" (UID: \"b18ed7df-bfef-43ca-af32-7693909a4d7f\") " pod="openshift-image-registry/node-ca-pmp7g" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242867 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-daemon-config\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242954 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d7697b0-6e56-40c9-ae24-47f612e0a2b0-agent-certs\") pod \"konnectivity-agent-lpzdk\" (UID: \"4d7697b0-6e56-40c9-ae24-47f612e0a2b0\") " pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.242982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkwz2\" (UniqueName: \"kubernetes.io/projected/045a17d2-a35c-4d79-a9b5-93ab54128d08-kube-api-access-qkwz2\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b18ed7df-bfef-43ca-af32-7693909a4d7f-serviceca\") pod \"node-ca-pmp7g\" (UID: \"b18ed7df-bfef-43ca-af32-7693909a4d7f\") " pod="openshift-image-registry/node-ca-pmp7g" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243046 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6ngq\" (UniqueName: \"kubernetes.io/projected/10b64002-953c-46f9-a84e-c4269ba5814f-kube-api-access-d6ngq\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-kubelet\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243123 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-slash\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243147 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243172 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/10b64002-953c-46f9-a84e-c4269ba5814f-etc-tuned\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243190 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-kubelet\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243194 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-run-netns\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243228 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/511a926e-4880-4520-be94-6bb456910f1a-ovnkube-config\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243254 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-system-cni-dir\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243271 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-slash\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243278 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-cni-dir\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-run-k8s-cni-cncf-io\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243305 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 06 22:02:55.243332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243327 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-socket-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.243350 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243359 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-system-cni-dir\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.243413 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs podName:1bb2a002-a9ac-4494-b7b1-57d94a96711b nodeName:}" failed. No retries permitted until 2026-06-06 22:02:55.743395221 +0000 UTC m=+2.945621934 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs") pod "network-metrics-daemon-hr9ch" (UID: "1bb2a002-a9ac-4494-b7b1-57d94a96711b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243420 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-cni-dir\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243308 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4d7697b0-6e56-40c9-ae24-47f612e0a2b0-konnectivity-ca\") pod \"konnectivity-agent-lpzdk\" (UID: \"4d7697b0-6e56-40c9-ae24-47f612e0a2b0\") " pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243466 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-run-k8s-cni-cncf-io\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243230 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-run-netns\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243352 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-systemd\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243500 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-daemon-config\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243529 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-node-log\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243569 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-socket-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243587 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/511a926e-4880-4520-be94-6bb456910f1a-ovn-node-metrics-cert\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243611 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243628 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-node-log\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243634 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4xhq\" (UniqueName: \"kubernetes.io/projected/b12f3564-b124-43da-a185-597650b9b6f7-kube-api-access-k4xhq\") pod \"node-resolver-x87wj\" (UID: \"b12f3564-b124-43da-a185-597650b9b6f7\") " pod="openshift-dns/node-resolver-x87wj" Jun 06 22:02:55.244235 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243666 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-var-lib-openvswitch\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243691 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-conf-dir\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243716 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfzsk\" (UniqueName: \"kubernetes.io/projected/1516a48e-3746-4869-b2c4-4df9eb7c34f4-kube-api-access-rfzsk\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-sysconfig\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243778 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-etc-selinux\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243796 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-kubernetes\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243830 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-host\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-var-lib-openvswitch\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243871 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6060cc52-d6aa-4840-a8ea-bf2cc720751c-cni-binary-copy\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-multus-conf-dir\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243898 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-var-lib-cni-multus\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243931 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-var-lib-cni-multus\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-var-lib-kubelet\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.243961 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r79ff\" (UniqueName: \"kubernetes.io/projected/6060cc52-d6aa-4840-a8ea-bf2cc720751c-kube-api-access-r79ff\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244005 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-var-lib-kubelet\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245023 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244017 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-registration-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b18ed7df-bfef-43ca-af32-7693909a4d7f-host\") pod \"node-ca-pmp7g\" (UID: \"b18ed7df-bfef-43ca-af32-7693909a4d7f\") " pod="openshift-image-registry/node-ca-pmp7g" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-sysctl-conf\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244124 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-cnibin\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244147 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-modprobe-d\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244171 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-sysctl-d\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244200 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ec1375f-fdce-49ff-be3f-d9e93c239968-iptables-alerter-script\") pod \"iptables-alerter-rmrkv\" (UID: \"1ec1375f-fdce-49ff-be3f-d9e93c239968\") " pod="openshift-network-operator/iptables-alerter-rmrkv" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244208 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-cnibin\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244229 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-etc-openvswitch\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244246 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/511a926e-4880-4520-be94-6bb456910f1a-ovnkube-config\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-879cd\" (UniqueName: \"kubernetes.io/projected/511a926e-4880-4520-be94-6bb456910f1a-kube-api-access-879cd\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-hostroot\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244261 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-registration-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244306 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-sys-fs\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244308 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-etc-openvswitch\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244330 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-system-cni-dir\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244337 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-hostroot\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.245924 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244356 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12f3564-b124-43da-a185-597650b9b6f7-tmp-dir\") pod \"node-resolver-x87wj\" (UID: \"b12f3564-b124-43da-a185-597650b9b6f7\") " pod="openshift-dns/node-resolver-x87wj" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6060cc52-d6aa-4840-a8ea-bf2cc720751c-cni-binary-copy\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244379 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-sys-fs\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-run-openvswitch\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244423 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-run-openvswitch\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244434 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/511a926e-4880-4520-be94-6bb456910f1a-env-overrides\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244457 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-run-netns\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244490 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-device-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244519 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-run-netns\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244517 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/045a17d2-a35c-4d79-a9b5-93ab54128d08-cni-binary-copy\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244562 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/1516a48e-3746-4869-b2c4-4df9eb7c34f4-device-dir\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-etc-kubernetes\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244634 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ca9bddb-c443-47df-90f0-88b8db74ccd3-dbus\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244655 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b12f3564-b124-43da-a185-597650b9b6f7-tmp-dir\") pod \"node-resolver-x87wj\" (UID: \"b12f3564-b124-43da-a185-597650b9b6f7\") " pod="openshift-dns/node-resolver-x87wj" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244662 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-etc-kubernetes\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-systemd-units\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.246737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244659 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-systemd-units\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244730 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-run-systemd\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-cni-bin\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244792 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-cni-netd\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244794 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-run-systemd\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/511a926e-4880-4520-be94-6bb456910f1a-ovnkube-script-lib\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244840 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-sys\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244846 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-cni-bin\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244853 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-run-ovn-kubernetes\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244874 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b12f3564-b124-43da-a185-597650b9b6f7-hosts-file\") pod \"node-resolver-x87wj\" (UID: \"b12f3564-b124-43da-a185-597650b9b6f7\") " pod="openshift-dns/node-resolver-x87wj" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244898 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-cni-netd\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244899 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-os-release\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ec1375f-fdce-49ff-be3f-d9e93c239968-host-slash\") pod \"iptables-alerter-rmrkv\" (UID: \"1ec1375f-fdce-49ff-be3f-d9e93c239968\") " pod="openshift-network-operator/iptables-alerter-rmrkv" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244950 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-lib-modules\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244954 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-os-release\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244969 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b64002-953c-46f9-a84e-c4269ba5814f-tmp\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.247607 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244990 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ca9bddb-c443-47df-90f0-88b8db74ccd3-kubelet-config\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.244809 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/511a926e-4880-4520-be94-6bb456910f1a-env-overrides\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245018 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245046 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b12f3564-b124-43da-a185-597650b9b6f7-hosts-file\") pod \"node-resolver-x87wj\" (UID: \"b12f3564-b124-43da-a185-597650b9b6f7\") " pod="openshift-dns/node-resolver-x87wj" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245083 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245095 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/045a17d2-a35c-4d79-a9b5-93ab54128d08-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245127 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/045a17d2-a35c-4d79-a9b5-93ab54128d08-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245154 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wj8nk\" (UniqueName: \"kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk\") pod \"network-check-target-7k8nh\" (UID: \"cb56d656-beeb-4dc7-a344-8928c6241100\") " pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245175 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-run\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-run-ovn\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245238 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-var-lib-cni-bin\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6vrb\" (UniqueName: \"kubernetes.io/projected/1ec1375f-fdce-49ff-be3f-d9e93c239968-kube-api-access-w6vrb\") pod \"iptables-alerter-rmrkv\" (UID: \"1ec1375f-fdce-49ff-be3f-d9e93c239968\") " pod="openshift-network-operator/iptables-alerter-rmrkv" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245273 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6060cc52-d6aa-4840-a8ea-bf2cc720751c-host-var-lib-cni-bin\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245242 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/511a926e-4880-4520-be94-6bb456910f1a-run-ovn\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.245338 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/511a926e-4880-4520-be94-6bb456910f1a-ovnkube-script-lib\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.247597 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/511a926e-4880-4520-be94-6bb456910f1a-ovn-node-metrics-cert\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.248463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.247711 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4d7697b0-6e56-40c9-ae24-47f612e0a2b0-agent-certs\") pod \"konnectivity-agent-lpzdk\" (UID: \"4d7697b0-6e56-40c9-ae24-47f612e0a2b0\") " pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:02:55.253262 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.253046 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfzsk\" (UniqueName: \"kubernetes.io/projected/1516a48e-3746-4869-b2c4-4df9eb7c34f4-kube-api-access-rfzsk\") pod \"aws-ebs-csi-driver-node-gmq7z\" (UID: \"1516a48e-3746-4869-b2c4-4df9eb7c34f4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.253262 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.253083 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r79ff\" (UniqueName: \"kubernetes.io/projected/6060cc52-d6aa-4840-a8ea-bf2cc720751c-kube-api-access-r79ff\") pod \"multus-w64sb\" (UID: \"6060cc52-d6aa-4840-a8ea-bf2cc720751c\") " pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.253262 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.253142 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmgxm\" (UniqueName: \"kubernetes.io/projected/1bb2a002-a9ac-4494-b7b1-57d94a96711b-kube-api-access-lmgxm\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:02:55.253585 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.253481 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4xhq\" (UniqueName: \"kubernetes.io/projected/b12f3564-b124-43da-a185-597650b9b6f7-kube-api-access-k4xhq\") pod \"node-resolver-x87wj\" (UID: \"b12f3564-b124-43da-a185-597650b9b6f7\") " pod="openshift-dns/node-resolver-x87wj" Jun 06 22:02:55.255463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.255440 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-879cd\" (UniqueName: \"kubernetes.io/projected/511a926e-4880-4520-be94-6bb456910f1a-kube-api-access-879cd\") pod \"ovnkube-node-d7rct\" (UID: \"511a926e-4880-4520-be94-6bb456910f1a\") " pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.346445 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346305 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b64002-953c-46f9-a84e-c4269ba5814f-tmp\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.346445 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346365 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ca9bddb-c443-47df-90f0-88b8db74ccd3-kubelet-config\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:55.346445 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346393 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/045a17d2-a35c-4d79-a9b5-93ab54128d08-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.346739 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/045a17d2-a35c-4d79-a9b5-93ab54128d08-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.346739 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346556 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj8nk\" (UniqueName: \"kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk\") pod \"network-check-target-7k8nh\" (UID: \"cb56d656-beeb-4dc7-a344-8928c6241100\") " pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:02:55.346739 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-run\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.346739 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6vrb\" (UniqueName: \"kubernetes.io/projected/1ec1375f-fdce-49ff-be3f-d9e93c239968-kube-api-access-w6vrb\") pod \"iptables-alerter-rmrkv\" (UID: \"1ec1375f-fdce-49ff-be3f-d9e93c239968\") " pod="openshift-network-operator/iptables-alerter-rmrkv" Jun 06 22:02:55.346739 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346624 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-var-lib-kubelet\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.346739 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346685 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-cnibin\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.346739 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-os-release\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.346739 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346732 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk4g6\" (UniqueName: \"kubernetes.io/projected/b18ed7df-bfef-43ca-af32-7693909a4d7f-kube-api-access-gk4g6\") pod \"node-ca-pmp7g\" (UID: \"b18ed7df-bfef-43ca-af32-7693909a4d7f\") " pod="openshift-image-registry/node-ca-pmp7g" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346751 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkwz2\" (UniqueName: \"kubernetes.io/projected/045a17d2-a35c-4d79-a9b5-93ab54128d08-kube-api-access-qkwz2\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346776 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b18ed7df-bfef-43ca-af32-7693909a4d7f-serviceca\") pod \"node-ca-pmp7g\" (UID: \"b18ed7df-bfef-43ca-af32-7693909a4d7f\") " pod="openshift-image-registry/node-ca-pmp7g" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346804 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6ngq\" (UniqueName: \"kubernetes.io/projected/10b64002-953c-46f9-a84e-c4269ba5814f-kube-api-access-d6ngq\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346847 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/10b64002-953c-46f9-a84e-c4269ba5814f-etc-tuned\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346876 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-systemd\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346903 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346934 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-sysconfig\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346957 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-kubernetes\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346979 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-host\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.346985 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-run\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b18ed7df-bfef-43ca-af32-7693909a4d7f-host\") pod \"node-ca-pmp7g\" (UID: \"b18ed7df-bfef-43ca-af32-7693909a4d7f\") " pod="openshift-image-registry/node-ca-pmp7g" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347033 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-sysctl-conf\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347063 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-var-lib-kubelet\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-modprobe-d\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347062 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/045a17d2-a35c-4d79-a9b5-93ab54128d08-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347126 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-sysctl-d\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347198 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/7ca9bddb-c443-47df-90f0-88b8db74ccd3-kubelet-config\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347204 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ec1375f-fdce-49ff-be3f-d9e93c239968-iptables-alerter-script\") pod \"iptables-alerter-rmrkv\" (UID: \"1ec1375f-fdce-49ff-be3f-d9e93c239968\") " pod="openshift-network-operator/iptables-alerter-rmrkv" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347239 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-system-cni-dir\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347245 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-cnibin\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/045a17d2-a35c-4d79-a9b5-93ab54128d08-cni-binary-copy\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347298 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347314 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-os-release\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347326 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ca9bddb-c443-47df-90f0-88b8db74ccd3-dbus\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347365 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-sys\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ec1375f-fdce-49ff-be3f-d9e93c239968-host-slash\") pod \"iptables-alerter-rmrkv\" (UID: \"1ec1375f-fdce-49ff-be3f-d9e93c239968\") " pod="openshift-network-operator/iptables-alerter-rmrkv" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-lib-modules\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347421 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/045a17d2-a35c-4d79-a9b5-93ab54128d08-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347452 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-sysctl-conf\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347508 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-sysconfig\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347527 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-kubernetes\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.347949 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347559 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-modprobe-d\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347589 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-lib-modules\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347600 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b18ed7df-bfef-43ca-af32-7693909a4d7f-serviceca\") pod \"node-ca-pmp7g\" (UID: \"b18ed7df-bfef-43ca-af32-7693909a4d7f\") " pod="openshift-image-registry/node-ca-pmp7g" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.347604 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347675 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-sys\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.347694 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret podName:7ca9bddb-c443-47df-90f0-88b8db74ccd3 nodeName:}" failed. No retries permitted until 2026-06-06 22:02:55.847674393 +0000 UTC m=+3.049901089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret") pod "global-pull-secret-syncer-44sh9" (UID: "7ca9bddb-c443-47df-90f0-88b8db74ccd3") : object "kube-system"/"original-pull-secret" not registered Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347700 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-sysctl-d\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347743 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b18ed7df-bfef-43ca-af32-7693909a4d7f-host\") pod \"node-ca-pmp7g\" (UID: \"b18ed7df-bfef-43ca-af32-7693909a4d7f\") " pod="openshift-image-registry/node-ca-pmp7g" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347785 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-system-cni-dir\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347823 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/045a17d2-a35c-4d79-a9b5-93ab54128d08-tuning-conf-dir\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347869 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1ec1375f-fdce-49ff-be3f-d9e93c239968-host-slash\") pod \"iptables-alerter-rmrkv\" (UID: \"1ec1375f-fdce-49ff-be3f-d9e93c239968\") " pod="openshift-network-operator/iptables-alerter-rmrkv" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347880 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-host\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/7ca9bddb-c443-47df-90f0-88b8db74ccd3-dbus\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.347934 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/10b64002-953c-46f9-a84e-c4269ba5814f-etc-systemd\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.348359 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1ec1375f-fdce-49ff-be3f-d9e93c239968-iptables-alerter-script\") pod \"iptables-alerter-rmrkv\" (UID: \"1ec1375f-fdce-49ff-be3f-d9e93c239968\") " pod="openshift-network-operator/iptables-alerter-rmrkv" Jun 06 22:02:55.348728 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.348681 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/045a17d2-a35c-4d79-a9b5-93ab54128d08-cni-binary-copy\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.349755 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.349719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/10b64002-953c-46f9-a84e-c4269ba5814f-tmp\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.349948 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.349926 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/10b64002-953c-46f9-a84e-c4269ba5814f-etc-tuned\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.353842 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.353767 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 22:02:55.353842 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.353790 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 22:02:55.353842 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.353805 2574 projected.go:196] Error preparing data for projected volume kube-api-access-wj8nk for pod openshift-network-diagnostics/network-check-target-7k8nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:02:55.354033 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.353873 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk podName:cb56d656-beeb-4dc7-a344-8928c6241100 nodeName:}" failed. No retries permitted until 2026-06-06 22:02:55.853855862 +0000 UTC m=+3.056082577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-wj8nk" (UniqueName: "kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk") pod "network-check-target-7k8nh" (UID: "cb56d656-beeb-4dc7-a344-8928c6241100") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:02:55.355737 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.355696 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk4g6\" (UniqueName: \"kubernetes.io/projected/b18ed7df-bfef-43ca-af32-7693909a4d7f-kube-api-access-gk4g6\") pod \"node-ca-pmp7g\" (UID: \"b18ed7df-bfef-43ca-af32-7693909a4d7f\") " pod="openshift-image-registry/node-ca-pmp7g" Jun 06 22:02:55.356458 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.356370 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkwz2\" (UniqueName: \"kubernetes.io/projected/045a17d2-a35c-4d79-a9b5-93ab54128d08-kube-api-access-qkwz2\") pod \"multus-additional-cni-plugins-q9fww\" (UID: \"045a17d2-a35c-4d79-a9b5-93ab54128d08\") " pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.357303 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.356801 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6ngq\" (UniqueName: \"kubernetes.io/projected/10b64002-953c-46f9-a84e-c4269ba5814f-kube-api-access-d6ngq\") pod \"tuned-lj46z\" (UID: \"10b64002-953c-46f9-a84e-c4269ba5814f\") " pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.357501 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.357426 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6vrb\" (UniqueName: \"kubernetes.io/projected/1ec1375f-fdce-49ff-be3f-d9e93c239968-kube-api-access-w6vrb\") pod \"iptables-alerter-rmrkv\" (UID: \"1ec1375f-fdce-49ff-be3f-d9e93c239968\") " pod="openshift-network-operator/iptables-alerter-rmrkv" Jun 06 22:02:55.429736 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.429700 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-x87wj" Jun 06 22:02:55.436544 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.436520 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:02:55.445213 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.445191 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-w64sb" Jun 06 22:02:55.449871 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.449848 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:02:55.455466 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.455441 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" Jun 06 22:02:55.462017 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.461978 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lj46z" Jun 06 22:02:55.467765 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.467721 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-q9fww" Jun 06 22:02:55.475297 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.475276 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-rmrkv" Jun 06 22:02:55.480902 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.480882 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pmp7g" Jun 06 22:02:55.750265 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.750185 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:02:55.750422 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.750313 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:02:55.750422 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.750371 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs podName:1bb2a002-a9ac-4494-b7b1-57d94a96711b nodeName:}" failed. No retries permitted until 2026-06-06 22:02:56.750358219 +0000 UTC m=+3.952584914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs") pod "network-metrics-daemon-hr9ch" (UID: "1bb2a002-a9ac-4494-b7b1-57d94a96711b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:02:55.850705 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.850667 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:55.850836 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.850777 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 22:02:55.850836 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.850831 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret podName:7ca9bddb-c443-47df-90f0-88b8db74ccd3 nodeName:}" failed. No retries permitted until 2026-06-06 22:02:56.850816037 +0000 UTC m=+4.053042738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret") pod "global-pull-secret-syncer-44sh9" (UID: "7ca9bddb-c443-47df-90f0-88b8db74ccd3") : object "kube-system"/"original-pull-secret" not registered Jun 06 22:02:55.951617 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:55.951581 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj8nk\" (UniqueName: \"kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk\") pod \"network-check-target-7k8nh\" (UID: \"cb56d656-beeb-4dc7-a344-8928c6241100\") " pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:02:55.951801 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.951729 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 22:02:55.951801 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.951752 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 22:02:55.951801 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.951763 2574 projected.go:196] Error preparing data for projected volume kube-api-access-wj8nk for pod openshift-network-diagnostics/network-check-target-7k8nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:02:55.951946 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:55.951817 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk podName:cb56d656-beeb-4dc7-a344-8928c6241100 nodeName:}" failed. No retries permitted until 2026-06-06 22:02:56.951799324 +0000 UTC m=+4.154026019 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-wj8nk" (UniqueName: "kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk") pod "network-check-target-7k8nh" (UID: "cb56d656-beeb-4dc7-a344-8928c6241100") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:02:56.171202 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:56.171154 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 21:57:55 +0000 UTC" deadline="2028-02-25 23:37:23.83031698 +0000 UTC" Jun 06 22:02:56.171202 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:56.171200 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15097h34m27.659121219s" Jun 06 22:02:56.178912 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:56.178881 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb12f3564_b124_43da_a185_597650b9b6f7.slice/crio-8ad064d8ca32792b4595479a0b7ff23ba71502e17b12b86d4135aea2a19eb5e5 WatchSource:0}: Error finding container 8ad064d8ca32792b4595479a0b7ff23ba71502e17b12b86d4135aea2a19eb5e5: Status 404 returned error can't find the container with id 8ad064d8ca32792b4595479a0b7ff23ba71502e17b12b86d4135aea2a19eb5e5 Jun 06 22:02:56.181147 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:56.181114 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6060cc52_d6aa_4840_a8ea_bf2cc720751c.slice/crio-247ac7300b9d8e3b07e459b12325ab42023b310795ce9515f2833415922934d8 WatchSource:0}: Error finding container 247ac7300b9d8e3b07e459b12325ab42023b310795ce9515f2833415922934d8: Status 404 returned error can't find the container with id 247ac7300b9d8e3b07e459b12325ab42023b310795ce9515f2833415922934d8 Jun 06 22:02:56.183132 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:56.183109 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b64002_953c_46f9_a84e_c4269ba5814f.slice/crio-98cffdd77fc5faba48abb9b92c350eeae3769ff834074d875b23d2139c3d6783 WatchSource:0}: Error finding container 98cffdd77fc5faba48abb9b92c350eeae3769ff834074d875b23d2139c3d6783: Status 404 returned error can't find the container with id 98cffdd77fc5faba48abb9b92c350eeae3769ff834074d875b23d2139c3d6783 Jun 06 22:02:56.184499 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:56.184479 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod045a17d2_a35c_4d79_a9b5_93ab54128d08.slice/crio-9c90b04dec3c19c315bd42b780150dc7c1b59f1bad8ee5ab381b17e785efd492 WatchSource:0}: Error finding container 9c90b04dec3c19c315bd42b780150dc7c1b59f1bad8ee5ab381b17e785efd492: Status 404 returned error can't find the container with id 9c90b04dec3c19c315bd42b780150dc7c1b59f1bad8ee5ab381b17e785efd492 Jun 06 22:02:56.185932 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:56.185880 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1516a48e_3746_4869_b2c4_4df9eb7c34f4.slice/crio-fa2b4b3f7d64150fcfb9a37f0c5be1a8aa9646efe16995e54a9fe39b323b783f WatchSource:0}: Error finding container fa2b4b3f7d64150fcfb9a37f0c5be1a8aa9646efe16995e54a9fe39b323b783f: Status 404 returned error can't find the container with id fa2b4b3f7d64150fcfb9a37f0c5be1a8aa9646efe16995e54a9fe39b323b783f Jun 06 22:02:56.208123 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:56.208100 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d7697b0_6e56_40c9_ae24_47f612e0a2b0.slice/crio-9d99c12e0a24fab2d74e9c661abe788f9f7b299116ef7e9c1d7048f18d5e0946 WatchSource:0}: Error finding container 9d99c12e0a24fab2d74e9c661abe788f9f7b299116ef7e9c1d7048f18d5e0946: Status 404 returned error can't find the container with id 9d99c12e0a24fab2d74e9c661abe788f9f7b299116ef7e9c1d7048f18d5e0946 Jun 06 22:02:56.209922 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:56.209833 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec1375f_fdce_49ff_be3f_d9e93c239968.slice/crio-62c56e5e29b2e576714a560026a7b1b6518c01c1177bdca1976eacefbb4c6a6f WatchSource:0}: Error finding container 62c56e5e29b2e576714a560026a7b1b6518c01c1177bdca1976eacefbb4c6a6f: Status 404 returned error can't find the container with id 62c56e5e29b2e576714a560026a7b1b6518c01c1177bdca1976eacefbb4c6a6f Jun 06 22:02:56.210625 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:56.210601 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb18ed7df_bfef_43ca_af32_7693909a4d7f.slice/crio-b134ca223434a4a91d1385d8bd0ab63542be5c58fd3739f5dd74aa79e12372da WatchSource:0}: Error finding container b134ca223434a4a91d1385d8bd0ab63542be5c58fd3739f5dd74aa79e12372da: Status 404 returned error can't find the container with id b134ca223434a4a91d1385d8bd0ab63542be5c58fd3739f5dd74aa79e12372da Jun 06 22:02:56.211113 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:56.211061 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9fww" event={"ID":"045a17d2-a35c-4d79-a9b5-93ab54128d08","Type":"ContainerStarted","Data":"9c90b04dec3c19c315bd42b780150dc7c1b59f1bad8ee5ab381b17e785efd492"} Jun 06 22:02:56.211700 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:02:56.211592 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511a926e_4880_4520_be94_6bb456910f1a.slice/crio-5a8f543729b354fa68c3558e6bb4f49282224fd644b87c06429107e21a3ea335 WatchSource:0}: Error finding container 5a8f543729b354fa68c3558e6bb4f49282224fd644b87c06429107e21a3ea335: Status 404 returned error can't find the container with id 5a8f543729b354fa68c3558e6bb4f49282224fd644b87c06429107e21a3ea335 Jun 06 22:02:56.212902 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:56.212843 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lj46z" event={"ID":"10b64002-953c-46f9-a84e-c4269ba5814f","Type":"ContainerStarted","Data":"98cffdd77fc5faba48abb9b92c350eeae3769ff834074d875b23d2139c3d6783"} Jun 06 22:02:56.213753 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:56.213733 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w64sb" event={"ID":"6060cc52-d6aa-4840-a8ea-bf2cc720751c","Type":"ContainerStarted","Data":"247ac7300b9d8e3b07e459b12325ab42023b310795ce9515f2833415922934d8"} Jun 06 22:02:56.215712 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:56.215686 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x87wj" event={"ID":"b12f3564-b124-43da-a185-597650b9b6f7","Type":"ContainerStarted","Data":"8ad064d8ca32792b4595479a0b7ff23ba71502e17b12b86d4135aea2a19eb5e5"} Jun 06 22:02:56.216958 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:56.216936 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lpzdk" event={"ID":"4d7697b0-6e56-40c9-ae24-47f612e0a2b0","Type":"ContainerStarted","Data":"9d99c12e0a24fab2d74e9c661abe788f9f7b299116ef7e9c1d7048f18d5e0946"} Jun 06 22:02:56.218204 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:56.218182 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" event={"ID":"1516a48e-3746-4869-b2c4-4df9eb7c34f4","Type":"ContainerStarted","Data":"fa2b4b3f7d64150fcfb9a37f0c5be1a8aa9646efe16995e54a9fe39b323b783f"} Jun 06 22:02:56.758731 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:56.757852 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:02:56.758731 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:56.758271 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:02:56.758731 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:56.758335 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs podName:1bb2a002-a9ac-4494-b7b1-57d94a96711b nodeName:}" failed. No retries permitted until 2026-06-06 22:02:58.758315522 +0000 UTC m=+5.960542221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs") pod "network-metrics-daemon-hr9ch" (UID: "1bb2a002-a9ac-4494-b7b1-57d94a96711b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:02:56.859141 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:56.858540 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:56.859141 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:56.858684 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 22:02:56.859141 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:56.858748 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret podName:7ca9bddb-c443-47df-90f0-88b8db74ccd3 nodeName:}" failed. No retries permitted until 2026-06-06 22:02:58.858729819 +0000 UTC m=+6.060956517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret") pod "global-pull-secret-syncer-44sh9" (UID: "7ca9bddb-c443-47df-90f0-88b8db74ccd3") : object "kube-system"/"original-pull-secret" not registered Jun 06 22:02:56.958937 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:56.958887 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj8nk\" (UniqueName: \"kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk\") pod \"network-check-target-7k8nh\" (UID: \"cb56d656-beeb-4dc7-a344-8928c6241100\") " pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:02:56.959146 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:56.959122 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 22:02:56.959146 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:56.959144 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 22:02:56.959292 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:56.959158 2574 projected.go:196] Error preparing data for projected volume kube-api-access-wj8nk for pod openshift-network-diagnostics/network-check-target-7k8nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:02:56.959292 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:56.959222 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk podName:cb56d656-beeb-4dc7-a344-8928c6241100 nodeName:}" failed. No retries permitted until 2026-06-06 22:02:58.959202334 +0000 UTC m=+6.161429043 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-wj8nk" (UniqueName: "kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk") pod "network-check-target-7k8nh" (UID: "cb56d656-beeb-4dc7-a344-8928c6241100") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:02:57.171808 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:57.171692 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-05 21:57:55 +0000 UTC" deadline="2028-03-15 03:17:47.963458078 +0000 UTC" Jun 06 22:02:57.171808 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:57.171731 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15533h14m50.791731187s" Jun 06 22:02:57.205260 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:57.204408 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:02:57.205260 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:57.204548 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:02:57.205260 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:57.204950 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:02:57.205260 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:57.205047 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:02:57.205260 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:57.205131 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:57.205260 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:57.205207 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:02:57.236668 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:57.236628 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" event={"ID":"511a926e-4880-4520-be94-6bb456910f1a","Type":"ContainerStarted","Data":"5a8f543729b354fa68c3558e6bb4f49282224fd644b87c06429107e21a3ea335"} Jun 06 22:02:57.249052 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:57.249010 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pmp7g" event={"ID":"b18ed7df-bfef-43ca-af32-7693909a4d7f","Type":"ContainerStarted","Data":"b134ca223434a4a91d1385d8bd0ab63542be5c58fd3739f5dd74aa79e12372da"} Jun 06 22:02:57.257518 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:57.257425 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rmrkv" event={"ID":"1ec1375f-fdce-49ff-be3f-d9e93c239968","Type":"ContainerStarted","Data":"62c56e5e29b2e576714a560026a7b1b6518c01c1177bdca1976eacefbb4c6a6f"} Jun 06 22:02:57.277171 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:57.276875 2574 generic.go:356] "Generic (PLEG): container finished" podID="1316253b60e3f4aae52aa3f3fa4a3e33" containerID="f055f1696a1a1b1c137e70c87d1f3cbb570ee88930fb4349cae32f65bab20a60" exitCode=0 Jun 06 22:02:57.277171 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:57.277114 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" event={"ID":"1316253b60e3f4aae52aa3f3fa4a3e33","Type":"ContainerDied","Data":"f055f1696a1a1b1c137e70c87d1f3cbb570ee88930fb4349cae32f65bab20a60"} Jun 06 22:02:57.294059 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:57.293948 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-122.ec2.internal" event={"ID":"0a87311d29ccf74442080aeb2ab4f1c4","Type":"ContainerStarted","Data":"8b00d14eb42720eaeb5676b4235c9f1e63af398dcfeb561273216fe0bbdf14dd"} Jun 06 22:02:58.332375 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:58.332338 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" event={"ID":"1316253b60e3f4aae52aa3f3fa4a3e33","Type":"ContainerStarted","Data":"6ce62424c17bce45030ae1a13a819d9bc9bfd20618bb4f01b9bb077237576940"} Jun 06 22:02:58.344991 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:58.344931 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-122.ec2.internal" podStartSLOduration=4.344910941 podStartE2EDuration="4.344910941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:02:57.306834821 +0000 UTC m=+4.509061539" watchObservedRunningTime="2026-06-06 22:02:58.344910941 +0000 UTC m=+5.547137656" Jun 06 22:02:58.345823 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:58.345732 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-122.ec2.internal" podStartSLOduration=4.345721531 podStartE2EDuration="4.345721531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:02:58.344849781 +0000 UTC m=+5.547076500" watchObservedRunningTime="2026-06-06 22:02:58.345721531 +0000 UTC m=+5.547948250" Jun 06 22:02:58.772269 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:58.772184 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:02:58.772426 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:58.772394 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:02:58.772484 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:58.772462 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs podName:1bb2a002-a9ac-4494-b7b1-57d94a96711b nodeName:}" failed. No retries permitted until 2026-06-06 22:03:02.772443261 +0000 UTC m=+9.974669971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs") pod "network-metrics-daemon-hr9ch" (UID: "1bb2a002-a9ac-4494-b7b1-57d94a96711b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:02:58.873031 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:58.872981 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:58.873221 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:58.873149 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 22:02:58.873221 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:58.873212 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret podName:7ca9bddb-c443-47df-90f0-88b8db74ccd3 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:02.873193562 +0000 UTC m=+10.075420261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret") pod "global-pull-secret-syncer-44sh9" (UID: "7ca9bddb-c443-47df-90f0-88b8db74ccd3") : object "kube-system"/"original-pull-secret" not registered Jun 06 22:02:58.973961 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:58.973922 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj8nk\" (UniqueName: \"kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk\") pod \"network-check-target-7k8nh\" (UID: \"cb56d656-beeb-4dc7-a344-8928c6241100\") " pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:02:58.974165 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:58.974149 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 22:02:58.974240 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:58.974173 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 22:02:58.974240 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:58.974186 2574 projected.go:196] Error preparing data for projected volume kube-api-access-wj8nk for pod openshift-network-diagnostics/network-check-target-7k8nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:02:58.974347 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:58.974246 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk podName:cb56d656-beeb-4dc7-a344-8928c6241100 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:02.974226697 +0000 UTC m=+10.176453413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-wj8nk" (UniqueName: "kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk") pod "network-check-target-7k8nh" (UID: "cb56d656-beeb-4dc7-a344-8928c6241100") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:02:59.202518 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:59.202484 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:02:59.202703 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:59.202636 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:02:59.204804 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:59.204625 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:02:59.204804 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:59.204768 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:02:59.204992 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:02:59.204823 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:02:59.204992 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:02:59.204958 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:01.202870 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:01.202777 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:01.203411 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:01.202915 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:01.203411 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:01.202950 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:01.203411 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:01.202949 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:01.203411 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:01.203049 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:01.203411 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:01.203155 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:02.809243 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:02.808605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:02.809243 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:02.808816 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:03:02.809243 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:02.808879 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs podName:1bb2a002-a9ac-4494-b7b1-57d94a96711b nodeName:}" failed. No retries permitted until 2026-06-06 22:03:10.808860807 +0000 UTC m=+18.011087505 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs") pod "network-metrics-daemon-hr9ch" (UID: "1bb2a002-a9ac-4494-b7b1-57d94a96711b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:03:02.909231 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:02.909183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:02.909402 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:02.909327 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 22:03:02.909486 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:02.909403 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret podName:7ca9bddb-c443-47df-90f0-88b8db74ccd3 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:10.90938407 +0000 UTC m=+18.111610777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret") pod "global-pull-secret-syncer-44sh9" (UID: "7ca9bddb-c443-47df-90f0-88b8db74ccd3") : object "kube-system"/"original-pull-secret" not registered Jun 06 22:03:03.010578 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:03.010547 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj8nk\" (UniqueName: \"kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk\") pod \"network-check-target-7k8nh\" (UID: \"cb56d656-beeb-4dc7-a344-8928c6241100\") " pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:03.010778 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:03.010686 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 22:03:03.010778 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:03.010706 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 22:03:03.010778 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:03.010719 2574 projected.go:196] Error preparing data for projected volume kube-api-access-wj8nk for pod openshift-network-diagnostics/network-check-target-7k8nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:03:03.010778 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:03.010780 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk podName:cb56d656-beeb-4dc7-a344-8928c6241100 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:11.01076253 +0000 UTC m=+18.212989232 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-wj8nk" (UniqueName: "kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk") pod "network-check-target-7k8nh" (UID: "cb56d656-beeb-4dc7-a344-8928c6241100") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:03:03.203894 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:03.203230 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:03.203894 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:03.203353 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:03.203894 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:03.203708 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:03.203894 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:03.203798 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:03.203894 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:03.203822 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:03.204285 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:03.203901 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:05.202314 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:05.202277 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:05.202782 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:05.202423 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:05.202782 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:05.202460 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:05.202782 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:05.202277 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:05.202782 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:05.202606 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:05.202782 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:05.202683 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:07.202118 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:07.202089 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:07.202583 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:07.202099 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:07.202583 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:07.202221 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:07.202583 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:07.202099 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:07.202583 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:07.202258 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:07.202583 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:07.202377 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:09.202522 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:09.202456 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:09.202522 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:09.202493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:09.203040 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:09.202455 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:09.203040 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:09.202602 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:09.203040 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:09.202675 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:09.203040 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:09.202761 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:10.867800 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:10.867717 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:10.868271 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:10.867911 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:03:10.868271 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:10.867984 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs podName:1bb2a002-a9ac-4494-b7b1-57d94a96711b nodeName:}" failed. No retries permitted until 2026-06-06 22:03:26.867963651 +0000 UTC m=+34.070190363 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs") pod "network-metrics-daemon-hr9ch" (UID: "1bb2a002-a9ac-4494-b7b1-57d94a96711b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:03:10.968334 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:10.968244 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:10.968507 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:10.968359 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 22:03:10.968507 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:10.968436 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret podName:7ca9bddb-c443-47df-90f0-88b8db74ccd3 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:26.968417593 +0000 UTC m=+34.170644298 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret") pod "global-pull-secret-syncer-44sh9" (UID: "7ca9bddb-c443-47df-90f0-88b8db74ccd3") : object "kube-system"/"original-pull-secret" not registered Jun 06 22:03:11.069010 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:11.068972 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj8nk\" (UniqueName: \"kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk\") pod \"network-check-target-7k8nh\" (UID: \"cb56d656-beeb-4dc7-a344-8928c6241100\") " pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:11.069196 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:11.069169 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 22:03:11.069196 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:11.069193 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 22:03:11.069296 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:11.069208 2574 projected.go:196] Error preparing data for projected volume kube-api-access-wj8nk for pod openshift-network-diagnostics/network-check-target-7k8nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:03:11.069296 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:11.069274 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk podName:cb56d656-beeb-4dc7-a344-8928c6241100 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:27.069257766 +0000 UTC m=+34.271484482 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-wj8nk" (UniqueName: "kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk") pod "network-check-target-7k8nh" (UID: "cb56d656-beeb-4dc7-a344-8928c6241100") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:03:11.202173 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:11.202084 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:11.202341 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:11.202217 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:11.202341 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:11.202089 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:11.202341 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:11.202309 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:11.202341 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:11.202084 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:11.202542 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:11.202390 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:13.203727 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:13.203687 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:13.204253 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:13.203780 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:13.204253 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:13.203831 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:13.204253 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:13.203860 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:13.204253 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:13.203900 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:13.204253 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:13.203982 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:15.202609 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.202343 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:15.203249 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.202343 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:15.203249 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.202352 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:15.203249 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:15.202746 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:15.203249 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:15.202788 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:15.203249 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:15.202852 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:15.365310 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.365054 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lj46z" event={"ID":"10b64002-953c-46f9-a84e-c4269ba5814f","Type":"ContainerStarted","Data":"18d2321482aacada8c21a160a60172bfc62236e9c162a68817e8efb10f7e0fb6"} Jun 06 22:03:15.366801 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.366771 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pmp7g" event={"ID":"b18ed7df-bfef-43ca-af32-7693909a4d7f","Type":"ContainerStarted","Data":"bc32a2b09d22980716dac460cc34056536e213526eba010bb532f716f7a80a8e"} Jun 06 22:03:15.368470 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.368430 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-lpzdk" event={"ID":"4d7697b0-6e56-40c9-ae24-47f612e0a2b0","Type":"ContainerStarted","Data":"248b230df3569937c4f9f354b72aaaddc72fcde0cc317578191b489d6b79e33d"} Jun 06 22:03:15.369992 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.369965 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" event={"ID":"1516a48e-3746-4869-b2c4-4df9eb7c34f4","Type":"ContainerStarted","Data":"5f1fd2b3cfa0d963abb18981efa8b0d6f69c87a0550e4a61c3797cb6fdbbf84e"} Jun 06 22:03:15.371418 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.371396 2574 generic.go:356] "Generic (PLEG): container finished" podID="045a17d2-a35c-4d79-a9b5-93ab54128d08" containerID="2280173a50bf53441813994650ca85b9f32a05db8ee87ff2fb45735cd8805d10" exitCode=0 Jun 06 22:03:15.371514 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.371463 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9fww" event={"ID":"045a17d2-a35c-4d79-a9b5-93ab54128d08","Type":"ContainerDied","Data":"2280173a50bf53441813994650ca85b9f32a05db8ee87ff2fb45735cd8805d10"} Jun 06 22:03:15.372960 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.372917 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-w64sb" event={"ID":"6060cc52-d6aa-4840-a8ea-bf2cc720751c","Type":"ContainerStarted","Data":"150d6fca6fb804c0b89543f3f93085224aa6b7b6683b799345e81f0dec5e7c0e"} Jun 06 22:03:15.374570 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.374487 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-x87wj" event={"ID":"b12f3564-b124-43da-a185-597650b9b6f7","Type":"ContainerStarted","Data":"492185b3f4b7abdfdeaacad1f14f8362bfc5522bf4faab3f882d82af72ad23e9"} Jun 06 22:03:15.379432 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.377787 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:03:15.380809 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.380785 2574 generic.go:356] "Generic (PLEG): container finished" podID="511a926e-4880-4520-be94-6bb456910f1a" containerID="0351444d00eb627cb3bf138c4e2e2a97532ca7dc31b874600b8a0aef4292b59f" exitCode=1 Jun 06 22:03:15.380908 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.380818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" event={"ID":"511a926e-4880-4520-be94-6bb456910f1a","Type":"ContainerStarted","Data":"ed248948dc35757223dc482975f64f0443bc0c6629f4be893302501add14e425"} Jun 06 22:03:15.380908 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.380856 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lj46z" podStartSLOduration=3.879501566 podStartE2EDuration="22.380836712s" totalImagesPullingTime="18.501335146s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:15.380125545 +0000 UTC m=+22.582352265" watchObservedRunningTime="2026-06-06 22:03:15.380836712 +0000 UTC m=+22.583063432" Jun 06 22:03:15.381025 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.380898 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" event={"ID":"511a926e-4880-4520-be94-6bb456910f1a","Type":"ContainerStarted","Data":"c2bc8554db9051589a28ef2d3d6140f0c074c409b172fafbc60f746f2f2576b7"} Jun 06 22:03:15.381025 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.380976 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" event={"ID":"511a926e-4880-4520-be94-6bb456910f1a","Type":"ContainerDied","Data":"0351444d00eb627cb3bf138c4e2e2a97532ca7dc31b874600b8a0aef4292b59f"} Jun 06 22:03:15.381025 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.381016 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" event={"ID":"511a926e-4880-4520-be94-6bb456910f1a","Type":"ContainerStarted","Data":"d9e5c822f0ddd73ba6f2f58c11428db30c30f41778ed978b570648da27f9cc2b"} Jun 06 22:03:15.391710 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.391571 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pmp7g" podStartSLOduration=3.9225514329999998 podStartE2EDuration="22.391551942s" totalImagesPullingTime="18.469000509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:15.391521409 +0000 UTC m=+22.593748128" watchObservedRunningTime="2026-06-06 22:03:15.391551942 +0000 UTC m=+22.593778659" Jun 06 22:03:15.438330 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.438277 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-w64sb" podStartSLOduration=3.907903226 podStartE2EDuration="22.438256145s" totalImagesPullingTime="18.530352919s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:15.43743717 +0000 UTC m=+22.639663888" watchObservedRunningTime="2026-06-06 22:03:15.438256145 +0000 UTC m=+22.640482863" Jun 06 22:03:15.438663 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.438624 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-x87wj" podStartSLOduration=3.935036212 podStartE2EDuration="22.438611764s" totalImagesPullingTime="18.503575552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:15.411122997 +0000 UTC m=+22.613349712" watchObservedRunningTime="2026-06-06 22:03:15.438611764 +0000 UTC m=+22.640838484" Jun 06 22:03:15.473323 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:15.473268 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-lpzdk" podStartSLOduration=4.041180412 podStartE2EDuration="22.473243251s" totalImagesPullingTime="18.432062839s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:15.451308158 +0000 UTC m=+22.653534877" watchObservedRunningTime="2026-06-06 22:03:15.473243251 +0000 UTC m=+22.675469970" Jun 06 22:03:16.083593 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:16.083556 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 06 22:03:16.208865 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:16.208744 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-06T22:03:16.083583588Z","UUID":"21f8dcda-a8cf-4bb6-8ae5-9be2dfa6ec89","Handler":null,"Name":"","Endpoint":""} Jun 06 22:03:16.210495 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:16.210460 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 06 22:03:16.210618 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:16.210506 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 06 22:03:16.385121 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:16.385087 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-rmrkv" event={"ID":"1ec1375f-fdce-49ff-be3f-d9e93c239968","Type":"ContainerStarted","Data":"abcbee56afad1b69c838d8b0fc5fc6a3438bfca862c0632882a74f791d83b6dc"} Jun 06 22:03:16.387062 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:16.387029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" event={"ID":"1516a48e-3746-4869-b2c4-4df9eb7c34f4","Type":"ContainerStarted","Data":"951f48e8b86df4191f76a63a8c21d5cacd82d980303027c1f46bffc94abdb474"} Jun 06 22:03:16.390168 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:16.390149 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:03:16.390604 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:16.390579 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" event={"ID":"511a926e-4880-4520-be94-6bb456910f1a","Type":"ContainerStarted","Data":"457d119d1bdcc063b839c5a9d81d953c7711fb6a68519a7afda0ddbcf31b3c43"} Jun 06 22:03:16.390738 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:16.390719 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" event={"ID":"511a926e-4880-4520-be94-6bb456910f1a","Type":"ContainerStarted","Data":"4bd84d5d0b302770d20adbfedce140b7ddeece3d61ec3020951507dc1772e492"} Jun 06 22:03:16.397490 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:16.397454 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-rmrkv" podStartSLOduration=4.921017034 podStartE2EDuration="23.397436239s" totalImagesPullingTime="18.476419205s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:16.39696183 +0000 UTC m=+23.599188547" watchObservedRunningTime="2026-06-06 22:03:16.397436239 +0000 UTC m=+23.599662957" Jun 06 22:03:17.203211 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:17.202710 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:17.203211 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:17.202710 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:17.203211 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:17.202857 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:17.203211 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:17.202938 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:17.203211 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:17.202997 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:17.203211 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:17.203063 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:17.395658 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:17.395438 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" event={"ID":"1516a48e-3746-4869-b2c4-4df9eb7c34f4","Type":"ContainerStarted","Data":"c5830dd4965c4bbfa7d3bfed17e911f1334798facaf05e07f775d0c4eef949c9"} Jun 06 22:03:17.412228 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:17.412183 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gmq7z" podStartSLOduration=3.867783308 podStartE2EDuration="24.412168577s" totalImagesPullingTime="20.544385269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:17.411542799 +0000 UTC m=+24.613769517" watchObservedRunningTime="2026-06-06 22:03:17.412168577 +0000 UTC m=+24.614395293" Jun 06 22:03:18.400758 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:18.400725 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:03:18.401162 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:18.401131 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" event={"ID":"511a926e-4880-4520-be94-6bb456910f1a","Type":"ContainerStarted","Data":"1269e27509c4d7007afd82cb69f72461a4a90f6c314c1df24a778e5c09e867bd"} Jun 06 22:03:19.202745 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:19.202708 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:19.202745 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:19.202727 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:19.202991 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:19.202752 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:19.202991 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:19.202837 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:19.202991 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:19.202952 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:19.203160 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:19.203052 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:19.562216 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:19.562180 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:03:19.562827 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:19.562812 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:03:20.407430 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:20.407250 2574 generic.go:356] "Generic (PLEG): container finished" podID="045a17d2-a35c-4d79-a9b5-93ab54128d08" containerID="f17033e11e268ef3170eff8757f3d1933bb23ae0f31bc319309832edf82d3b45" exitCode=0 Jun 06 22:03:20.407642 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:20.407327 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9fww" event={"ID":"045a17d2-a35c-4d79-a9b5-93ab54128d08","Type":"ContainerDied","Data":"f17033e11e268ef3170eff8757f3d1933bb23ae0f31bc319309832edf82d3b45"} Jun 06 22:03:20.410734 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:20.410714 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:03:20.411050 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:20.411029 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" event={"ID":"511a926e-4880-4520-be94-6bb456910f1a","Type":"ContainerStarted","Data":"39529dfe40092f93c2e81be818f56040967b33764319f85293549677c50ada1d"} Jun 06 22:03:20.411498 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:20.411483 2574 scope.go:117] "RemoveContainer" containerID="0351444d00eb627cb3bf138c4e2e2a97532ca7dc31b874600b8a0aef4292b59f" Jun 06 22:03:21.202804 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:21.202774 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:21.203471 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:21.202775 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:21.203471 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:21.202775 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:21.203471 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:21.202983 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:21.203471 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:21.203047 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:21.203471 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:21.202877 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:21.417715 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:21.417690 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:03:21.418137 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:21.418107 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" event={"ID":"511a926e-4880-4520-be94-6bb456910f1a","Type":"ContainerStarted","Data":"35c8eb6ac723bc44797fa5f94b5a28d624e7b2d348be286eac1d299ccc647674"} Jun 06 22:03:21.418505 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:21.418479 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:03:21.418591 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:21.418564 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:03:21.418655 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:21.418612 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:03:21.435448 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:21.435416 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:03:21.436689 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:21.436668 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:03:21.442623 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:21.442574 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" podStartSLOduration=9.679772352 podStartE2EDuration="28.442560111s" totalImagesPullingTime="18.762787759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:21.441959986 +0000 UTC m=+28.644186727" watchObservedRunningTime="2026-06-06 22:03:21.442560111 +0000 UTC m=+28.644786829" Jun 06 22:03:22.025362 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:22.025280 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-44sh9"] Jun 06 22:03:22.025519 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:22.025395 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:22.025519 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:22.025478 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:22.028390 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:22.028361 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hr9ch"] Jun 06 22:03:22.028517 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:22.028470 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:22.028590 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:22.028556 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:22.028824 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:22.028805 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7k8nh"] Jun 06 22:03:22.028900 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:22.028889 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:22.028993 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:22.028974 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:22.422578 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:22.422401 2574 generic.go:356] "Generic (PLEG): container finished" podID="045a17d2-a35c-4d79-a9b5-93ab54128d08" containerID="61ed3e3e88e5598d2b586343a6c18ba17a9796a0e370adf5b6fcc1de9c5dced0" exitCode=0 Jun 06 22:03:22.422923 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:22.422481 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9fww" event={"ID":"045a17d2-a35c-4d79-a9b5-93ab54128d08","Type":"ContainerDied","Data":"61ed3e3e88e5598d2b586343a6c18ba17a9796a0e370adf5b6fcc1de9c5dced0"} Jun 06 22:03:24.202402 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:24.202313 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:24.202402 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:24.202350 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:24.202402 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:24.202355 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:24.202967 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:24.202424 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:24.202967 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:24.202504 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:24.202967 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:24.202557 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:24.430332 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:24.430299 2574 generic.go:356] "Generic (PLEG): container finished" podID="045a17d2-a35c-4d79-a9b5-93ab54128d08" containerID="7dd798a2b796335fa13acfd5d08c012487a995677bfcec6e2d6705d257a0122c" exitCode=0 Jun 06 22:03:24.430468 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:24.430343 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9fww" event={"ID":"045a17d2-a35c-4d79-a9b5-93ab54128d08","Type":"ContainerDied","Data":"7dd798a2b796335fa13acfd5d08c012487a995677bfcec6e2d6705d257a0122c"} Jun 06 22:03:24.467830 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:24.467803 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:03:24.467981 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:24.467960 2574 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 06 22:03:24.468536 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:24.468511 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-lpzdk" Jun 06 22:03:26.202156 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:26.202120 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:26.202156 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:26.202154 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:26.203035 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:26.202260 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-44sh9" podUID="7ca9bddb-c443-47df-90f0-88b8db74ccd3" Jun 06 22:03:26.203035 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:26.202304 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:26.203035 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:26.202422 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:03:26.203035 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:26.202501 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7k8nh" podUID="cb56d656-beeb-4dc7-a344-8928c6241100" Jun 06 22:03:26.888390 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:26.888351 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:26.888553 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:26.888502 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:03:26.888593 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:26.888566 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs podName:1bb2a002-a9ac-4494-b7b1-57d94a96711b nodeName:}" failed. No retries permitted until 2026-06-06 22:03:58.888551349 +0000 UTC m=+66.090778044 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs") pod "network-metrics-daemon-hr9ch" (UID: "1bb2a002-a9ac-4494-b7b1-57d94a96711b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 06 22:03:26.989451 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:26.989411 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:26.989620 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:26.989538 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 06 22:03:26.989620 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:26.989595 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret podName:7ca9bddb-c443-47df-90f0-88b8db74ccd3 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:58.989579976 +0000 UTC m=+66.191806683 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret") pod "global-pull-secret-syncer-44sh9" (UID: "7ca9bddb-c443-47df-90f0-88b8db74ccd3") : object "kube-system"/"original-pull-secret" not registered Jun 06 22:03:27.090143 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.090106 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj8nk\" (UniqueName: \"kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk\") pod \"network-check-target-7k8nh\" (UID: \"cb56d656-beeb-4dc7-a344-8928c6241100\") " pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:27.090314 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:27.090294 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 06 22:03:27.090367 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:27.090319 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 06 22:03:27.090367 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:27.090333 2574 projected.go:196] Error preparing data for projected volume kube-api-access-wj8nk for pod openshift-network-diagnostics/network-check-target-7k8nh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:03:27.090445 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:27.090397 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk podName:cb56d656-beeb-4dc7-a344-8928c6241100 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:59.090378837 +0000 UTC m=+66.292605533 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-wj8nk" (UniqueName: "kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk") pod "network-check-target-7k8nh" (UID: "cb56d656-beeb-4dc7-a344-8928c6241100") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 06 22:03:27.602423 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.602124 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-122.ec2.internal" event="NodeReady" Jun 06 22:03:27.602830 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.602510 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 06 22:03:27.636589 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.636558 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-76fc9b94c-88j4x"] Jun 06 22:03:27.639811 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.639784 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8"] Jun 06 22:03:27.639942 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.639924 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.642336 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.642221 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zzm52\"" Jun 06 22:03:27.642336 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.642221 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 06 22:03:27.642336 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.642320 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 06 22:03:27.642564 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.642305 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 06 22:03:27.642754 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.642737 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9"] Jun 06 22:03:27.642849 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.642822 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:27.644481 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.644442 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 06 22:03:27.644591 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.644516 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 06 22:03:27.644712 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.644694 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 06 22:03:27.644809 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.644794 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 06 22:03:27.647283 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.647235 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4"] Jun 06 22:03:27.647416 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.647386 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.648853 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.648829 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 06 22:03:27.648962 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.648943 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 06 22:03:27.650473 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.649715 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 06 22:03:27.650473 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.650145 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 06 22:03:27.650996 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.650978 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" Jun 06 22:03:27.652572 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.652554 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 06 22:03:27.652782 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.652764 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-nglth\"" Jun 06 22:03:27.652828 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.652794 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 06 22:03:27.657511 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.657483 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8"] Jun 06 22:03:27.659125 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.659102 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dq67q"] Jun 06 22:03:27.662617 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.662205 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9"] Jun 06 22:03:27.662617 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.662238 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76fc9b94c-88j4x"] Jun 06 22:03:27.662617 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.662262 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dr9gv"] Jun 06 22:03:27.662817 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.662785 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.664781 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.664755 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 06 22:03:27.664905 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.664857 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j597l\"" Jun 06 22:03:27.664974 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.664901 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 06 22:03:27.665946 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.665924 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dr9gv" Jun 06 22:03:27.667690 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.667573 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 06 22:03:27.667787 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.667720 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 06 22:03:27.667787 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.667757 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nsrrs\"" Jun 06 22:03:27.667943 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.667798 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 06 22:03:27.668899 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.668882 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4"] Jun 06 22:03:27.672796 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.672775 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dr9gv"] Jun 06 22:03:27.673832 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.673813 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dq67q"] Jun 06 22:03:27.796287 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-image-registry-private-configuration\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.796287 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796289 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34126ddd-d068-4d2b-9072-5bfd10053f72-ca-trust-extracted\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.796526 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796324 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-hub\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.796526 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796380 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffjk6\" (UniqueName: \"kubernetes.io/projected/ea11ebf1-7f7c-433c-b7c2-916388355331-kube-api-access-ffjk6\") pod \"ingress-canary-dr9gv\" (UID: \"ea11ebf1-7f7c-433c-b7c2-916388355331\") " pod="openshift-ingress-canary/ingress-canary-dr9gv" Jun 06 22:03:27.796526 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796432 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-installation-pull-secrets\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.796526 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796469 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.796526 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796485 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-trusted-ca\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.796526 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796504 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws6sx\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-kube-api-access-ws6sx\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.796526 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796527 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa201edc-f138-4084-85d3-a9f9b796008f-klusterlet-config\") pod \"klusterlet-addon-workmgr-58557b7d57-xjdx8\" (UID: \"aa201edc-f138-4084-85d3-a9f9b796008f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:27.796869 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796555 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/292a2731-f6e7-4d94-a447-311c52668733-additional-service-ca\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.796869 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796571 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4a169796-2e0c-4335-901d-5603f7698b8a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-98b95998b-lxzj4\" (UID: \"4a169796-2e0c-4335-901d-5603f7698b8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" Jun 06 22:03:27.796869 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796593 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea11ebf1-7f7c-433c-b7c2-916388355331-cert\") pod \"ingress-canary-dr9gv\" (UID: \"ea11ebf1-7f7c-433c-b7c2-916388355331\") " pod="openshift-ingress-canary/ingress-canary-dr9gv" Jun 06 22:03:27.796869 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-certificates\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.796869 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796704 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.796869 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-ca\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.796869 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796798 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-bound-sa-token\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.796869 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br5fq\" (UniqueName: \"kubernetes.io/projected/aa201edc-f138-4084-85d3-a9f9b796008f-kube-api-access-br5fq\") pod \"klusterlet-addon-workmgr-58557b7d57-xjdx8\" (UID: \"aa201edc-f138-4084-85d3-a9f9b796008f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:27.797240 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796878 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.797240 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796901 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa201edc-f138-4084-85d3-a9f9b796008f-tmp\") pod \"klusterlet-addon-workmgr-58557b7d57-xjdx8\" (UID: \"aa201edc-f138-4084-85d3-a9f9b796008f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:27.797240 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796926 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3225a74-e305-445e-aa91-2002863b6d73-config-volume\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.797240 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796952 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.797240 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.796980 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb54p\" (UniqueName: \"kubernetes.io/projected/d3225a74-e305-445e-aa91-2002863b6d73-kube-api-access-bb54p\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.797240 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.797010 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xjq5\" (UniqueName: \"kubernetes.io/projected/4a169796-2e0c-4335-901d-5603f7698b8a-kube-api-access-4xjq5\") pod \"managed-serviceaccount-addon-agent-98b95998b-lxzj4\" (UID: \"4a169796-2e0c-4335-901d-5603f7698b8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" Jun 06 22:03:27.797240 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.797045 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mllz7\" (UniqueName: \"kubernetes.io/projected/292a2731-f6e7-4d94-a447-311c52668733-kube-api-access-mllz7\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.797240 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.797092 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3225a74-e305-445e-aa91-2002863b6d73-tmp-dir\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.898263 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898164 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-ca\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.898263 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-bound-sa-token\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.898263 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br5fq\" (UniqueName: \"kubernetes.io/projected/aa201edc-f138-4084-85d3-a9f9b796008f-kube-api-access-br5fq\") pod \"klusterlet-addon-workmgr-58557b7d57-xjdx8\" (UID: \"aa201edc-f138-4084-85d3-a9f9b796008f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898282 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898301 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa201edc-f138-4084-85d3-a9f9b796008f-tmp\") pod \"klusterlet-addon-workmgr-58557b7d57-xjdx8\" (UID: \"aa201edc-f138-4084-85d3-a9f9b796008f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898316 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3225a74-e305-445e-aa91-2002863b6d73-config-volume\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898335 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb54p\" (UniqueName: \"kubernetes.io/projected/d3225a74-e305-445e-aa91-2002863b6d73-kube-api-access-bb54p\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xjq5\" (UniqueName: \"kubernetes.io/projected/4a169796-2e0c-4335-901d-5603f7698b8a-kube-api-access-4xjq5\") pod \"managed-serviceaccount-addon-agent-98b95998b-lxzj4\" (UID: \"4a169796-2e0c-4335-901d-5603f7698b8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:27.898412 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898424 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mllz7\" (UniqueName: \"kubernetes.io/projected/292a2731-f6e7-4d94-a447-311c52668733-kube-api-access-mllz7\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:27.898433 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fc9b94c-88j4x: secret "image-registry-tls" not found Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898446 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3225a74-e305-445e-aa91-2002863b6d73-tmp-dir\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-image-registry-private-configuration\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.898547 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:27.898500 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls podName:34126ddd-d068-4d2b-9072-5bfd10053f72 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:28.398479745 +0000 UTC m=+35.600706457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls") pod "image-registry-76fc9b94c-88j4x" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72") : secret "image-registry-tls" not found Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34126ddd-d068-4d2b-9072-5bfd10053f72-ca-trust-extracted\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898760 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-hub\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898784 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffjk6\" (UniqueName: \"kubernetes.io/projected/ea11ebf1-7f7c-433c-b7c2-916388355331-kube-api-access-ffjk6\") pod \"ingress-canary-dr9gv\" (UID: \"ea11ebf1-7f7c-433c-b7c2-916388355331\") " pod="openshift-ingress-canary/ingress-canary-dr9gv" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898806 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-installation-pull-secrets\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898829 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa201edc-f138-4084-85d3-a9f9b796008f-tmp\") pod \"klusterlet-addon-workmgr-58557b7d57-xjdx8\" (UID: \"aa201edc-f138-4084-85d3-a9f9b796008f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898836 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898861 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-trusted-ca\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898885 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws6sx\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-kube-api-access-ws6sx\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898910 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa201edc-f138-4084-85d3-a9f9b796008f-klusterlet-config\") pod \"klusterlet-addon-workmgr-58557b7d57-xjdx8\" (UID: \"aa201edc-f138-4084-85d3-a9f9b796008f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898923 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3225a74-e305-445e-aa91-2002863b6d73-tmp-dir\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.898970 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/292a2731-f6e7-4d94-a447-311c52668733-additional-service-ca\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.899002 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4a169796-2e0c-4335-901d-5603f7698b8a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-98b95998b-lxzj4\" (UID: \"4a169796-2e0c-4335-901d-5603f7698b8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.899027 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea11ebf1-7f7c-433c-b7c2-916388355331-cert\") pod \"ingress-canary-dr9gv\" (UID: \"ea11ebf1-7f7c-433c-b7c2-916388355331\") " pod="openshift-ingress-canary/ingress-canary-dr9gv" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.899097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-certificates\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.899100 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3225a74-e305-445e-aa91-2002863b6d73-config-volume\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.899198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.899124 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.899998 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:27.899239 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 22:03:27.899998 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:27.899287 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls podName:d3225a74-e305-445e-aa91-2002863b6d73 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:28.399271751 +0000 UTC m=+35.601498447 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls") pod "dns-default-dq67q" (UID: "d3225a74-e305-445e-aa91-2002863b6d73") : secret "dns-default-metrics-tls" not found Jun 06 22:03:27.899998 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.899430 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34126ddd-d068-4d2b-9072-5bfd10053f72-ca-trust-extracted\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.899998 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.899945 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/292a2731-f6e7-4d94-a447-311c52668733-additional-service-ca\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.901695 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.900464 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-certificates\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.901695 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.901373 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-trusted-ca\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.904058 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.903947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-ca\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.904058 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.903970 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.904058 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.904049 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/aa201edc-f138-4084-85d3-a9f9b796008f-klusterlet-config\") pod \"klusterlet-addon-workmgr-58557b7d57-xjdx8\" (UID: \"aa201edc-f138-4084-85d3-a9f9b796008f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:27.904311 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.904108 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-image-registry-private-configuration\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.904311 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.904115 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.904486 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.904460 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/292a2731-f6e7-4d94-a447-311c52668733-hub\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.905101 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.904691 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ea11ebf1-7f7c-433c-b7c2-916388355331-cert\") pod \"ingress-canary-dr9gv\" (UID: \"ea11ebf1-7f7c-433c-b7c2-916388355331\") " pod="openshift-ingress-canary/ingress-canary-dr9gv" Jun 06 22:03:27.905101 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.905060 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4a169796-2e0c-4335-901d-5603f7698b8a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-98b95998b-lxzj4\" (UID: \"4a169796-2e0c-4335-901d-5603f7698b8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" Jun 06 22:03:27.906605 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.906555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-installation-pull-secrets\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.907565 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.907517 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-br5fq\" (UniqueName: \"kubernetes.io/projected/aa201edc-f138-4084-85d3-a9f9b796008f-kube-api-access-br5fq\") pod \"klusterlet-addon-workmgr-58557b7d57-xjdx8\" (UID: \"aa201edc-f138-4084-85d3-a9f9b796008f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:27.908216 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.908172 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb54p\" (UniqueName: \"kubernetes.io/projected/d3225a74-e305-445e-aa91-2002863b6d73-kube-api-access-bb54p\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:27.908660 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.908614 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffjk6\" (UniqueName: \"kubernetes.io/projected/ea11ebf1-7f7c-433c-b7c2-916388355331-kube-api-access-ffjk6\") pod \"ingress-canary-dr9gv\" (UID: \"ea11ebf1-7f7c-433c-b7c2-916388355331\") " pod="openshift-ingress-canary/ingress-canary-dr9gv" Jun 06 22:03:27.908931 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.908884 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xjq5\" (UniqueName: \"kubernetes.io/projected/4a169796-2e0c-4335-901d-5603f7698b8a-kube-api-access-4xjq5\") pod \"managed-serviceaccount-addon-agent-98b95998b-lxzj4\" (UID: \"4a169796-2e0c-4335-901d-5603f7698b8a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" Jun 06 22:03:27.909600 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.909555 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mllz7\" (UniqueName: \"kubernetes.io/projected/292a2731-f6e7-4d94-a447-311c52668733-kube-api-access-mllz7\") pod \"cluster-proxy-proxy-agent-699d8d6874-mshj9\" (UID: \"292a2731-f6e7-4d94-a447-311c52668733\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.910000 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.909976 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-bound-sa-token\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.911801 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.911778 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws6sx\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-kube-api-access-ws6sx\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:27.965806 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.965763 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:27.984988 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.984957 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:03:27.992123 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:27.992050 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" Jun 06 22:03:28.019566 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.019537 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dr9gv" Jun 06 22:03:28.202059 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.201944 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:28.202059 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.201995 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:28.202059 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.201995 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:28.204190 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.203963 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 22:03:28.204190 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.203977 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d4tj5\"" Jun 06 22:03:28.204190 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.203990 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 22:03:28.204190 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.204037 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ksb8v\"" Jun 06 22:03:28.204190 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.203964 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 22:03:28.204190 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.204111 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 22:03:28.403574 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.403542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:28.403768 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:28.403648 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:28.403768 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:28.403709 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 22:03:28.403768 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:28.403731 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fc9b94c-88j4x: secret "image-registry-tls" not found Jun 06 22:03:28.403906 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:28.403773 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 22:03:28.403906 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:28.403786 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls podName:34126ddd-d068-4d2b-9072-5bfd10053f72 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:29.403771424 +0000 UTC m=+36.605998118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls") pod "image-registry-76fc9b94c-88j4x" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72") : secret "image-registry-tls" not found Jun 06 22:03:28.403906 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:28.403835 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls podName:d3225a74-e305-445e-aa91-2002863b6d73 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:29.403818248 +0000 UTC m=+36.606044945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls") pod "dns-default-dq67q" (UID: "d3225a74-e305-445e-aa91-2002863b6d73") : secret "dns-default-metrics-tls" not found Jun 06 22:03:29.262723 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.262678 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4"] Jun 06 22:03:29.266433 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.266407 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9"] Jun 06 22:03:29.271149 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:03:29.271118 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a169796_2e0c_4335_901d_5603f7698b8a.slice/crio-42d7231d2f39dbbe26993883abbe85949ddb337a3f8734bcd88e4e5f90c54cc2 WatchSource:0}: Error finding container 42d7231d2f39dbbe26993883abbe85949ddb337a3f8734bcd88e4e5f90c54cc2: Status 404 returned error can't find the container with id 42d7231d2f39dbbe26993883abbe85949ddb337a3f8734bcd88e4e5f90c54cc2 Jun 06 22:03:29.271443 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:03:29.271414 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod292a2731_f6e7_4d94_a447_311c52668733.slice/crio-72c858959c3bfc223f9311a1d8ff5c62ced0affb96f39303a0bb068429704a77 WatchSource:0}: Error finding container 72c858959c3bfc223f9311a1d8ff5c62ced0affb96f39303a0bb068429704a77: Status 404 returned error can't find the container with id 72c858959c3bfc223f9311a1d8ff5c62ced0affb96f39303a0bb068429704a77 Jun 06 22:03:29.280377 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.277995 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dr9gv"] Jun 06 22:03:29.280377 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.278282 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8"] Jun 06 22:03:29.281447 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:03:29.281403 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa201edc_f138_4084_85d3_a9f9b796008f.slice/crio-54bf9b1a739791e34f80d0df0d9a318876fc92b75914ca9ae3b3c80f0c216e1d WatchSource:0}: Error finding container 54bf9b1a739791e34f80d0df0d9a318876fc92b75914ca9ae3b3c80f0c216e1d: Status 404 returned error can't find the container with id 54bf9b1a739791e34f80d0df0d9a318876fc92b75914ca9ae3b3c80f0c216e1d Jun 06 22:03:29.282576 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:03:29.282550 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea11ebf1_7f7c_433c_b7c2_916388355331.slice/crio-5f544d09684d5fc25b30fb7e4866409593235924b8abb817fd95f1dea671b1cc WatchSource:0}: Error finding container 5f544d09684d5fc25b30fb7e4866409593235924b8abb817fd95f1dea671b1cc: Status 404 returned error can't find the container with id 5f544d09684d5fc25b30fb7e4866409593235924b8abb817fd95f1dea671b1cc Jun 06 22:03:29.411197 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.411171 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:29.411298 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.411226 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:29.411340 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:29.411320 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 22:03:29.411340 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:29.411336 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fc9b94c-88j4x: secret "image-registry-tls" not found Jun 06 22:03:29.411406 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:29.411382 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls podName:34126ddd-d068-4d2b-9072-5bfd10053f72 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:31.411368707 +0000 UTC m=+38.613595402 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls") pod "image-registry-76fc9b94c-88j4x" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72") : secret "image-registry-tls" not found Jun 06 22:03:29.411406 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:29.411320 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 22:03:29.411480 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:29.411457 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls podName:d3225a74-e305-445e-aa91-2002863b6d73 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:31.411441071 +0000 UTC m=+38.613667768 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls") pod "dns-default-dq67q" (UID: "d3225a74-e305-445e-aa91-2002863b6d73") : secret "dns-default-metrics-tls" not found Jun 06 22:03:29.446534 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.446343 2574 generic.go:356] "Generic (PLEG): container finished" podID="045a17d2-a35c-4d79-a9b5-93ab54128d08" containerID="988673a26e813d46f9ceb252fa14bbab68d33e47d89040a4f84738576eab0aac" exitCode=0 Jun 06 22:03:29.446745 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.446424 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9fww" event={"ID":"045a17d2-a35c-4d79-a9b5-93ab54128d08","Type":"ContainerDied","Data":"988673a26e813d46f9ceb252fa14bbab68d33e47d89040a4f84738576eab0aac"} Jun 06 22:03:29.447753 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.447728 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dr9gv" event={"ID":"ea11ebf1-7f7c-433c-b7c2-916388355331","Type":"ContainerStarted","Data":"5f544d09684d5fc25b30fb7e4866409593235924b8abb817fd95f1dea671b1cc"} Jun 06 22:03:29.448854 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.448830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" event={"ID":"4a169796-2e0c-4335-901d-5603f7698b8a","Type":"ContainerStarted","Data":"42d7231d2f39dbbe26993883abbe85949ddb337a3f8734bcd88e4e5f90c54cc2"} Jun 06 22:03:29.449961 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.449934 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" event={"ID":"292a2731-f6e7-4d94-a447-311c52668733","Type":"ContainerStarted","Data":"72c858959c3bfc223f9311a1d8ff5c62ced0affb96f39303a0bb068429704a77"} Jun 06 22:03:29.451013 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:29.450988 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" event={"ID":"aa201edc-f138-4084-85d3-a9f9b796008f","Type":"ContainerStarted","Data":"54bf9b1a739791e34f80d0df0d9a318876fc92b75914ca9ae3b3c80f0c216e1d"} Jun 06 22:03:30.461961 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:30.461870 2574 generic.go:356] "Generic (PLEG): container finished" podID="045a17d2-a35c-4d79-a9b5-93ab54128d08" containerID="86eec38e8af94eb4dee0e62ea750007a9636fb36f60de75843acaebce411dd6c" exitCode=0 Jun 06 22:03:30.461961 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:30.461945 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9fww" event={"ID":"045a17d2-a35c-4d79-a9b5-93ab54128d08","Type":"ContainerDied","Data":"86eec38e8af94eb4dee0e62ea750007a9636fb36f60de75843acaebce411dd6c"} Jun 06 22:03:31.430472 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:31.429665 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:31.430472 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:31.429746 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:31.430472 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:31.429879 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 22:03:31.430472 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:31.429895 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fc9b94c-88j4x: secret "image-registry-tls" not found Jun 06 22:03:31.430472 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:31.429956 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls podName:34126ddd-d068-4d2b-9072-5bfd10053f72 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:35.429936154 +0000 UTC m=+42.632162873 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls") pod "image-registry-76fc9b94c-88j4x" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72") : secret "image-registry-tls" not found Jun 06 22:03:31.430472 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:31.430380 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 22:03:31.430472 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:31.430434 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls podName:d3225a74-e305-445e-aa91-2002863b6d73 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:35.430418875 +0000 UTC m=+42.632645575 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls") pod "dns-default-dq67q" (UID: "d3225a74-e305-445e-aa91-2002863b6d73") : secret "dns-default-metrics-tls" not found Jun 06 22:03:31.475510 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:31.475346 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-q9fww" event={"ID":"045a17d2-a35c-4d79-a9b5-93ab54128d08","Type":"ContainerStarted","Data":"ea2d043612014f2add9e467e24007b2bc1971f7bfe8d04bb9e0e25c7f692ce49"} Jun 06 22:03:31.495818 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:31.495480 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-q9fww" podStartSLOduration=8.835346524 podStartE2EDuration="38.495459222s" totalImagesPullingTime="29.660112698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:31.494399734 +0000 UTC m=+38.696626452" watchObservedRunningTime="2026-06-06 22:03:31.495459222 +0000 UTC m=+38.697685942" Jun 06 22:03:35.469231 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:35.469191 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:35.469864 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:35.469264 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:35.469864 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:35.469370 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 22:03:35.469864 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:35.469423 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 22:03:35.469864 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:35.469443 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fc9b94c-88j4x: secret "image-registry-tls" not found Jun 06 22:03:35.469864 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:35.469450 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls podName:d3225a74-e305-445e-aa91-2002863b6d73 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:43.4694289 +0000 UTC m=+50.671655597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls") pod "dns-default-dq67q" (UID: "d3225a74-e305-445e-aa91-2002863b6d73") : secret "dns-default-metrics-tls" not found Jun 06 22:03:35.469864 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:35.469492 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls podName:34126ddd-d068-4d2b-9072-5bfd10053f72 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:43.469476792 +0000 UTC m=+50.671703510 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls") pod "image-registry-76fc9b94c-88j4x" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72") : secret "image-registry-tls" not found Jun 06 22:03:37.494779 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.494739 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dr9gv" event={"ID":"ea11ebf1-7f7c-433c-b7c2-916388355331","Type":"ContainerStarted","Data":"0bd8e4e6b0a403e81b78bb19e1c833c35e767f0b249708b501502ddaeeff9522"} Jun 06 22:03:37.496193 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.496168 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" event={"ID":"4a169796-2e0c-4335-901d-5603f7698b8a","Type":"ContainerStarted","Data":"944b7768b459c566189d4bd504506464f6e49c20224184fcca1756a8f99adaa3"} Jun 06 22:03:37.498118 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.498094 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" event={"ID":"292a2731-f6e7-4d94-a447-311c52668733","Type":"ContainerStarted","Data":"9ff95141e648e28edc88a340a0383dcfe8d97fa2909ae90d5f01d21d466cad5f"} Jun 06 22:03:37.498211 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.498126 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" event={"ID":"292a2731-f6e7-4d94-a447-311c52668733","Type":"ContainerStarted","Data":"0c7804ae8de321a70507f531844a7aa70ad2ce82b7c55b12be7155eaab022e82"} Jun 06 22:03:37.498211 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.498142 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" event={"ID":"292a2731-f6e7-4d94-a447-311c52668733","Type":"ContainerStarted","Data":"089d4306333911dbdfb6a597f833851eb6d225137fd7dd0e27f6352e7cbbd11d"} Jun 06 22:03:37.499374 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.499346 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" event={"ID":"aa201edc-f138-4084-85d3-a9f9b796008f","Type":"ContainerStarted","Data":"088161a5c5192fb739d58aa914fd47106d61c6954b4e9ee039711dd041c7b0a2"} Jun 06 22:03:37.499565 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.499548 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:37.501261 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.501246 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:03:37.511022 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.510984 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dr9gv" podStartSLOduration=3.279416 podStartE2EDuration="10.510972911s" totalImagesPullingTime="7.231556911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:37.510230903 +0000 UTC m=+44.712457620" watchObservedRunningTime="2026-06-06 22:03:37.510972911 +0000 UTC m=+44.713199625" Jun 06 22:03:37.526594 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.526546 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" podStartSLOduration=32.268013127 podStartE2EDuration="39.526528418s" totalImagesPullingTime="7.258515291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:37.525889436 +0000 UTC m=+44.728116154" watchObservedRunningTime="2026-06-06 22:03:37.526528418 +0000 UTC m=+44.728755136" Jun 06 22:03:37.540561 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.540518 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" podStartSLOduration=32.288053175 podStartE2EDuration="39.540501437s" totalImagesPullingTime="7.252448262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:37.539842081 +0000 UTC m=+44.742068800" watchObservedRunningTime="2026-06-06 22:03:37.540501437 +0000 UTC m=+44.742728155" Jun 06 22:03:37.553485 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:37.553423 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" podStartSLOduration=32.302880784 podStartE2EDuration="39.553404689s" totalImagesPullingTime="7.250523905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:03:37.553138306 +0000 UTC m=+44.755365022" watchObservedRunningTime="2026-06-06 22:03:37.553404689 +0000 UTC m=+44.755631407" Jun 06 22:03:43.528162 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:43.528126 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:43.528719 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:43.528271 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:43.528719 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:43.528279 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 22:03:43.528719 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:43.528300 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fc9b94c-88j4x: secret "image-registry-tls" not found Jun 06 22:03:43.528719 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:43.528366 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 22:03:43.528719 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:43.528369 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls podName:34126ddd-d068-4d2b-9072-5bfd10053f72 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:59.528349776 +0000 UTC m=+66.730576472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls") pod "image-registry-76fc9b94c-88j4x" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72") : secret "image-registry-tls" not found Jun 06 22:03:43.528719 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:43.528421 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls podName:d3225a74-e305-445e-aa91-2002863b6d73 nodeName:}" failed. No retries permitted until 2026-06-06 22:03:59.528409818 +0000 UTC m=+66.730636513 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls") pod "dns-default-dq67q" (UID: "d3225a74-e305-445e-aa91-2002863b6d73") : secret "dns-default-metrics-tls" not found Jun 06 22:03:53.436345 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:53.436316 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d7rct" Jun 06 22:03:58.942443 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:58.942394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:03:58.944579 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:58.944558 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 06 22:03:58.952992 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:58.952973 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 22:03:58.953055 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:58.953039 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs podName:1bb2a002-a9ac-4494-b7b1-57d94a96711b nodeName:}" failed. No retries permitted until 2026-06-06 22:05:02.953023137 +0000 UTC m=+130.155249831 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs") pod "network-metrics-daemon-hr9ch" (UID: "1bb2a002-a9ac-4494-b7b1-57d94a96711b") : secret "metrics-daemon-secret" not found Jun 06 22:03:59.042812 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.042777 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:59.045021 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.045003 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 06 22:03:59.056445 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.056414 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/7ca9bddb-c443-47df-90f0-88b8db74ccd3-original-pull-secret\") pod \"global-pull-secret-syncer-44sh9\" (UID: \"7ca9bddb-c443-47df-90f0-88b8db74ccd3\") " pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:59.121477 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.121440 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-44sh9" Jun 06 22:03:59.144301 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.144270 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wj8nk\" (UniqueName: \"kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk\") pod \"network-check-target-7k8nh\" (UID: \"cb56d656-beeb-4dc7-a344-8928c6241100\") " pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:59.146773 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.146750 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 06 22:03:59.157264 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.157237 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 06 22:03:59.170231 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.170169 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wj8nk\" (UniqueName: \"kubernetes.io/projected/cb56d656-beeb-4dc7-a344-8928c6241100-kube-api-access-wj8nk\") pod \"network-check-target-7k8nh\" (UID: \"cb56d656-beeb-4dc7-a344-8928c6241100\") " pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:59.248854 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.248821 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-44sh9"] Jun 06 22:03:59.251861 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:03:59.251816 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca9bddb_c443_47df_90f0_88b8db74ccd3.slice/crio-e90cac5444f870718ee879aeed0b5f1d00004a154fe2cbf50cbac554b73c615e WatchSource:0}: Error finding container e90cac5444f870718ee879aeed0b5f1d00004a154fe2cbf50cbac554b73c615e: Status 404 returned error can't find the container with id e90cac5444f870718ee879aeed0b5f1d00004a154fe2cbf50cbac554b73c615e Jun 06 22:03:59.428422 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.428389 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ksb8v\"" Jun 06 22:03:59.437388 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.437367 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:03:59.547851 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.547818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:03:59.547998 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.547865 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:03:59.547998 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:59.547969 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 22:03:59.547998 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:59.547983 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fc9b94c-88j4x: secret "image-registry-tls" not found Jun 06 22:03:59.547998 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:59.547989 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 22:03:59.548161 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:59.548042 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls podName:34126ddd-d068-4d2b-9072-5bfd10053f72 nodeName:}" failed. No retries permitted until 2026-06-06 22:04:31.548019418 +0000 UTC m=+98.750246112 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls") pod "image-registry-76fc9b94c-88j4x" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72") : secret "image-registry-tls" not found Jun 06 22:03:59.548161 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:03:59.548109 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls podName:d3225a74-e305-445e-aa91-2002863b6d73 nodeName:}" failed. No retries permitted until 2026-06-06 22:04:31.548090588 +0000 UTC m=+98.750317287 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls") pod "dns-default-dq67q" (UID: "d3225a74-e305-445e-aa91-2002863b6d73") : secret "dns-default-metrics-tls" not found Jun 06 22:03:59.559649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.559625 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7k8nh"] Jun 06 22:03:59.562854 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:03:59.562830 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb56d656_beeb_4dc7_a344_8928c6241100.slice/crio-254aed557a250918e7b1bb3c30dde5f292ec79a93d4c11b6b117b5b1e4724f00 WatchSource:0}: Error finding container 254aed557a250918e7b1bb3c30dde5f292ec79a93d4c11b6b117b5b1e4724f00: Status 404 returned error can't find the container with id 254aed557a250918e7b1bb3c30dde5f292ec79a93d4c11b6b117b5b1e4724f00 Jun 06 22:03:59.567157 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.567131 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-44sh9" event={"ID":"7ca9bddb-c443-47df-90f0-88b8db74ccd3","Type":"ContainerStarted","Data":"e90cac5444f870718ee879aeed0b5f1d00004a154fe2cbf50cbac554b73c615e"} Jun 06 22:03:59.568144 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:03:59.568123 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7k8nh" event={"ID":"cb56d656-beeb-4dc7-a344-8928c6241100","Type":"ContainerStarted","Data":"254aed557a250918e7b1bb3c30dde5f292ec79a93d4c11b6b117b5b1e4724f00"} Jun 06 22:04:04.585742 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:04:04.585702 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-44sh9" event={"ID":"7ca9bddb-c443-47df-90f0-88b8db74ccd3","Type":"ContainerStarted","Data":"2dde91ba194a4d83f4f0b580ea88c9c7ed47d336258f5396dc8a6add1da4fa2f"} Jun 06 22:04:04.587244 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:04:04.587224 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7k8nh" event={"ID":"cb56d656-beeb-4dc7-a344-8928c6241100","Type":"ContainerStarted","Data":"e0ab20725aee1d10a717dfe61921e502c945ffe3c79133e6bd0e0c42557a3f65"} Jun 06 22:04:04.587370 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:04:04.587351 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:04:04.598806 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:04:04.598756 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-44sh9" podStartSLOduration=67.096436581 podStartE2EDuration="1m11.598740858s" totalImagesPullingTime="4.502304277s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:04:04.597935129 +0000 UTC m=+71.800161845" watchObservedRunningTime="2026-06-06 22:04:04.598740858 +0000 UTC m=+71.800967576" Jun 06 22:04:04.610488 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:04:04.610421 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7k8nh" podStartSLOduration=67.424005363 podStartE2EDuration="1m11.610405728s" totalImagesPullingTime="4.186400365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:04:04.610401242 +0000 UTC m=+71.812627960" watchObservedRunningTime="2026-06-06 22:04:04.610405728 +0000 UTC m=+71.812632445" Jun 06 22:04:31.585130 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:04:31.585088 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:04:31.585649 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:04:31.585148 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:04:31.585649 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:04:31.585239 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 22:04:31.585649 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:04:31.585264 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 22:04:31.585649 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:04:31.585281 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fc9b94c-88j4x: secret "image-registry-tls" not found Jun 06 22:04:31.585649 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:04:31.585310 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls podName:d3225a74-e305-445e-aa91-2002863b6d73 nodeName:}" failed. No retries permitted until 2026-06-06 22:05:35.585291267 +0000 UTC m=+162.787517966 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls") pod "dns-default-dq67q" (UID: "d3225a74-e305-445e-aa91-2002863b6d73") : secret "dns-default-metrics-tls" not found Jun 06 22:04:31.585649 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:04:31.585325 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls podName:34126ddd-d068-4d2b-9072-5bfd10053f72 nodeName:}" failed. No retries permitted until 2026-06-06 22:05:35.585319497 +0000 UTC m=+162.787546191 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls") pod "image-registry-76fc9b94c-88j4x" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72") : secret "image-registry-tls" not found Jun 06 22:04:35.592691 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:04:35.592662 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7k8nh" Jun 06 22:05:03.005644 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:03.005602 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:05:03.006159 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:05:03.005729 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 06 22:05:03.006159 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:05:03.005785 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs podName:1bb2a002-a9ac-4494-b7b1-57d94a96711b nodeName:}" failed. No retries permitted until 2026-06-06 22:07:05.005770894 +0000 UTC m=+252.207997591 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs") pod "network-metrics-daemon-hr9ch" (UID: "1bb2a002-a9ac-4494-b7b1-57d94a96711b") : secret "metrics-daemon-secret" not found Jun 06 22:05:30.656803 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:05:30.656743 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" podUID="34126ddd-d068-4d2b-9072-5bfd10053f72" Jun 06 22:05:30.713329 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:05:30.713275 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dq67q" podUID="d3225a74-e305-445e-aa91-2002863b6d73" Jun 06 22:05:30.839367 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:30.839332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dq67q" Jun 06 22:05:30.839563 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:30.839332 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:05:31.213427 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:05:31.213393 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-hr9ch" podUID="1bb2a002-a9ac-4494-b7b1-57d94a96711b" Jun 06 22:05:35.637437 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:35.637381 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:05:35.637854 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:35.637477 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:05:35.637854 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:05:35.637534 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 06 22:05:35.637854 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:05:35.637553 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-76fc9b94c-88j4x: secret "image-registry-tls" not found Jun 06 22:05:35.637854 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:05:35.637568 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 06 22:05:35.637854 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:05:35.637629 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls podName:34126ddd-d068-4d2b-9072-5bfd10053f72 nodeName:}" failed. No retries permitted until 2026-06-06 22:07:37.637611472 +0000 UTC m=+284.839838170 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls") pod "image-registry-76fc9b94c-88j4x" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72") : secret "image-registry-tls" not found Jun 06 22:05:35.637854 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:05:35.637642 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls podName:d3225a74-e305-445e-aa91-2002863b6d73 nodeName:}" failed. No retries permitted until 2026-06-06 22:07:37.637636404 +0000 UTC m=+284.839863099 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls") pod "dns-default-dq67q" (UID: "d3225a74-e305-445e-aa91-2002863b6d73") : secret "dns-default-metrics-tls" not found Jun 06 22:05:36.859936 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:36.859902 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a169796-2e0c-4335-901d-5603f7698b8a" containerID="944b7768b459c566189d4bd504506464f6e49c20224184fcca1756a8f99adaa3" exitCode=255 Jun 06 22:05:36.860417 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:36.859975 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" event={"ID":"4a169796-2e0c-4335-901d-5603f7698b8a","Type":"ContainerDied","Data":"944b7768b459c566189d4bd504506464f6e49c20224184fcca1756a8f99adaa3"} Jun 06 22:05:36.860417 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:36.860353 2574 scope.go:117] "RemoveContainer" containerID="944b7768b459c566189d4bd504506464f6e49c20224184fcca1756a8f99adaa3" Jun 06 22:05:36.861440 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:36.861416 2574 generic.go:356] "Generic (PLEG): container finished" podID="aa201edc-f138-4084-85d3-a9f9b796008f" containerID="088161a5c5192fb739d58aa914fd47106d61c6954b4e9ee039711dd041c7b0a2" exitCode=1 Jun 06 22:05:36.861526 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:36.861442 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" event={"ID":"aa201edc-f138-4084-85d3-a9f9b796008f","Type":"ContainerDied","Data":"088161a5c5192fb739d58aa914fd47106d61c6954b4e9ee039711dd041c7b0a2"} Jun 06 22:05:36.861732 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:36.861717 2574 scope.go:117] "RemoveContainer" containerID="088161a5c5192fb739d58aa914fd47106d61c6954b4e9ee039711dd041c7b0a2" Jun 06 22:05:37.500117 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:37.500022 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:05:37.865659 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:37.865625 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" event={"ID":"4a169796-2e0c-4335-901d-5603f7698b8a","Type":"ContainerStarted","Data":"cf39e5075a82d826da6d0b872468cfe5949115af380c5bc2abbdca319f2ea73f"} Jun 06 22:05:37.867331 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:37.867300 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" event={"ID":"aa201edc-f138-4084-85d3-a9f9b796008f","Type":"ContainerStarted","Data":"5a27d7f3cf8e8ec5b3845695fa28a7cb8aa5246ad65c716f546277ec1c6795e7"} Jun 06 22:05:37.867488 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:37.867473 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:05:37.868056 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:37.868039 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:05:43.202999 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:05:43.202917 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:06:20.076738 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:20.076711 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x87wj_b12f3564-b124-43da-a185-597650b9b6f7/dns-node-resolver/0.log" Jun 06 22:06:20.676848 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:20.676821 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pmp7g_b18ed7df-bfef-43ca-af32-7693909a4d7f/node-ca/0.log" Jun 06 22:06:21.480385 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:21.480361 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dr9gv_ea11ebf1-7f7c-433c-b7c2-916388355331/serve-healthcheck-canary/0.log" Jun 06 22:06:39.755781 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.755746 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2d5c2"] Jun 06 22:06:39.758905 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.758879 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.761417 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.761396 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 06 22:06:39.761550 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.761430 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 06 22:06:39.761550 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.761401 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-vjws4\"" Jun 06 22:06:39.761550 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.761431 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 06 22:06:39.761550 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.761400 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 06 22:06:39.768961 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.768941 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2d5c2"] Jun 06 22:06:39.805380 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.805349 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d18be130-ada4-484f-b0e7-8a80c2d46fee-crio-socket\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.805560 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.805393 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmfw5\" (UniqueName: \"kubernetes.io/projected/d18be130-ada4-484f-b0e7-8a80c2d46fee-kube-api-access-kmfw5\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.805560 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.805468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d18be130-ada4-484f-b0e7-8a80c2d46fee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.805677 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.805560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d18be130-ada4-484f-b0e7-8a80c2d46fee-data-volume\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.805677 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.805602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d18be130-ada4-484f-b0e7-8a80c2d46fee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.906820 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.906785 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d18be130-ada4-484f-b0e7-8a80c2d46fee-crio-socket\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.907014 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.906833 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmfw5\" (UniqueName: \"kubernetes.io/projected/d18be130-ada4-484f-b0e7-8a80c2d46fee-kube-api-access-kmfw5\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.907014 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.906870 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d18be130-ada4-484f-b0e7-8a80c2d46fee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.907014 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.906889 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d18be130-ada4-484f-b0e7-8a80c2d46fee-data-volume\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.907014 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.906915 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d18be130-ada4-484f-b0e7-8a80c2d46fee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.907014 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.906935 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d18be130-ada4-484f-b0e7-8a80c2d46fee-crio-socket\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.907374 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.907353 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d18be130-ada4-484f-b0e7-8a80c2d46fee-data-volume\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.907565 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.907550 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d18be130-ada4-484f-b0e7-8a80c2d46fee-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.909139 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.909121 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d18be130-ada4-484f-b0e7-8a80c2d46fee-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:39.923186 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:39.923157 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmfw5\" (UniqueName: \"kubernetes.io/projected/d18be130-ada4-484f-b0e7-8a80c2d46fee-kube-api-access-kmfw5\") pod \"insights-runtime-extractor-2d5c2\" (UID: \"d18be130-ada4-484f-b0e7-8a80c2d46fee\") " pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:40.067709 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:40.067679 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2d5c2" Jun 06 22:06:40.192811 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:40.192765 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2d5c2"] Jun 06 22:06:40.197016 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:06:40.196987 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd18be130_ada4_484f_b0e7_8a80c2d46fee.slice/crio-4040dd248991eabc31655f80e200b2b74a0a99dd50c3b5e4f6b31da1a29178c5 WatchSource:0}: Error finding container 4040dd248991eabc31655f80e200b2b74a0a99dd50c3b5e4f6b31da1a29178c5: Status 404 returned error can't find the container with id 4040dd248991eabc31655f80e200b2b74a0a99dd50c3b5e4f6b31da1a29178c5 Jun 06 22:06:41.057552 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:41.057506 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2d5c2" event={"ID":"d18be130-ada4-484f-b0e7-8a80c2d46fee","Type":"ContainerStarted","Data":"7b7fdf247413f9f2f46b95063ff2cfabd4fcaa2f70d1da2804a6179194d25018"} Jun 06 22:06:41.057925 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:41.057568 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2d5c2" event={"ID":"d18be130-ada4-484f-b0e7-8a80c2d46fee","Type":"ContainerStarted","Data":"ebc361e6fbf6628f84da1124e0070df961f1c1a31508d447f01e8efc02b73d93"} Jun 06 22:06:41.057925 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:41.057587 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2d5c2" event={"ID":"d18be130-ada4-484f-b0e7-8a80c2d46fee","Type":"ContainerStarted","Data":"4040dd248991eabc31655f80e200b2b74a0a99dd50c3b5e4f6b31da1a29178c5"} Jun 06 22:06:43.069289 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:43.069258 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2d5c2" event={"ID":"d18be130-ada4-484f-b0e7-8a80c2d46fee","Type":"ContainerStarted","Data":"7214da58e5d59e8ed6cd96ed349a4305d2324a20c44b88843f97ab8f59ea204f"} Jun 06 22:06:43.084570 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:43.084528 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2d5c2" podStartSLOduration=2.10754524 podStartE2EDuration="4.084514129s" totalImagesPullingTime="1.976968889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:06:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:06:43.083766306 +0000 UTC m=+230.285993024" watchObservedRunningTime="2026-06-06 22:06:43.084514129 +0000 UTC m=+230.286740846" Jun 06 22:06:55.894342 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.894310 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-5fvkv"] Jun 06 22:06:55.897540 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.897516 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:55.899342 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.899316 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 06 22:06:55.899478 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.899326 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 06 22:06:55.901117 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.901094 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 06 22:06:55.901385 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.901363 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 06 22:06:55.901572 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.901554 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 06 22:06:55.901815 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.901789 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 06 22:06:55.902154 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.902133 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l4vd7\"" Jun 06 22:06:55.925335 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.925307 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-root\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:55.925459 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.925338 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-wtmp\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:55.925459 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.925358 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-sys\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:55.925459 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.925383 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:55.925459 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.925402 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-tls\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:55.925602 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.925486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-metrics-client-ca\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:55.925602 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.925522 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-textfile\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:55.925602 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.925549 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhdfs\" (UniqueName: \"kubernetes.io/projected/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-kube-api-access-vhdfs\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:55.925602 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:55.925581 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026272 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026227 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026272 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026275 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-tls\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026519 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-metrics-client-ca\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026519 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026349 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-textfile\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026519 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026476 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhdfs\" (UniqueName: \"kubernetes.io/projected/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-kube-api-access-vhdfs\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026671 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026671 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026583 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-root\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026671 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-wtmp\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026671 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-sys\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026879 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026692 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-textfile\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026879 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026707 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-sys\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026879 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026755 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-root\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.026879 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026846 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-wtmp\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.027030 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.026953 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-metrics-client-ca\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.027140 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.027118 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-accelerators-collector-config\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.028652 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.028630 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-tls\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.028770 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.028749 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.033043 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.033023 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhdfs\" (UniqueName: \"kubernetes.io/projected/efe30a75-322e-4bfb-9d8c-e3866f8cbfe8-kube-api-access-vhdfs\") pod \"node-exporter-5fvkv\" (UID: \"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8\") " pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.210861 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:56.210771 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-5fvkv" Jun 06 22:06:56.222525 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:06:56.222495 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefe30a75_322e_4bfb_9d8c_e3866f8cbfe8.slice/crio-3a4eb56789114e43eb92313a499f11f68a9642f117a1f2bcc1a3e35b6f0cb084 WatchSource:0}: Error finding container 3a4eb56789114e43eb92313a499f11f68a9642f117a1f2bcc1a3e35b6f0cb084: Status 404 returned error can't find the container with id 3a4eb56789114e43eb92313a499f11f68a9642f117a1f2bcc1a3e35b6f0cb084 Jun 06 22:06:57.112699 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:57.112664 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fvkv" event={"ID":"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8","Type":"ContainerStarted","Data":"3a4eb56789114e43eb92313a499f11f68a9642f117a1f2bcc1a3e35b6f0cb084"} Jun 06 22:06:58.116762 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:58.116720 2574 generic.go:356] "Generic (PLEG): container finished" podID="efe30a75-322e-4bfb-9d8c-e3866f8cbfe8" containerID="ce3cd687d8b7cdcb7e1c6d9694729ebc1d46feb9aee69e671b300723ccae1396" exitCode=0 Jun 06 22:06:58.117168 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:58.116792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fvkv" event={"ID":"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8","Type":"ContainerDied","Data":"ce3cd687d8b7cdcb7e1c6d9694729ebc1d46feb9aee69e671b300723ccae1396"} Jun 06 22:06:59.122106 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:59.122052 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fvkv" event={"ID":"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8","Type":"ContainerStarted","Data":"6b2b689d57a41a53fe87667c36b24b78dfa230cf8f318a87ebc6ed74d18de119"} Jun 06 22:06:59.122491 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:59.122136 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-5fvkv" event={"ID":"efe30a75-322e-4bfb-9d8c-e3866f8cbfe8","Type":"ContainerStarted","Data":"6c3cd98c81498d391b65ce4be1789ad0a6595d291ca0255e6ef0539f77c2aa48"} Jun 06 22:06:59.144617 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:06:59.144549 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-5fvkv" podStartSLOduration=3.12390558 podStartE2EDuration="4.144531589s" totalImagesPullingTime="955.802224ms" totalInitContainerRuntime="64.823785ms" isStatefulPod=true podCreationTimestamp="2026-06-06 22:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:06:59.142925641 +0000 UTC m=+246.345152358" watchObservedRunningTime="2026-06-06 22:06:59.144531589 +0000 UTC m=+246.346758308" Jun 06 22:07:05.094385 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:05.094348 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:07:05.096627 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:05.096605 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1bb2a002-a9ac-4494-b7b1-57d94a96711b-metrics-certs\") pod \"network-metrics-daemon-hr9ch\" (UID: \"1bb2a002-a9ac-4494-b7b1-57d94a96711b\") " pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:07:05.105330 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:05.105307 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-d4tj5\"" Jun 06 22:07:05.113740 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:05.113724 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hr9ch" Jun 06 22:07:05.236632 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:05.236596 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hr9ch"] Jun 06 22:07:05.241480 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:07:05.241455 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb2a002_a9ac_4494_b7b1_57d94a96711b.slice/crio-d2a8e607499fcee06f36bf0448ee944800f9992b6169b310d5bea27e72080ddb WatchSource:0}: Error finding container d2a8e607499fcee06f36bf0448ee944800f9992b6169b310d5bea27e72080ddb: Status 404 returned error can't find the container with id d2a8e607499fcee06f36bf0448ee944800f9992b6169b310d5bea27e72080ddb Jun 06 22:07:06.146209 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:06.146181 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hr9ch" event={"ID":"1bb2a002-a9ac-4494-b7b1-57d94a96711b","Type":"ContainerStarted","Data":"d2a8e607499fcee06f36bf0448ee944800f9992b6169b310d5bea27e72080ddb"} Jun 06 22:07:07.152047 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:07.152004 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hr9ch" event={"ID":"1bb2a002-a9ac-4494-b7b1-57d94a96711b","Type":"ContainerStarted","Data":"6f2dc1ebf79494ef4d24589d6331cf488d6ec4108d2100da9a9aa99a616cd03f"} Jun 06 22:07:07.152624 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:07.152129 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hr9ch" event={"ID":"1bb2a002-a9ac-4494-b7b1-57d94a96711b","Type":"ContainerStarted","Data":"b45fc16f2ba510bf0b778fed7cd04a2b57a32898b66fbc3256c4a87c46ae44f3"} Jun 06 22:07:07.168965 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:07.168912 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hr9ch" podStartSLOduration=253.319902735 podStartE2EDuration="4m14.168896979s" totalImagesPullingTime="848.994244ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:07:07.168124194 +0000 UTC m=+254.370350911" watchObservedRunningTime="2026-06-06 22:07:07.168896979 +0000 UTC m=+254.371123696" Jun 06 22:07:33.840458 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:07:33.840407 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dq67q" podUID="d3225a74-e305-445e-aa91-2002863b6d73" Jun 06 22:07:33.840458 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:07:33.840407 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" podUID="34126ddd-d068-4d2b-9072-5bfd10053f72" Jun 06 22:07:34.236109 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:34.236014 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dq67q" Jun 06 22:07:34.236275 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:34.236014 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:07:37.245593 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.245502 2574 generic.go:356] "Generic (PLEG): container finished" podID="4a169796-2e0c-4335-901d-5603f7698b8a" containerID="cf39e5075a82d826da6d0b872468cfe5949115af380c5bc2abbdca319f2ea73f" exitCode=255 Jun 06 22:07:37.245593 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.245572 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" event={"ID":"4a169796-2e0c-4335-901d-5603f7698b8a","Type":"ContainerDied","Data":"cf39e5075a82d826da6d0b872468cfe5949115af380c5bc2abbdca319f2ea73f"} Jun 06 22:07:37.246117 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.245615 2574 scope.go:117] "RemoveContainer" containerID="944b7768b459c566189d4bd504506464f6e49c20224184fcca1756a8f99adaa3" Jun 06 22:07:37.246117 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.245916 2574 scope.go:117] "RemoveContainer" containerID="cf39e5075a82d826da6d0b872468cfe5949115af380c5bc2abbdca319f2ea73f" Jun 06 22:07:37.246441 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:07:37.246409 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-98b95998b-lxzj4_open-cluster-management-agent-addon(4a169796-2e0c-4335-901d-5603f7698b8a)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" podUID="4a169796-2e0c-4335-901d-5603f7698b8a" Jun 06 22:07:37.251086 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.251039 2574 generic.go:356] "Generic (PLEG): container finished" podID="aa201edc-f138-4084-85d3-a9f9b796008f" containerID="5a27d7f3cf8e8ec5b3845695fa28a7cb8aa5246ad65c716f546277ec1c6795e7" exitCode=1 Jun 06 22:07:37.251199 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.251106 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" event={"ID":"aa201edc-f138-4084-85d3-a9f9b796008f","Type":"ContainerDied","Data":"5a27d7f3cf8e8ec5b3845695fa28a7cb8aa5246ad65c716f546277ec1c6795e7"} Jun 06 22:07:37.251751 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.251735 2574 scope.go:117] "RemoveContainer" containerID="5a27d7f3cf8e8ec5b3845695fa28a7cb8aa5246ad65c716f546277ec1c6795e7" Jun 06 22:07:37.251908 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:07:37.251888 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-58557b7d57-xjdx8_open-cluster-management-agent-addon(aa201edc-f138-4084-85d3-a9f9b796008f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" podUID="aa201edc-f138-4084-85d3-a9f9b796008f" Jun 06 22:07:37.257875 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.257857 2574 scope.go:117] "RemoveContainer" containerID="088161a5c5192fb739d58aa914fd47106d61c6954b4e9ee039711dd041c7b0a2" Jun 06 22:07:37.643042 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.642985 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:07:37.643042 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.643049 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:07:37.645314 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.645282 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3225a74-e305-445e-aa91-2002863b6d73-metrics-tls\") pod \"dns-default-dq67q\" (UID: \"d3225a74-e305-445e-aa91-2002863b6d73\") " pod="openshift-dns/dns-default-dq67q" Jun 06 22:07:37.645512 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.645490 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"image-registry-76fc9b94c-88j4x\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:07:37.838940 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.838910 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j597l\"" Jun 06 22:07:37.838940 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.838910 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zzm52\"" Jun 06 22:07:37.847340 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.847318 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dq67q" Jun 06 22:07:37.847406 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.847343 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:07:37.867845 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.867820 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:07:37.966447 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.966401 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:07:37.986942 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.986836 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dq67q"] Jun 06 22:07:37.990092 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:07:37.990045 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3225a74_e305_445e_aa91_2002863b6d73.slice/crio-c6ff1928e5925508711b8d8f7f625c790687dca357bb8c47a75275c71cc6e056 WatchSource:0}: Error finding container c6ff1928e5925508711b8d8f7f625c790687dca357bb8c47a75275c71cc6e056: Status 404 returned error can't find the container with id c6ff1928e5925508711b8d8f7f625c790687dca357bb8c47a75275c71cc6e056 Jun 06 22:07:37.992250 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:37.992226 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" Jun 06 22:07:38.009711 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:38.009677 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-76fc9b94c-88j4x"] Jun 06 22:07:38.013383 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:07:38.013358 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34126ddd_d068_4d2b_9072_5bfd10053f72.slice/crio-d7af063291bf6c6f6005f6ed530985ac73bfd7725d4e8c88d16f4b94bdba4943 WatchSource:0}: Error finding container d7af063291bf6c6f6005f6ed530985ac73bfd7725d4e8c88d16f4b94bdba4943: Status 404 returned error can't find the container with id d7af063291bf6c6f6005f6ed530985ac73bfd7725d4e8c88d16f4b94bdba4943 Jun 06 22:07:38.256647 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:38.256564 2574 scope.go:117] "RemoveContainer" containerID="cf39e5075a82d826da6d0b872468cfe5949115af380c5bc2abbdca319f2ea73f" Jun 06 22:07:38.257117 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:07:38.256742 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-98b95998b-lxzj4_open-cluster-management-agent-addon(4a169796-2e0c-4335-901d-5603f7698b8a)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" podUID="4a169796-2e0c-4335-901d-5603f7698b8a" Jun 06 22:07:38.257497 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:38.257472 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dq67q" event={"ID":"d3225a74-e305-445e-aa91-2002863b6d73","Type":"ContainerStarted","Data":"c6ff1928e5925508711b8d8f7f625c790687dca357bb8c47a75275c71cc6e056"} Jun 06 22:07:38.259180 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:38.259157 2574 scope.go:117] "RemoveContainer" containerID="5a27d7f3cf8e8ec5b3845695fa28a7cb8aa5246ad65c716f546277ec1c6795e7" Jun 06 22:07:38.259347 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:07:38.259318 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-58557b7d57-xjdx8_open-cluster-management-agent-addon(aa201edc-f138-4084-85d3-a9f9b796008f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" podUID="aa201edc-f138-4084-85d3-a9f9b796008f" Jun 06 22:07:38.260414 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:38.260394 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" event={"ID":"34126ddd-d068-4d2b-9072-5bfd10053f72","Type":"ContainerStarted","Data":"2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a"} Jun 06 22:07:38.260507 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:38.260430 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" event={"ID":"34126ddd-d068-4d2b-9072-5bfd10053f72","Type":"ContainerStarted","Data":"d7af063291bf6c6f6005f6ed530985ac73bfd7725d4e8c88d16f4b94bdba4943"} Jun 06 22:07:38.260558 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:38.260529 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:07:38.286130 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:38.286052 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" podStartSLOduration=285.286031366 podStartE2EDuration="4m45.286031366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:02:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:07:38.285360948 +0000 UTC m=+285.487587667" watchObservedRunningTime="2026-06-06 22:07:38.286031366 +0000 UTC m=+285.488258085" Jun 06 22:07:39.264387 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:39.264359 2574 scope.go:117] "RemoveContainer" containerID="5a27d7f3cf8e8ec5b3845695fa28a7cb8aa5246ad65c716f546277ec1c6795e7" Jun 06 22:07:39.264781 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:07:39.264538 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-58557b7d57-xjdx8_open-cluster-management-agent-addon(aa201edc-f138-4084-85d3-a9f9b796008f)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" podUID="aa201edc-f138-4084-85d3-a9f9b796008f" Jun 06 22:07:40.269181 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:40.269143 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dq67q" event={"ID":"d3225a74-e305-445e-aa91-2002863b6d73","Type":"ContainerStarted","Data":"5200b515215d32527a7cd983c69dc0b26ce6bcf325b1d8ec69e8ee69786779ff"} Jun 06 22:07:40.269642 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:40.269200 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dq67q" event={"ID":"d3225a74-e305-445e-aa91-2002863b6d73","Type":"ContainerStarted","Data":"a4bf41d7b604859082d92c02ca0dd6d3ffcc065fcfae7f14c6df8e9d5363dbfe"} Jun 06 22:07:40.269642 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:40.269232 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dq67q" Jun 06 22:07:40.283659 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:40.283607 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dq67q" podStartSLOduration=251.53216765 podStartE2EDuration="4m13.283590965s" totalImagesPullingTime="1.751423315s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:03:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:07:40.282804246 +0000 UTC m=+287.485030963" watchObservedRunningTime="2026-06-06 22:07:40.283590965 +0000 UTC m=+287.485817682" Jun 06 22:07:47.986163 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:47.986110 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" podUID="292a2731-f6e7-4d94-a447-311c52668733" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 06 22:07:50.282022 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:50.281986 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dq67q" Jun 06 22:07:52.203048 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:52.203014 2574 scope.go:117] "RemoveContainer" containerID="5a27d7f3cf8e8ec5b3845695fa28a7cb8aa5246ad65c716f546277ec1c6795e7" Jun 06 22:07:52.203474 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:52.203126 2574 scope.go:117] "RemoveContainer" containerID="cf39e5075a82d826da6d0b872468cfe5949115af380c5bc2abbdca319f2ea73f" Jun 06 22:07:52.317721 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:52.317642 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" event={"ID":"aa201edc-f138-4084-85d3-a9f9b796008f","Type":"ContainerStarted","Data":"eec22ba737fe8a3f2eeaab2091ac6abe1f57f1eae3dd057eb04ce8f58d518683"} Jun 06 22:07:52.318006 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:52.317986 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:07:52.319418 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:52.319376 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-58557b7d57-xjdx8" Jun 06 22:07:52.320575 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:52.320523 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-98b95998b-lxzj4" event={"ID":"4a169796-2e0c-4335-901d-5603f7698b8a","Type":"ContainerStarted","Data":"2f3b4c8d9ef7c7faa1d98ba088119966721be008f49817ab803d9a36a5c9e50a"} Jun 06 22:07:53.138632 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:53.138601 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:07:53.140515 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:53.140494 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:07:53.147627 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:53.147601 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 06 22:07:57.852386 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:57.852353 2574 patch_prober.go:28] interesting pod/image-registry-76fc9b94c-88j4x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 06 22:07:57.854713 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:57.852403 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" podUID="34126ddd-d068-4d2b-9072-5bfd10053f72" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 22:07:57.871920 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:57.871894 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fvkv_efe30a75-322e-4bfb-9d8c-e3866f8cbfe8/init-textfile/0.log" Jun 06 22:07:57.985967 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:57.985928 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" podUID="292a2731-f6e7-4d94-a447-311c52668733" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 06 22:07:58.060344 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:58.060317 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fvkv_efe30a75-322e-4bfb-9d8c-e3866f8cbfe8/node-exporter/0.log" Jun 06 22:07:58.259757 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:58.259685 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fvkv_efe30a75-322e-4bfb-9d8c-e3866f8cbfe8/kube-rbac-proxy/0.log" Jun 06 22:07:59.268368 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:07:59.268342 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:08:05.259152 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:05.259120 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dq67q_d3225a74-e305-445e-aa91-2002863b6d73/dns/0.log" Jun 06 22:08:05.459651 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:05.459615 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dq67q_d3225a74-e305-445e-aa91-2002863b6d73/kube-rbac-proxy/0.log" Jun 06 22:08:06.859556 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:06.859533 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x87wj_b12f3564-b124-43da-a185-597650b9b6f7/dns-node-resolver/0.log" Jun 06 22:08:07.059966 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:07.059934 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-76fc9b94c-88j4x_34126ddd-d068-4d2b-9072-5bfd10053f72/registry/0.log" Jun 06 22:08:07.659132 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:07.659103 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pmp7g_b18ed7df-bfef-43ca-af32-7693909a4d7f/node-ca/0.log" Jun 06 22:08:07.985998 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:07.985915 2574 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" podUID="292a2731-f6e7-4d94-a447-311c52668733" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 06 22:08:07.985998 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:07.985981 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" Jun 06 22:08:07.986467 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:07.986438 2574 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"9ff95141e648e28edc88a340a0383dcfe8d97fa2909ae90d5f01d21d466cad5f"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 06 22:08:07.986507 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:07.986488 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" podUID="292a2731-f6e7-4d94-a447-311c52668733" containerName="service-proxy" containerID="cri-o://9ff95141e648e28edc88a340a0383dcfe8d97fa2909ae90d5f01d21d466cad5f" gracePeriod=30 Jun 06 22:08:08.378831 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:08.378799 2574 generic.go:356] "Generic (PLEG): container finished" podID="292a2731-f6e7-4d94-a447-311c52668733" containerID="9ff95141e648e28edc88a340a0383dcfe8d97fa2909ae90d5f01d21d466cad5f" exitCode=2 Jun 06 22:08:08.379010 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:08.378872 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" event={"ID":"292a2731-f6e7-4d94-a447-311c52668733","Type":"ContainerDied","Data":"9ff95141e648e28edc88a340a0383dcfe8d97fa2909ae90d5f01d21d466cad5f"} Jun 06 22:08:08.379010 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:08.378917 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-699d8d6874-mshj9" event={"ID":"292a2731-f6e7-4d94-a447-311c52668733","Type":"ContainerStarted","Data":"1d1ee3d51c5e42789b18f214c35b11133de04d5a30d1995fe3e29fbf6c2c5b52"} Jun 06 22:08:08.459313 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:08.459287 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dr9gv_ea11ebf1-7f7c-433c-b7c2-916388355331/serve-healthcheck-canary/0.log" Jun 06 22:08:08.712591 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:08.712500 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76fc9b94c-88j4x"] Jun 06 22:08:33.732140 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:33.732097 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" podUID="34126ddd-d068-4d2b-9072-5bfd10053f72" containerName="registry" containerID="cri-o://2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a" gracePeriod=30 Jun 06 22:08:33.976175 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:33.976148 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:08:34.036930 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.036905 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") pod \"34126ddd-d068-4d2b-9072-5bfd10053f72\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " Jun 06 22:08:34.037122 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.036941 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-installation-pull-secrets\") pod \"34126ddd-d068-4d2b-9072-5bfd10053f72\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " Jun 06 22:08:34.037122 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.036967 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-bound-sa-token\") pod \"34126ddd-d068-4d2b-9072-5bfd10053f72\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " Jun 06 22:08:34.037122 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.037005 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-image-registry-private-configuration\") pod \"34126ddd-d068-4d2b-9072-5bfd10053f72\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " Jun 06 22:08:34.037122 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.037029 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-certificates\") pod \"34126ddd-d068-4d2b-9072-5bfd10053f72\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " Jun 06 22:08:34.037122 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.037051 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws6sx\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-kube-api-access-ws6sx\") pod \"34126ddd-d068-4d2b-9072-5bfd10053f72\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " Jun 06 22:08:34.037392 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.037274 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34126ddd-d068-4d2b-9072-5bfd10053f72-ca-trust-extracted\") pod \"34126ddd-d068-4d2b-9072-5bfd10053f72\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " Jun 06 22:08:34.037392 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.037333 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-trusted-ca\") pod \"34126ddd-d068-4d2b-9072-5bfd10053f72\" (UID: \"34126ddd-d068-4d2b-9072-5bfd10053f72\") " Jun 06 22:08:34.037595 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.037562 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "34126ddd-d068-4d2b-9072-5bfd10053f72" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 22:08:34.037937 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.037908 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "34126ddd-d068-4d2b-9072-5bfd10053f72" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 22:08:34.039593 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.039543 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "34126ddd-d068-4d2b-9072-5bfd10053f72" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 22:08:34.039709 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.039632 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "34126ddd-d068-4d2b-9072-5bfd10053f72" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 22:08:34.039777 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.039719 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "34126ddd-d068-4d2b-9072-5bfd10053f72" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 06 22:08:34.039834 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.039791 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "34126ddd-d068-4d2b-9072-5bfd10053f72" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 22:08:34.039922 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.039905 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-kube-api-access-ws6sx" (OuterVolumeSpecName: "kube-api-access-ws6sx") pod "34126ddd-d068-4d2b-9072-5bfd10053f72" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72"). InnerVolumeSpecName "kube-api-access-ws6sx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 22:08:34.048130 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.048101 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/34126ddd-d068-4d2b-9072-5bfd10053f72-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "34126ddd-d068-4d2b-9072-5bfd10053f72" (UID: "34126ddd-d068-4d2b-9072-5bfd10053f72"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 22:08:34.138242 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.138204 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-tls\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:08:34.138242 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.138238 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-installation-pull-secrets\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:08:34.138242 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.138248 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-bound-sa-token\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:08:34.138433 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.138259 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/34126ddd-d068-4d2b-9072-5bfd10053f72-image-registry-private-configuration\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:08:34.138433 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.138269 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-registry-certificates\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:08:34.138433 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.138278 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws6sx\" (UniqueName: \"kubernetes.io/projected/34126ddd-d068-4d2b-9072-5bfd10053f72-kube-api-access-ws6sx\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:08:34.138433 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.138286 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/34126ddd-d068-4d2b-9072-5bfd10053f72-ca-trust-extracted\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:08:34.138433 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.138294 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/34126ddd-d068-4d2b-9072-5bfd10053f72-trusted-ca\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:08:34.472989 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.472894 2574 generic.go:356] "Generic (PLEG): container finished" podID="34126ddd-d068-4d2b-9072-5bfd10053f72" containerID="2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a" exitCode=0 Jun 06 22:08:34.472989 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.472937 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" Jun 06 22:08:34.472989 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.472956 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" event={"ID":"34126ddd-d068-4d2b-9072-5bfd10053f72","Type":"ContainerDied","Data":"2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a"} Jun 06 22:08:34.473245 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.472998 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-76fc9b94c-88j4x" event={"ID":"34126ddd-d068-4d2b-9072-5bfd10053f72","Type":"ContainerDied","Data":"d7af063291bf6c6f6005f6ed530985ac73bfd7725d4e8c88d16f4b94bdba4943"} Jun 06 22:08:34.473245 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.473019 2574 scope.go:117] "RemoveContainer" containerID="2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a" Jun 06 22:08:34.481711 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.481690 2574 scope.go:117] "RemoveContainer" containerID="2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a" Jun 06 22:08:34.482039 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:08:34.482004 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a\": container with ID starting with 2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a not found: ID does not exist" containerID="2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a" Jun 06 22:08:34.482151 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.482048 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a"} err="failed to get container status \"2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a\": rpc error: code = NotFound desc = could not find container \"2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a\": container with ID starting with 2ae834b05425e6da36571dbf63aa0dbdd2639f4ec2ac4ca65ac9449bed749e2a not found: ID does not exist" Jun 06 22:08:34.492356 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.492324 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-76fc9b94c-88j4x"] Jun 06 22:08:34.496110 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:34.496090 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-76fc9b94c-88j4x"] Jun 06 22:08:35.207141 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:08:35.207111 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34126ddd-d068-4d2b-9072-5bfd10053f72" path="/var/lib/kubelet/pods/34126ddd-d068-4d2b-9072-5bfd10053f72/volumes" Jun 06 22:09:57.445395 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.445358 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4"] Jun 06 22:09:57.445868 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.445599 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34126ddd-d068-4d2b-9072-5bfd10053f72" containerName="registry" Jun 06 22:09:57.445868 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.445609 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="34126ddd-d068-4d2b-9072-5bfd10053f72" containerName="registry" Jun 06 22:09:57.445868 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.445656 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="34126ddd-d068-4d2b-9072-5bfd10053f72" containerName="registry" Jun 06 22:09:57.448234 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.448218 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4" Jun 06 22:09:57.450498 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.450473 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 06 22:09:57.450641 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.450477 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 06 22:09:57.450641 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.450499 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-d5rzh\"" Jun 06 22:09:57.454417 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.454391 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4"] Jun 06 22:09:57.615987 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.615950 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd61a543-78ea-4b88-9292-aef23e64d473-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-rqfk4\" (UID: \"dd61a543-78ea-4b88-9292-aef23e64d473\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4" Jun 06 22:09:57.615987 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.615989 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rzr2\" (UniqueName: \"kubernetes.io/projected/dd61a543-78ea-4b88-9292-aef23e64d473-kube-api-access-8rzr2\") pod \"cert-manager-cainjector-5d99449ffd-rqfk4\" (UID: \"dd61a543-78ea-4b88-9292-aef23e64d473\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4" Jun 06 22:09:57.716944 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.716873 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rzr2\" (UniqueName: \"kubernetes.io/projected/dd61a543-78ea-4b88-9292-aef23e64d473-kube-api-access-8rzr2\") pod \"cert-manager-cainjector-5d99449ffd-rqfk4\" (UID: \"dd61a543-78ea-4b88-9292-aef23e64d473\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4" Jun 06 22:09:57.716944 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.716939 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd61a543-78ea-4b88-9292-aef23e64d473-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-rqfk4\" (UID: \"dd61a543-78ea-4b88-9292-aef23e64d473\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4" Jun 06 22:09:57.724669 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.724638 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/dd61a543-78ea-4b88-9292-aef23e64d473-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-rqfk4\" (UID: \"dd61a543-78ea-4b88-9292-aef23e64d473\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4" Jun 06 22:09:57.724779 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.724746 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rzr2\" (UniqueName: \"kubernetes.io/projected/dd61a543-78ea-4b88-9292-aef23e64d473-kube-api-access-8rzr2\") pod \"cert-manager-cainjector-5d99449ffd-rqfk4\" (UID: \"dd61a543-78ea-4b88-9292-aef23e64d473\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4" Jun 06 22:09:57.757637 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.757606 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4" Jun 06 22:09:57.881929 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.881899 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4"] Jun 06 22:09:57.885498 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:09:57.885476 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd61a543_78ea_4b88_9292_aef23e64d473.slice/crio-439068fe560cae9c2405e6d7d7bba229068b1288a2096a27612492f85ea5ed8a WatchSource:0}: Error finding container 439068fe560cae9c2405e6d7d7bba229068b1288a2096a27612492f85ea5ed8a: Status 404 returned error can't find the container with id 439068fe560cae9c2405e6d7d7bba229068b1288a2096a27612492f85ea5ed8a Jun 06 22:09:57.887774 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:57.887756 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 22:09:58.750225 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:09:58.750187 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4" event={"ID":"dd61a543-78ea-4b88-9292-aef23e64d473","Type":"ContainerStarted","Data":"439068fe560cae9c2405e6d7d7bba229068b1288a2096a27612492f85ea5ed8a"} Jun 06 22:10:00.758713 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:00.758681 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4" event={"ID":"dd61a543-78ea-4b88-9292-aef23e64d473","Type":"ContainerStarted","Data":"1cb7f5376fc4dd6abec9ec229bc066f72d13d3be1309b038aea6fe11f29f3bc1"} Jun 06 22:10:00.783709 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:00.783649 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-rqfk4" podStartSLOduration=1.619915206 podStartE2EDuration="3.783632652s" totalImagesPullingTime="2.163717446s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:09:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:10:00.782664785 +0000 UTC m=+427.984891503" watchObservedRunningTime="2026-06-06 22:10:00.783632652 +0000 UTC m=+427.985859369" Jun 06 22:10:27.294442 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.294357 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf"] Jun 06 22:10:27.297619 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.297596 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.299726 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.299707 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 06 22:10:27.299835 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.299793 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 06 22:10:27.300346 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.300325 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 06 22:10:27.300471 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.300454 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 06 22:10:27.300530 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.300473 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dbwnd\"" Jun 06 22:10:27.311961 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.311937 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf"] Jun 06 22:10:27.319642 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.319618 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.319749 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.319659 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk6hr\" (UniqueName: \"kubernetes.io/projected/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-kube-api-access-gk6hr\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.319749 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.319681 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-tmp\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.319749 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.319740 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-manifests\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.319856 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.319770 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.420505 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.420465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.420706 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.420519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk6hr\" (UniqueName: \"kubernetes.io/projected/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-kube-api-access-gk6hr\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.420706 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.420609 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-tmp\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.420706 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.420639 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-manifests\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.420706 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.420668 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.421098 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.421042 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-manifests\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.422960 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.422930 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-tmp\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.423169 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.423151 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-webhook-cert\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.423218 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.423189 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-apiservice-cert\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.427187 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.427169 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk6hr\" (UniqueName: \"kubernetes.io/projected/3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef-kube-api-access-gk6hr\") pod \"opendatahub-operator-controller-manager-9c76bcc58-65kcf\" (UID: \"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef\") " pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.607518 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.607420 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:27.742511 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.742478 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf"] Jun 06 22:10:27.745914 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:10:27.745883 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3151b7a1_5d0f_4b07_b80f_2ba5e238b6ef.slice/crio-c5d2f5ddba0ca5bcdcbf89a1f5a75b159e058c82ed21dee7c2d847098bbb040f WatchSource:0}: Error finding container c5d2f5ddba0ca5bcdcbf89a1f5a75b159e058c82ed21dee7c2d847098bbb040f: Status 404 returned error can't find the container with id c5d2f5ddba0ca5bcdcbf89a1f5a75b159e058c82ed21dee7c2d847098bbb040f Jun 06 22:10:27.850035 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:27.850000 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" event={"ID":"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef","Type":"ContainerStarted","Data":"c5d2f5ddba0ca5bcdcbf89a1f5a75b159e058c82ed21dee7c2d847098bbb040f"} Jun 06 22:10:30.863288 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:30.863251 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" event={"ID":"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef","Type":"ContainerStarted","Data":"b1d96b63ff6aed8fac482776454d2bb6765e061c0bdb2308024404487fc3e7f7"} Jun 06 22:10:31.868267 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:31.868229 2574 generic.go:356] "Generic (PLEG): container finished" podID="3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef" containerID="b1d96b63ff6aed8fac482776454d2bb6765e061c0bdb2308024404487fc3e7f7" exitCode=0 Jun 06 22:10:31.868623 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:31.868309 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" event={"ID":"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef","Type":"ContainerDied","Data":"b1d96b63ff6aed8fac482776454d2bb6765e061c0bdb2308024404487fc3e7f7"} Jun 06 22:10:32.874346 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:32.874307 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" event={"ID":"3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef","Type":"ContainerStarted","Data":"4133994de757bb67c1b4f7ddeb353561a1c0210f42b715e75e4da6fc1f1f7a40"} Jun 06 22:10:32.874801 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:32.874435 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:32.893156 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:32.893102 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" podStartSLOduration=1.5943439179999999 podStartE2EDuration="5.893084398s" totalImagesPullingTime="3.300616594s" totalInitContainerRuntime="998.123886ms" isStatefulPod=false podCreationTimestamp="2026-06-06 22:10:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:10:32.891569089 +0000 UTC m=+460.093795823" watchObservedRunningTime="2026-06-06 22:10:32.893084398 +0000 UTC m=+460.095311105" Jun 06 22:10:43.880199 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:43.880161 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-9c76bcc58-65kcf" Jun 06 22:10:46.659845 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.659814 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj"] Jun 06 22:10:46.662953 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.662934 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" Jun 06 22:10:46.664834 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.664811 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 06 22:10:46.664834 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.664821 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 06 22:10:46.665162 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.665147 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 06 22:10:46.665230 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.665188 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 06 22:10:46.669256 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.669232 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-xqp9g\"" Jun 06 22:10:46.679310 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.679283 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj"] Jun 06 22:10:46.760048 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.760012 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516df559-a664-46e5-9411-440540036932-tmp\") pod \"kube-auth-proxy-76d78c7b69-r9tbj\" (UID: \"516df559-a664-46e5-9411-440540036932\") " pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" Jun 06 22:10:46.760256 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.760092 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/516df559-a664-46e5-9411-440540036932-tls-certs\") pod \"kube-auth-proxy-76d78c7b69-r9tbj\" (UID: \"516df559-a664-46e5-9411-440540036932\") " pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" Jun 06 22:10:46.760256 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.760142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b86t\" (UniqueName: \"kubernetes.io/projected/516df559-a664-46e5-9411-440540036932-kube-api-access-6b86t\") pod \"kube-auth-proxy-76d78c7b69-r9tbj\" (UID: \"516df559-a664-46e5-9411-440540036932\") " pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" Jun 06 22:10:46.860999 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.860964 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/516df559-a664-46e5-9411-440540036932-tls-certs\") pod \"kube-auth-proxy-76d78c7b69-r9tbj\" (UID: \"516df559-a664-46e5-9411-440540036932\") " pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" Jun 06 22:10:46.861198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.861043 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b86t\" (UniqueName: \"kubernetes.io/projected/516df559-a664-46e5-9411-440540036932-kube-api-access-6b86t\") pod \"kube-auth-proxy-76d78c7b69-r9tbj\" (UID: \"516df559-a664-46e5-9411-440540036932\") " pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" Jun 06 22:10:46.861198 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.861117 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516df559-a664-46e5-9411-440540036932-tmp\") pod \"kube-auth-proxy-76d78c7b69-r9tbj\" (UID: \"516df559-a664-46e5-9411-440540036932\") " pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" Jun 06 22:10:46.863368 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.863345 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/516df559-a664-46e5-9411-440540036932-tmp\") pod \"kube-auth-proxy-76d78c7b69-r9tbj\" (UID: \"516df559-a664-46e5-9411-440540036932\") " pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" Jun 06 22:10:46.863614 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.863595 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/516df559-a664-46e5-9411-440540036932-tls-certs\") pod \"kube-auth-proxy-76d78c7b69-r9tbj\" (UID: \"516df559-a664-46e5-9411-440540036932\") " pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" Jun 06 22:10:46.869493 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.869458 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b86t\" (UniqueName: \"kubernetes.io/projected/516df559-a664-46e5-9411-440540036932-kube-api-access-6b86t\") pod \"kube-auth-proxy-76d78c7b69-r9tbj\" (UID: \"516df559-a664-46e5-9411-440540036932\") " pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" Jun 06 22:10:46.973036 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:46.972963 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" Jun 06 22:10:47.120149 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.120119 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj"] Jun 06 22:10:47.122626 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:10:47.122598 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod516df559_a664_46e5_9411_440540036932.slice/crio-a84261d4b504ed407f8a104c38d20bd55b98dbabb739a7fcca77b8404711de47 WatchSource:0}: Error finding container a84261d4b504ed407f8a104c38d20bd55b98dbabb739a7fcca77b8404711de47: Status 404 returned error can't find the container with id a84261d4b504ed407f8a104c38d20bd55b98dbabb739a7fcca77b8404711de47 Jun 06 22:10:47.291540 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.291502 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-t9rtl"] Jun 06 22:10:47.295466 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.295449 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" Jun 06 22:10:47.297120 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.297098 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 06 22:10:47.303496 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.303158 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-t9rtl"] Jun 06 22:10:47.366523 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.366486 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhq5p\" (UniqueName: \"kubernetes.io/projected/7b4cadda-8423-4957-94b7-6a873831b653-kube-api-access-hhq5p\") pod \"model-serving-api-5dd488fc48-t9rtl\" (UID: \"7b4cadda-8423-4957-94b7-6a873831b653\") " pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" Jun 06 22:10:47.366523 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.366536 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4cadda-8423-4957-94b7-6a873831b653-tls-certs\") pod \"model-serving-api-5dd488fc48-t9rtl\" (UID: \"7b4cadda-8423-4957-94b7-6a873831b653\") " pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" Jun 06 22:10:47.467004 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.466963 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhq5p\" (UniqueName: \"kubernetes.io/projected/7b4cadda-8423-4957-94b7-6a873831b653-kube-api-access-hhq5p\") pod \"model-serving-api-5dd488fc48-t9rtl\" (UID: \"7b4cadda-8423-4957-94b7-6a873831b653\") " pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" Jun 06 22:10:47.467004 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.467006 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4cadda-8423-4957-94b7-6a873831b653-tls-certs\") pod \"model-serving-api-5dd488fc48-t9rtl\" (UID: \"7b4cadda-8423-4957-94b7-6a873831b653\") " pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" Jun 06 22:10:47.467257 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:10:47.467138 2574 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 06 22:10:47.467257 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:10:47.467192 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b4cadda-8423-4957-94b7-6a873831b653-tls-certs podName:7b4cadda-8423-4957-94b7-6a873831b653 nodeName:}" failed. No retries permitted until 2026-06-06 22:10:47.967175361 +0000 UTC m=+475.169402056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/7b4cadda-8423-4957-94b7-6a873831b653-tls-certs") pod "model-serving-api-5dd488fc48-t9rtl" (UID: "7b4cadda-8423-4957-94b7-6a873831b653") : secret "model-serving-api-tls" not found Jun 06 22:10:47.477724 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.477702 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhq5p\" (UniqueName: \"kubernetes.io/projected/7b4cadda-8423-4957-94b7-6a873831b653-kube-api-access-hhq5p\") pod \"model-serving-api-5dd488fc48-t9rtl\" (UID: \"7b4cadda-8423-4957-94b7-6a873831b653\") " pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" Jun 06 22:10:47.935363 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.930816 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" event={"ID":"516df559-a664-46e5-9411-440540036932","Type":"ContainerStarted","Data":"a84261d4b504ed407f8a104c38d20bd55b98dbabb739a7fcca77b8404711de47"} Jun 06 22:10:47.972353 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.972312 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4cadda-8423-4957-94b7-6a873831b653-tls-certs\") pod \"model-serving-api-5dd488fc48-t9rtl\" (UID: \"7b4cadda-8423-4957-94b7-6a873831b653\") " pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" Jun 06 22:10:47.980545 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:47.980488 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7b4cadda-8423-4957-94b7-6a873831b653-tls-certs\") pod \"model-serving-api-5dd488fc48-t9rtl\" (UID: \"7b4cadda-8423-4957-94b7-6a873831b653\") " pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" Jun 06 22:10:48.208483 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:48.208106 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" Jun 06 22:10:48.364618 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:48.364583 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-t9rtl"] Jun 06 22:10:48.368810 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:10:48.368781 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b4cadda_8423_4957_94b7_6a873831b653.slice/crio-26655d314c5cf946ee028f95ca3a000d3751fa8fe3ddb7c11bd3067583adebe6 WatchSource:0}: Error finding container 26655d314c5cf946ee028f95ca3a000d3751fa8fe3ddb7c11bd3067583adebe6: Status 404 returned error can't find the container with id 26655d314c5cf946ee028f95ca3a000d3751fa8fe3ddb7c11bd3067583adebe6 Jun 06 22:10:48.936144 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:48.936105 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" event={"ID":"7b4cadda-8423-4957-94b7-6a873831b653","Type":"ContainerStarted","Data":"26655d314c5cf946ee028f95ca3a000d3751fa8fe3ddb7c11bd3067583adebe6"} Jun 06 22:10:50.948417 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:50.948377 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" event={"ID":"516df559-a664-46e5-9411-440540036932","Type":"ContainerStarted","Data":"a27bcc470aa4bce301d728bad2daca82390db17a728eea53827bcaba798ffb02"} Jun 06 22:10:50.964082 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:50.963989 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-76d78c7b69-r9tbj" podStartSLOduration=2.206029514 podStartE2EDuration="4.963965971s" totalImagesPullingTime="2.757936457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:10:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:10:50.963521084 +0000 UTC m=+478.165747800" watchObservedRunningTime="2026-06-06 22:10:50.963965971 +0000 UTC m=+478.166192689" Jun 06 22:10:51.953121 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:51.953058 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" event={"ID":"7b4cadda-8423-4957-94b7-6a873831b653","Type":"ContainerStarted","Data":"4711c56ffb0f1c8d136362e7e714784c3cf487a051a8e4a3e3f24867cf54a0f8"} Jun 06 22:10:51.969034 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:51.968987 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" podStartSLOduration=2.281346798 podStartE2EDuration="4.968971883s" totalImagesPullingTime="2.687625085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:10:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:10:51.968535498 +0000 UTC m=+479.170762214" watchObservedRunningTime="2026-06-06 22:10:51.968971883 +0000 UTC m=+479.171198600" Jun 06 22:10:52.956765 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:52.956732 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" Jun 06 22:10:56.812745 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.812710 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-n25zl"] Jun 06 22:10:56.817128 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.817109 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" Jun 06 22:10:56.819409 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.819383 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hwm56\"" Jun 06 22:10:56.819611 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.819586 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 06 22:10:56.828729 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.828688 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w"] Jun 06 22:10:56.831907 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.831886 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-n25zl"] Jun 06 22:10:56.832030 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.831990 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" Jun 06 22:10:56.834045 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.834028 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-mrdpr\"" Jun 06 22:10:56.834152 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.834061 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 06 22:10:56.845550 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.845517 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w"] Jun 06 22:10:56.943409 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.943370 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ae21ed-d042-44d6-ac3a-505aacdebc39-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-m6n7w\" (UID: \"c5ae21ed-d042-44d6-ac3a-505aacdebc39\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" Jun 06 22:10:56.943564 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.943420 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swq69\" (UniqueName: \"kubernetes.io/projected/c5ae21ed-d042-44d6-ac3a-505aacdebc39-kube-api-access-swq69\") pod \"llmisvc-controller-manager-864bfd7bc9-m6n7w\" (UID: \"c5ae21ed-d042-44d6-ac3a-505aacdebc39\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" Jun 06 22:10:56.943564 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.943507 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxz5t\" (UniqueName: \"kubernetes.io/projected/604af505-3638-44c1-a28b-7b235cd9bd28-kube-api-access-pxz5t\") pod \"kserve-controller-manager-69fc866d76-n25zl\" (UID: \"604af505-3638-44c1-a28b-7b235cd9bd28\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" Jun 06 22:10:56.943564 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:56.943538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/604af505-3638-44c1-a28b-7b235cd9bd28-cert\") pod \"kserve-controller-manager-69fc866d76-n25zl\" (UID: \"604af505-3638-44c1-a28b-7b235cd9bd28\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" Jun 06 22:10:57.044592 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.044548 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swq69\" (UniqueName: \"kubernetes.io/projected/c5ae21ed-d042-44d6-ac3a-505aacdebc39-kube-api-access-swq69\") pod \"llmisvc-controller-manager-864bfd7bc9-m6n7w\" (UID: \"c5ae21ed-d042-44d6-ac3a-505aacdebc39\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" Jun 06 22:10:57.044765 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.044607 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxz5t\" (UniqueName: \"kubernetes.io/projected/604af505-3638-44c1-a28b-7b235cd9bd28-kube-api-access-pxz5t\") pod \"kserve-controller-manager-69fc866d76-n25zl\" (UID: \"604af505-3638-44c1-a28b-7b235cd9bd28\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" Jun 06 22:10:57.044765 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.044635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/604af505-3638-44c1-a28b-7b235cd9bd28-cert\") pod \"kserve-controller-manager-69fc866d76-n25zl\" (UID: \"604af505-3638-44c1-a28b-7b235cd9bd28\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" Jun 06 22:10:57.044765 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.044674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ae21ed-d042-44d6-ac3a-505aacdebc39-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-m6n7w\" (UID: \"c5ae21ed-d042-44d6-ac3a-505aacdebc39\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" Jun 06 22:10:57.044938 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:10:57.044780 2574 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jun 06 22:10:57.044938 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:10:57.044843 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5ae21ed-d042-44d6-ac3a-505aacdebc39-cert podName:c5ae21ed-d042-44d6-ac3a-505aacdebc39 nodeName:}" failed. No retries permitted until 2026-06-06 22:10:57.544823222 +0000 UTC m=+484.747049918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c5ae21ed-d042-44d6-ac3a-505aacdebc39-cert") pod "llmisvc-controller-manager-864bfd7bc9-m6n7w" (UID: "c5ae21ed-d042-44d6-ac3a-505aacdebc39") : secret "llmisvc-webhook-server-cert" not found Jun 06 22:10:57.047180 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.047160 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/604af505-3638-44c1-a28b-7b235cd9bd28-cert\") pod \"kserve-controller-manager-69fc866d76-n25zl\" (UID: \"604af505-3638-44c1-a28b-7b235cd9bd28\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" Jun 06 22:10:57.057260 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.057231 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-swq69\" (UniqueName: \"kubernetes.io/projected/c5ae21ed-d042-44d6-ac3a-505aacdebc39-kube-api-access-swq69\") pod \"llmisvc-controller-manager-864bfd7bc9-m6n7w\" (UID: \"c5ae21ed-d042-44d6-ac3a-505aacdebc39\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" Jun 06 22:10:57.060821 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.060797 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxz5t\" (UniqueName: \"kubernetes.io/projected/604af505-3638-44c1-a28b-7b235cd9bd28-kube-api-access-pxz5t\") pod \"kserve-controller-manager-69fc866d76-n25zl\" (UID: \"604af505-3638-44c1-a28b-7b235cd9bd28\") " pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" Jun 06 22:10:57.127049 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.126953 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" Jun 06 22:10:57.261036 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.261000 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-n25zl"] Jun 06 22:10:57.264490 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:10:57.264463 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod604af505_3638_44c1_a28b_7b235cd9bd28.slice/crio-475cbfe57fa620c7584c874a5d4f193f1331b23ec23dc95710ad2b99857bb866 WatchSource:0}: Error finding container 475cbfe57fa620c7584c874a5d4f193f1331b23ec23dc95710ad2b99857bb866: Status 404 returned error can't find the container with id 475cbfe57fa620c7584c874a5d4f193f1331b23ec23dc95710ad2b99857bb866 Jun 06 22:10:57.548950 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.548913 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ae21ed-d042-44d6-ac3a-505aacdebc39-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-m6n7w\" (UID: \"c5ae21ed-d042-44d6-ac3a-505aacdebc39\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" Jun 06 22:10:57.551298 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.551279 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c5ae21ed-d042-44d6-ac3a-505aacdebc39-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-m6n7w\" (UID: \"c5ae21ed-d042-44d6-ac3a-505aacdebc39\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" Jun 06 22:10:57.741183 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.741147 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" Jun 06 22:10:57.870319 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.870284 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w"] Jun 06 22:10:57.874133 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:10:57.874106 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc5ae21ed_d042_44d6_ac3a_505aacdebc39.slice/crio-ef55f64f99a98ce2258cfecaa7219c3f8be0ecae029fd912b1e016d9a26a87f2 WatchSource:0}: Error finding container ef55f64f99a98ce2258cfecaa7219c3f8be0ecae029fd912b1e016d9a26a87f2: Status 404 returned error can't find the container with id ef55f64f99a98ce2258cfecaa7219c3f8be0ecae029fd912b1e016d9a26a87f2 Jun 06 22:10:57.975621 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.975577 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" event={"ID":"c5ae21ed-d042-44d6-ac3a-505aacdebc39","Type":"ContainerStarted","Data":"ef55f64f99a98ce2258cfecaa7219c3f8be0ecae029fd912b1e016d9a26a87f2"} Jun 06 22:10:57.977161 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:10:57.977126 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" event={"ID":"604af505-3638-44c1-a28b-7b235cd9bd28","Type":"ContainerStarted","Data":"475cbfe57fa620c7584c874a5d4f193f1331b23ec23dc95710ad2b99857bb866"} Jun 06 22:11:00.990664 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:00.990622 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" event={"ID":"604af505-3638-44c1-a28b-7b235cd9bd28","Type":"ContainerStarted","Data":"80260653f55b7e7f09ee6c92017b1fad268fed7644282e297a945106dd2ee0b8"} Jun 06 22:11:00.991124 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:00.990705 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" Jun 06 22:11:00.991985 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:00.991962 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" event={"ID":"c5ae21ed-d042-44d6-ac3a-505aacdebc39","Type":"ContainerStarted","Data":"a17118c0e0fcf5f6614d503456923c94a90a024225740c98cc19b3ab68433f78"} Jun 06 22:11:00.992117 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:00.992103 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" Jun 06 22:11:01.004687 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:01.004620 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" podStartSLOduration=1.641069723 podStartE2EDuration="5.004602466s" totalImagesPullingTime="3.363532743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:11:01.003957799 +0000 UTC m=+488.206184517" watchObservedRunningTime="2026-06-06 22:11:01.004602466 +0000 UTC m=+488.206829186" Jun 06 22:11:01.017576 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:01.017514 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" podStartSLOduration=2.048619704 podStartE2EDuration="5.01749139s" totalImagesPullingTime="2.968871686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:11:01.017149779 +0000 UTC m=+488.219376499" watchObservedRunningTime="2026-06-06 22:11:01.01749139 +0000 UTC m=+488.219718108" Jun 06 22:11:03.969131 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:03.969103 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-t9rtl" Jun 06 22:11:05.386360 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.386322 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d"] Jun 06 22:11:05.390899 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.390877 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" Jun 06 22:11:05.393268 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.393242 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 06 22:11:05.393389 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.393285 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 06 22:11:05.393389 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.393293 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-crw7x\"" Jun 06 22:11:05.410228 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.410199 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d"] Jun 06 22:11:05.520652 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.520602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ad379da5-e96b-4306-82a8-b553e550e707-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ngd5d\" (UID: \"ad379da5-e96b-4306-82a8-b553e550e707\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" Jun 06 22:11:05.520843 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.520688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8zpd\" (UniqueName: \"kubernetes.io/projected/ad379da5-e96b-4306-82a8-b553e550e707-kube-api-access-q8zpd\") pod \"servicemesh-operator3-57f65f65fb-ngd5d\" (UID: \"ad379da5-e96b-4306-82a8-b553e550e707\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" Jun 06 22:11:05.622049 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.622012 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8zpd\" (UniqueName: \"kubernetes.io/projected/ad379da5-e96b-4306-82a8-b553e550e707-kube-api-access-q8zpd\") pod \"servicemesh-operator3-57f65f65fb-ngd5d\" (UID: \"ad379da5-e96b-4306-82a8-b553e550e707\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" Jun 06 22:11:05.622228 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.622056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ad379da5-e96b-4306-82a8-b553e550e707-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ngd5d\" (UID: \"ad379da5-e96b-4306-82a8-b553e550e707\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" Jun 06 22:11:05.624531 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.624512 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/ad379da5-e96b-4306-82a8-b553e550e707-operator-config\") pod \"servicemesh-operator3-57f65f65fb-ngd5d\" (UID: \"ad379da5-e96b-4306-82a8-b553e550e707\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" Jun 06 22:11:05.633438 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.633415 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8zpd\" (UniqueName: \"kubernetes.io/projected/ad379da5-e96b-4306-82a8-b553e550e707-kube-api-access-q8zpd\") pod \"servicemesh-operator3-57f65f65fb-ngd5d\" (UID: \"ad379da5-e96b-4306-82a8-b553e550e707\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" Jun 06 22:11:05.700105 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.699989 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" Jun 06 22:11:05.835091 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:05.835040 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d"] Jun 06 22:11:05.837923 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:11:05.837888 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad379da5_e96b_4306_82a8_b553e550e707.slice/crio-31b2692f7fbcfb8639b32846d68081f6b408d80768483f9f724b934c36f79816 WatchSource:0}: Error finding container 31b2692f7fbcfb8639b32846d68081f6b408d80768483f9f724b934c36f79816: Status 404 returned error can't find the container with id 31b2692f7fbcfb8639b32846d68081f6b408d80768483f9f724b934c36f79816 Jun 06 22:11:06.011270 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:06.011187 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" event={"ID":"ad379da5-e96b-4306-82a8-b553e550e707","Type":"ContainerStarted","Data":"31b2692f7fbcfb8639b32846d68081f6b408d80768483f9f724b934c36f79816"} Jun 06 22:11:09.026282 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:09.026244 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" event={"ID":"ad379da5-e96b-4306-82a8-b553e550e707","Type":"ContainerStarted","Data":"7b9c8e54e539d9ab70ad294d999308e3c8ac996d0ae2ac515d26610d5cf64fc0"} Jun 06 22:11:09.026684 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:09.026359 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" Jun 06 22:11:09.046085 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:09.046002 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" podStartSLOduration=1.383949598 podStartE2EDuration="4.0459849s" totalImagesPullingTime="2.662035302s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:11:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:11:09.044474693 +0000 UTC m=+496.246701421" watchObservedRunningTime="2026-06-06 22:11:09.0459849 +0000 UTC m=+496.248211618" Jun 06 22:11:20.033334 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:20.033299 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-ngd5d" Jun 06 22:11:22.401561 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.401532 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-64ff74d9d5-bzmhd"] Jun 06 22:11:22.408494 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.408469 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64ff74d9d5-bzmhd" Jun 06 22:11:22.410519 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.410493 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-fml2j\"" Jun 06 22:11:22.410643 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.410546 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 06 22:11:22.413791 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.413765 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64ff74d9d5-bzmhd"] Jun 06 22:11:22.560945 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.560901 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vr95\" (UniqueName: \"kubernetes.io/projected/5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e-kube-api-access-7vr95\") pod \"dashboard-redirect-64ff74d9d5-bzmhd\" (UID: \"5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e\") " pod="opendatahub/dashboard-redirect-64ff74d9d5-bzmhd" Jun 06 22:11:22.561151 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.560955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e-redirect-config\") pod \"dashboard-redirect-64ff74d9d5-bzmhd\" (UID: \"5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e\") " pod="opendatahub/dashboard-redirect-64ff74d9d5-bzmhd" Jun 06 22:11:22.662182 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.662097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e-redirect-config\") pod \"dashboard-redirect-64ff74d9d5-bzmhd\" (UID: \"5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e\") " pod="opendatahub/dashboard-redirect-64ff74d9d5-bzmhd" Jun 06 22:11:22.662321 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.662193 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vr95\" (UniqueName: \"kubernetes.io/projected/5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e-kube-api-access-7vr95\") pod \"dashboard-redirect-64ff74d9d5-bzmhd\" (UID: \"5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e\") " pod="opendatahub/dashboard-redirect-64ff74d9d5-bzmhd" Jun 06 22:11:22.662872 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.662850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e-redirect-config\") pod \"dashboard-redirect-64ff74d9d5-bzmhd\" (UID: \"5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e\") " pod="opendatahub/dashboard-redirect-64ff74d9d5-bzmhd" Jun 06 22:11:22.669749 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.669719 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vr95\" (UniqueName: \"kubernetes.io/projected/5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e-kube-api-access-7vr95\") pod \"dashboard-redirect-64ff74d9d5-bzmhd\" (UID: \"5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e\") " pod="opendatahub/dashboard-redirect-64ff74d9d5-bzmhd" Jun 06 22:11:22.721565 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.721532 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-64ff74d9d5-bzmhd" Jun 06 22:11:22.874249 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:22.874215 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-64ff74d9d5-bzmhd"] Jun 06 22:11:22.878253 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:11:22.878217 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e97e1a5_0868_4a80_be29_6ce1c9d9ba3e.slice/crio-70b640fa63e666e71a911eeab6e65cab6d91a1e197e7736595a2832dbce2d83f WatchSource:0}: Error finding container 70b640fa63e666e71a911eeab6e65cab6d91a1e197e7736595a2832dbce2d83f: Status 404 returned error can't find the container with id 70b640fa63e666e71a911eeab6e65cab6d91a1e197e7736595a2832dbce2d83f Jun 06 22:11:23.086222 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:23.086186 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64ff74d9d5-bzmhd" event={"ID":"5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e","Type":"ContainerStarted","Data":"70b640fa63e666e71a911eeab6e65cab6d91a1e197e7736595a2832dbce2d83f"} Jun 06 22:11:25.100020 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:25.099982 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-64ff74d9d5-bzmhd" event={"ID":"5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e","Type":"ContainerStarted","Data":"d2ab28ad42e39cde33fc37c515bd283e6d2827f0a9a57b583f29e58835e3889b"} Jun 06 22:11:25.114585 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:25.114330 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-64ff74d9d5-bzmhd" podStartSLOduration=1.263077966 podStartE2EDuration="3.114312099s" totalImagesPullingTime="1.851234133s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:11:25.114101998 +0000 UTC m=+512.316328716" watchObservedRunningTime="2026-06-06 22:11:25.114312099 +0000 UTC m=+512.316538820" Jun 06 22:11:31.997735 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:31.997701 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-m6n7w" Jun 06 22:11:32.000827 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.000803 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-n25zl" Jun 06 22:11:32.052400 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.052372 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2"] Jun 06 22:11:32.055778 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.055743 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.057726 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.057692 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 06 22:11:32.057861 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.057692 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 06 22:11:32.057978 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.057957 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 06 22:11:32.058056 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.057978 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fzzwn\"" Jun 06 22:11:32.058288 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.058268 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 06 22:11:32.075122 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.075091 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2"] Jun 06 22:11:32.239355 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.239317 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c945804a-e773-40ce-981c-6c521780a73d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.239355 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.239362 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c945804a-e773-40ce-981c-6c521780a73d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.239606 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.239384 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c945804a-e773-40ce-981c-6c521780a73d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.239606 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.239475 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c945804a-e773-40ce-981c-6c521780a73d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.239606 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.239530 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c945804a-e773-40ce-981c-6c521780a73d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.239606 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.239586 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c945804a-e773-40ce-981c-6c521780a73d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.239754 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.239619 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr4n7\" (UniqueName: \"kubernetes.io/projected/c945804a-e773-40ce-981c-6c521780a73d-kube-api-access-sr4n7\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.340166 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.340133 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr4n7\" (UniqueName: \"kubernetes.io/projected/c945804a-e773-40ce-981c-6c521780a73d-kube-api-access-sr4n7\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.340344 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.340176 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c945804a-e773-40ce-981c-6c521780a73d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.340344 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.340218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c945804a-e773-40ce-981c-6c521780a73d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.340344 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.340247 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c945804a-e773-40ce-981c-6c521780a73d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.340344 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.340274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c945804a-e773-40ce-981c-6c521780a73d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.340601 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.340485 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c945804a-e773-40ce-981c-6c521780a73d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.340601 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.340553 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c945804a-e773-40ce-981c-6c521780a73d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.341213 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.341183 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c945804a-e773-40ce-981c-6c521780a73d-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.343064 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.343017 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c945804a-e773-40ce-981c-6c521780a73d-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.343257 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.343235 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c945804a-e773-40ce-981c-6c521780a73d-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.343335 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.343315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c945804a-e773-40ce-981c-6c521780a73d-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.343463 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.343438 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c945804a-e773-40ce-981c-6c521780a73d-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.347485 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.347461 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c945804a-e773-40ce-981c-6c521780a73d-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.348187 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.348161 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr4n7\" (UniqueName: \"kubernetes.io/projected/c945804a-e773-40ce-981c-6c521780a73d-kube-api-access-sr4n7\") pod \"istiod-openshift-gateway-75c67f8887-l4wd2\" (UID: \"c945804a-e773-40ce-981c-6c521780a73d\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.366041 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.366015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:32.514767 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:32.514734 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2"] Jun 06 22:11:32.517806 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:11:32.517778 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc945804a_e773_40ce_981c_6c521780a73d.slice/crio-22da0997905c571425096f1c47ef5549a7e10e99cbd84fe2d38c9b3b956eba98 WatchSource:0}: Error finding container 22da0997905c571425096f1c47ef5549a7e10e99cbd84fe2d38c9b3b956eba98: Status 404 returned error can't find the container with id 22da0997905c571425096f1c47ef5549a7e10e99cbd84fe2d38c9b3b956eba98 Jun 06 22:11:33.135141 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:33.135099 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" event={"ID":"c945804a-e773-40ce-981c-6c521780a73d","Type":"ContainerStarted","Data":"22da0997905c571425096f1c47ef5549a7e10e99cbd84fe2d38c9b3b956eba98"} Jun 06 22:11:34.891336 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:34.891303 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 22:11:34.891559 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:34.891368 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jun 06 22:11:35.146248 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:35.146138 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" event={"ID":"c945804a-e773-40ce-981c-6c521780a73d","Type":"ContainerStarted","Data":"7f1b4bde7fee810df264149b55ca1df34672423d4432ab00a359f1afb455af67"} Jun 06 22:11:35.146248 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:35.146207 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:11:35.148004 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:35.147977 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-l4wd2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 06 22:11:35.148149 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:35.148026 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" podUID="c945804a-e773-40ce-981c-6c521780a73d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 22:11:35.165880 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:35.165830 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" podStartSLOduration=0.794638877 podStartE2EDuration="3.165810576s" totalImagesPullingTime="2.371171699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:11:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:11:35.164468576 +0000 UTC m=+522.366695295" watchObservedRunningTime="2026-06-06 22:11:35.165810576 +0000 UTC m=+522.368037298" Jun 06 22:11:36.150470 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:36.150435 2574 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-l4wd2 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 06 22:11:36.150858 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:36.150491 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" podUID="c945804a-e773-40ce-981c-6c521780a73d" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 06 22:11:39.151330 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:11:39.151297 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-l4wd2" Jun 06 22:12:27.234969 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.234930 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n"] Jun 06 22:12:27.238319 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.238295 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:27.240317 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.240294 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 06 22:12:27.240423 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.240294 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-l7rcj\"" Jun 06 22:12:27.240423 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.240364 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 06 22:12:27.249643 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.249614 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n"] Jun 06 22:12:27.388491 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.388449 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/992d829e-dc29-46e6-a0e3-6b60214494dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zx2n\" (UID: \"992d829e-dc29-46e6-a0e3-6b60214494dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:27.388491 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.388493 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht9jz\" (UniqueName: \"kubernetes.io/projected/992d829e-dc29-46e6-a0e3-6b60214494dc-kube-api-access-ht9jz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zx2n\" (UID: \"992d829e-dc29-46e6-a0e3-6b60214494dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:27.489862 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.489772 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/992d829e-dc29-46e6-a0e3-6b60214494dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zx2n\" (UID: \"992d829e-dc29-46e6-a0e3-6b60214494dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:27.489862 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.489814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht9jz\" (UniqueName: \"kubernetes.io/projected/992d829e-dc29-46e6-a0e3-6b60214494dc-kube-api-access-ht9jz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zx2n\" (UID: \"992d829e-dc29-46e6-a0e3-6b60214494dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:27.490205 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.490186 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/992d829e-dc29-46e6-a0e3-6b60214494dc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zx2n\" (UID: \"992d829e-dc29-46e6-a0e3-6b60214494dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:27.504288 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.504260 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht9jz\" (UniqueName: \"kubernetes.io/projected/992d829e-dc29-46e6-a0e3-6b60214494dc-kube-api-access-ht9jz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-6zx2n\" (UID: \"992d829e-dc29-46e6-a0e3-6b60214494dc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:27.548315 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.548267 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:27.683164 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:27.683130 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n"] Jun 06 22:12:27.686707 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:12:27.686669 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod992d829e_dc29_46e6_a0e3_6b60214494dc.slice/crio-3f9344d91953f62eb3ace8038f26301ce942d45db9cb6a512a8eecf710f9b3a1 WatchSource:0}: Error finding container 3f9344d91953f62eb3ace8038f26301ce942d45db9cb6a512a8eecf710f9b3a1: Status 404 returned error can't find the container with id 3f9344d91953f62eb3ace8038f26301ce942d45db9cb6a512a8eecf710f9b3a1 Jun 06 22:12:28.359630 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:28.359587 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" event={"ID":"992d829e-dc29-46e6-a0e3-6b60214494dc","Type":"ContainerStarted","Data":"3f9344d91953f62eb3ace8038f26301ce942d45db9cb6a512a8eecf710f9b3a1"} Jun 06 22:12:32.379331 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:32.379298 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" event={"ID":"992d829e-dc29-46e6-a0e3-6b60214494dc","Type":"ContainerStarted","Data":"5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5"} Jun 06 22:12:32.379693 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:32.379423 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:32.396246 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:32.396195 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" podStartSLOduration=0.792957126 podStartE2EDuration="5.396178507s" totalImagesPullingTime="4.603221381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:12:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:12:32.394662216 +0000 UTC m=+579.596888934" watchObservedRunningTime="2026-06-06 22:12:32.396178507 +0000 UTC m=+579.598405225" Jun 06 22:12:43.386460 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:43.386425 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:45.066162 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.066122 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n"] Jun 06 22:12:45.066556 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.066384 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" podUID="992d829e-dc29-46e6-a0e3-6b60214494dc" containerName="manager" containerID="cri-o://5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5" gracePeriod=2 Jun 06 22:12:45.077493 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.077465 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n"] Jun 06 22:12:45.081370 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:12:45.081335 2574 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"992d829e-dc29-46e6-a0e3-6b60214494dc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-6zx2n\": pods \"kuadrant-operator-controller-manager-8684c9ff49-6zx2n\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:45.092011 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.091983 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc"] Jun 06 22:12:45.092308 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.092294 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="992d829e-dc29-46e6-a0e3-6b60214494dc" containerName="manager" Jun 06 22:12:45.092308 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.092308 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="992d829e-dc29-46e6-a0e3-6b60214494dc" containerName="manager" Jun 06 22:12:45.092426 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.092361 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="992d829e-dc29-46e6-a0e3-6b60214494dc" containerName="manager" Jun 06 22:12:45.095180 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.095158 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:12:45.097404 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:12:45.097354 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6zx2n\" is forbidden: User \"system:node:ip-10-0-141-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-122.ec2.internal' and this object" podUID="992d829e-dc29-46e6-a0e3-6b60214494dc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:45.113969 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.113939 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc"] Jun 06 22:12:45.122266 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.122234 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbf1216b-c895-47ff-8668-ea2a725c9764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wpbvc\" (UID: \"dbf1216b-c895-47ff-8668-ea2a725c9764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:12:45.122443 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.122279 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdsm6\" (UniqueName: \"kubernetes.io/projected/dbf1216b-c895-47ff-8668-ea2a725c9764-kube-api-access-jdsm6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wpbvc\" (UID: \"dbf1216b-c895-47ff-8668-ea2a725c9764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:12:45.125682 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.125650 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r"] Jun 06 22:12:45.129365 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.129341 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r" Jun 06 22:12:45.131627 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.131601 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6c99q\"" Jun 06 22:12:45.131758 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:12:45.131691 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-6zx2n\" is forbidden: User \"system:node:ip-10-0-141-122.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-122.ec2.internal' and this object" podUID="992d829e-dc29-46e6-a0e3-6b60214494dc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:45.141019 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.140994 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r"] Jun 06 22:12:45.223022 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.222992 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smr67\" (UniqueName: \"kubernetes.io/projected/7d09990f-bba5-4b8f-8d2e-1b65837a95ea-kube-api-access-smr67\") pod \"limitador-operator-controller-manager-859d7b78bd-4vm5r\" (UID: \"7d09990f-bba5-4b8f-8d2e-1b65837a95ea\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r" Jun 06 22:12:45.223320 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.223042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbf1216b-c895-47ff-8668-ea2a725c9764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wpbvc\" (UID: \"dbf1216b-c895-47ff-8668-ea2a725c9764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:12:45.223320 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.223139 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdsm6\" (UniqueName: \"kubernetes.io/projected/dbf1216b-c895-47ff-8668-ea2a725c9764-kube-api-access-jdsm6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wpbvc\" (UID: \"dbf1216b-c895-47ff-8668-ea2a725c9764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:12:45.223448 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.223372 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbf1216b-c895-47ff-8668-ea2a725c9764-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wpbvc\" (UID: \"dbf1216b-c895-47ff-8668-ea2a725c9764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:12:45.231406 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.231380 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdsm6\" (UniqueName: \"kubernetes.io/projected/dbf1216b-c895-47ff-8668-ea2a725c9764-kube-api-access-jdsm6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-wpbvc\" (UID: \"dbf1216b-c895-47ff-8668-ea2a725c9764\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:12:45.312177 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.312152 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:45.324274 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.324223 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/992d829e-dc29-46e6-a0e3-6b60214494dc-extensions-socket-volume\") pod \"992d829e-dc29-46e6-a0e3-6b60214494dc\" (UID: \"992d829e-dc29-46e6-a0e3-6b60214494dc\") " Jun 06 22:12:45.324343 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.324321 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ht9jz\" (UniqueName: \"kubernetes.io/projected/992d829e-dc29-46e6-a0e3-6b60214494dc-kube-api-access-ht9jz\") pod \"992d829e-dc29-46e6-a0e3-6b60214494dc\" (UID: \"992d829e-dc29-46e6-a0e3-6b60214494dc\") " Jun 06 22:12:45.324504 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.324484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smr67\" (UniqueName: \"kubernetes.io/projected/7d09990f-bba5-4b8f-8d2e-1b65837a95ea-kube-api-access-smr67\") pod \"limitador-operator-controller-manager-859d7b78bd-4vm5r\" (UID: \"7d09990f-bba5-4b8f-8d2e-1b65837a95ea\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r" Jun 06 22:12:45.324731 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.324707 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/992d829e-dc29-46e6-a0e3-6b60214494dc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "992d829e-dc29-46e6-a0e3-6b60214494dc" (UID: "992d829e-dc29-46e6-a0e3-6b60214494dc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 22:12:45.326429 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.326408 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/992d829e-dc29-46e6-a0e3-6b60214494dc-kube-api-access-ht9jz" (OuterVolumeSpecName: "kube-api-access-ht9jz") pod "992d829e-dc29-46e6-a0e3-6b60214494dc" (UID: "992d829e-dc29-46e6-a0e3-6b60214494dc"). InnerVolumeSpecName "kube-api-access-ht9jz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 22:12:45.337322 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.337300 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-smr67\" (UniqueName: \"kubernetes.io/projected/7d09990f-bba5-4b8f-8d2e-1b65837a95ea-kube-api-access-smr67\") pod \"limitador-operator-controller-manager-859d7b78bd-4vm5r\" (UID: \"7d09990f-bba5-4b8f-8d2e-1b65837a95ea\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r" Jun 06 22:12:45.425653 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.425614 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/992d829e-dc29-46e6-a0e3-6b60214494dc-extensions-socket-volume\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:12:45.425653 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.425644 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ht9jz\" (UniqueName: \"kubernetes.io/projected/992d829e-dc29-46e6-a0e3-6b60214494dc-kube-api-access-ht9jz\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:12:45.435356 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.435320 2574 generic.go:356] "Generic (PLEG): container finished" podID="992d829e-dc29-46e6-a0e3-6b60214494dc" containerID="5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5" exitCode=0 Jun 06 22:12:45.435504 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.435368 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-6zx2n" Jun 06 22:12:45.435504 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.435416 2574 scope.go:117] "RemoveContainer" containerID="5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5" Jun 06 22:12:45.444417 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.444398 2574 scope.go:117] "RemoveContainer" containerID="5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5" Jun 06 22:12:45.444712 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:12:45.444693 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5\": container with ID starting with 5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5 not found: ID does not exist" containerID="5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5" Jun 06 22:12:45.444756 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.444722 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5"} err="failed to get container status \"5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5\": rpc error: code = NotFound desc = could not find container \"5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5\": container with ID starting with 5a16b6c2b974d87a98836e17fd7124e58cfbf1eeb51d1341f4595aeb5f8bc9c5 not found: ID does not exist" Jun 06 22:12:45.447869 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.447850 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:12:45.455084 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.455041 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r" Jun 06 22:12:45.624340 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.624306 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc"] Jun 06 22:12:45.627801 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:12:45.627773 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbf1216b_c895_47ff_8668_ea2a725c9764.slice/crio-dcb9230728dafe8b2283e6e26bcd73e4c99255f76d24aa3c7597f675fe59c723 WatchSource:0}: Error finding container dcb9230728dafe8b2283e6e26bcd73e4c99255f76d24aa3c7597f675fe59c723: Status 404 returned error can't find the container with id dcb9230728dafe8b2283e6e26bcd73e4c99255f76d24aa3c7597f675fe59c723 Jun 06 22:12:45.636527 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:45.636494 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r"] Jun 06 22:12:45.639160 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:12:45.639101 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d09990f_bba5_4b8f_8d2e_1b65837a95ea.slice/crio-3fc191f82eefd4c7ba74a43b8a70f36167c1fc55132cd94f112ce0e41125c326 WatchSource:0}: Error finding container 3fc191f82eefd4c7ba74a43b8a70f36167c1fc55132cd94f112ce0e41125c326: Status 404 returned error can't find the container with id 3fc191f82eefd4c7ba74a43b8a70f36167c1fc55132cd94f112ce0e41125c326 Jun 06 22:12:46.443790 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:46.443755 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" event={"ID":"dbf1216b-c895-47ff-8668-ea2a725c9764","Type":"ContainerStarted","Data":"70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378"} Jun 06 22:12:46.444365 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:46.443808 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" event={"ID":"dbf1216b-c895-47ff-8668-ea2a725c9764","Type":"ContainerStarted","Data":"dcb9230728dafe8b2283e6e26bcd73e4c99255f76d24aa3c7597f675fe59c723"} Jun 06 22:12:46.444365 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:46.443860 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:12:46.445084 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:46.445032 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r" event={"ID":"7d09990f-bba5-4b8f-8d2e-1b65837a95ea","Type":"ContainerStarted","Data":"3fc191f82eefd4c7ba74a43b8a70f36167c1fc55132cd94f112ce0e41125c326"} Jun 06 22:12:46.461724 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:46.461667 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" podStartSLOduration=1.461647599 podStartE2EDuration="1.461647599s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:12:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:12:46.460805855 +0000 UTC m=+593.663032573" watchObservedRunningTime="2026-06-06 22:12:46.461647599 +0000 UTC m=+593.663874317" Jun 06 22:12:47.207853 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:47.207772 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="992d829e-dc29-46e6-a0e3-6b60214494dc" path="/var/lib/kubelet/pods/992d829e-dc29-46e6-a0e3-6b60214494dc/volumes" Jun 06 22:12:47.450927 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:47.450891 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r" event={"ID":"7d09990f-bba5-4b8f-8d2e-1b65837a95ea","Type":"ContainerStarted","Data":"8cf9e30d4cf4ab7e953cc01bb869740a7a55303b306db9e112823b70de4e37c2"} Jun 06 22:12:47.451408 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:47.451104 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r" Jun 06 22:12:47.469990 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:47.469889 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r" podStartSLOduration=1.183478829 podStartE2EDuration="2.469868213s" totalImagesPullingTime="1.286389384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:12:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:12:47.469441426 +0000 UTC m=+594.671668148" watchObservedRunningTime="2026-06-06 22:12:47.469868213 +0000 UTC m=+594.672094932" Jun 06 22:12:53.168276 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:53.168250 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:12:53.168670 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:53.168251 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:12:57.453777 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:57.453746 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:12:58.457709 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:12:58.457672 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-4vm5r" Jun 06 22:13:00.925700 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:00.925662 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc"] Jun 06 22:13:00.926122 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:00.925872 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" podUID="dbf1216b-c895-47ff-8668-ea2a725c9764" containerName="manager" containerID="cri-o://70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378" gracePeriod=10 Jun 06 22:13:01.181425 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.181357 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:13:01.249617 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.249566 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbf1216b-c895-47ff-8668-ea2a725c9764-extensions-socket-volume\") pod \"dbf1216b-c895-47ff-8668-ea2a725c9764\" (UID: \"dbf1216b-c895-47ff-8668-ea2a725c9764\") " Jun 06 22:13:01.249819 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.249631 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdsm6\" (UniqueName: \"kubernetes.io/projected/dbf1216b-c895-47ff-8668-ea2a725c9764-kube-api-access-jdsm6\") pod \"dbf1216b-c895-47ff-8668-ea2a725c9764\" (UID: \"dbf1216b-c895-47ff-8668-ea2a725c9764\") " Jun 06 22:13:01.249976 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.249945 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dbf1216b-c895-47ff-8668-ea2a725c9764-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dbf1216b-c895-47ff-8668-ea2a725c9764" (UID: "dbf1216b-c895-47ff-8668-ea2a725c9764"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 06 22:13:01.251704 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.251671 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbf1216b-c895-47ff-8668-ea2a725c9764-kube-api-access-jdsm6" (OuterVolumeSpecName: "kube-api-access-jdsm6") pod "dbf1216b-c895-47ff-8668-ea2a725c9764" (UID: "dbf1216b-c895-47ff-8668-ea2a725c9764"). InnerVolumeSpecName "kube-api-access-jdsm6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 22:13:01.350911 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.350872 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dbf1216b-c895-47ff-8668-ea2a725c9764-extensions-socket-volume\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:13:01.350911 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.350904 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdsm6\" (UniqueName: \"kubernetes.io/projected/dbf1216b-c895-47ff-8668-ea2a725c9764-kube-api-access-jdsm6\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:13:01.510703 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.510613 2574 generic.go:356] "Generic (PLEG): container finished" podID="dbf1216b-c895-47ff-8668-ea2a725c9764" containerID="70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378" exitCode=0 Jun 06 22:13:01.510703 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.510651 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" event={"ID":"dbf1216b-c895-47ff-8668-ea2a725c9764","Type":"ContainerDied","Data":"70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378"} Jun 06 22:13:01.510703 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.510661 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" Jun 06 22:13:01.510703 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.510695 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc" event={"ID":"dbf1216b-c895-47ff-8668-ea2a725c9764","Type":"ContainerDied","Data":"dcb9230728dafe8b2283e6e26bcd73e4c99255f76d24aa3c7597f675fe59c723"} Jun 06 22:13:01.510965 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.510717 2574 scope.go:117] "RemoveContainer" containerID="70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378" Jun 06 22:13:01.519205 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.519188 2574 scope.go:117] "RemoveContainer" containerID="70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378" Jun 06 22:13:01.519445 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:13:01.519427 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378\": container with ID starting with 70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378 not found: ID does not exist" containerID="70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378" Jun 06 22:13:01.519520 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.519458 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378"} err="failed to get container status \"70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378\": rpc error: code = NotFound desc = could not find container \"70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378\": container with ID starting with 70fafac1ba0deb6eefc585e6378863654fdf8834d3b0024517c4cae821c67378 not found: ID does not exist" Jun 06 22:13:01.540941 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.540909 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc"] Jun 06 22:13:01.546290 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:01.546268 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-wpbvc"] Jun 06 22:13:03.207156 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:03.207121 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbf1216b-c895-47ff-8668-ea2a725c9764" path="/var/lib/kubelet/pods/dbf1216b-c895-47ff-8668-ea2a725c9764/volumes" Jun 06 22:13:31.147972 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.147929 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnz9s"] Jun 06 22:13:31.148488 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.148308 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbf1216b-c895-47ff-8668-ea2a725c9764" containerName="manager" Jun 06 22:13:31.148488 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.148321 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbf1216b-c895-47ff-8668-ea2a725c9764" containerName="manager" Jun 06 22:13:31.148488 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.148386 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbf1216b-c895-47ff-8668-ea2a725c9764" containerName="manager" Jun 06 22:13:31.151246 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.151227 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:31.153243 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.153218 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-44xpd\"" Jun 06 22:13:31.153358 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.153218 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 06 22:13:31.159442 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.159420 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnz9s"] Jun 06 22:13:31.242395 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.242356 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnz9s"] Jun 06 22:13:31.296155 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.296112 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-config-file\") pod \"limitador-limitador-64c94fd64f-rnz9s\" (UID: \"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:31.296343 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.296195 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf2fq\" (UniqueName: \"kubernetes.io/projected/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-kube-api-access-sf2fq\") pod \"limitador-limitador-64c94fd64f-rnz9s\" (UID: \"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:31.396836 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.396798 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf2fq\" (UniqueName: \"kubernetes.io/projected/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-kube-api-access-sf2fq\") pod \"limitador-limitador-64c94fd64f-rnz9s\" (UID: \"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:31.397009 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.396846 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-config-file\") pod \"limitador-limitador-64c94fd64f-rnz9s\" (UID: \"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:31.397462 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.397444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-config-file\") pod \"limitador-limitador-64c94fd64f-rnz9s\" (UID: \"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:31.418624 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.418542 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf2fq\" (UniqueName: \"kubernetes.io/projected/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-kube-api-access-sf2fq\") pod \"limitador-limitador-64c94fd64f-rnz9s\" (UID: \"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:31.462578 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.462541 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:31.593530 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.593497 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnz9s"] Jun 06 22:13:31.597472 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:13:31.597446 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65c3981d_4b4a_4c1c_8537_46b1f2d78cc8.slice/crio-70e0096f2ea2ce27256d214e50b11a44aed63b11cf74aa38e306b609832aa352 WatchSource:0}: Error finding container 70e0096f2ea2ce27256d214e50b11a44aed63b11cf74aa38e306b609832aa352: Status 404 returned error can't find the container with id 70e0096f2ea2ce27256d214e50b11a44aed63b11cf74aa38e306b609832aa352 Jun 06 22:13:31.642151 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:31.642116 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" event={"ID":"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8","Type":"ContainerStarted","Data":"70e0096f2ea2ce27256d214e50b11a44aed63b11cf74aa38e306b609832aa352"} Jun 06 22:13:34.663666 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:34.663624 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" event={"ID":"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8","Type":"ContainerStarted","Data":"97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b"} Jun 06 22:13:34.664175 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:34.663767 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:34.679345 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:34.679291 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" podStartSLOduration=1.023008533 podStartE2EDuration="3.679276781s" totalImagesPullingTime="2.656268248s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:13:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:13:34.678120693 +0000 UTC m=+641.880347401" watchObservedRunningTime="2026-06-06 22:13:34.679276781 +0000 UTC m=+641.881503527" Jun 06 22:13:45.668783 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:45.668751 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:48.510415 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:48.510371 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnz9s"] Jun 06 22:13:48.510825 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:48.510595 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" podUID="65c3981d-4b4a-4c1c-8537-46b1f2d78cc8" containerName="limitador" containerID="cri-o://97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b" gracePeriod=30 Jun 06 22:13:49.057640 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.057613 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:49.139322 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.139236 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-config-file\") pod \"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8\" (UID: \"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8\") " Jun 06 22:13:49.139322 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.139313 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf2fq\" (UniqueName: \"kubernetes.io/projected/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-kube-api-access-sf2fq\") pod \"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8\" (UID: \"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8\") " Jun 06 22:13:49.139636 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.139600 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-config-file" (OuterVolumeSpecName: "config-file") pod "65c3981d-4b4a-4c1c-8537-46b1f2d78cc8" (UID: "65c3981d-4b4a-4c1c-8537-46b1f2d78cc8"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 06 22:13:49.141343 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.141315 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-kube-api-access-sf2fq" (OuterVolumeSpecName: "kube-api-access-sf2fq") pod "65c3981d-4b4a-4c1c-8537-46b1f2d78cc8" (UID: "65c3981d-4b4a-4c1c-8537-46b1f2d78cc8"). InnerVolumeSpecName "kube-api-access-sf2fq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 22:13:49.240523 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.240487 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf2fq\" (UniqueName: \"kubernetes.io/projected/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-kube-api-access-sf2fq\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:13:49.240523 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.240517 2574 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8-config-file\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:13:49.725655 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.725617 2574 generic.go:356] "Generic (PLEG): container finished" podID="65c3981d-4b4a-4c1c-8537-46b1f2d78cc8" containerID="97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b" exitCode=0 Jun 06 22:13:49.726175 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.725669 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" Jun 06 22:13:49.726175 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.725670 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" event={"ID":"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8","Type":"ContainerDied","Data":"97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b"} Jun 06 22:13:49.726175 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.725802 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-rnz9s" event={"ID":"65c3981d-4b4a-4c1c-8537-46b1f2d78cc8","Type":"ContainerDied","Data":"70e0096f2ea2ce27256d214e50b11a44aed63b11cf74aa38e306b609832aa352"} Jun 06 22:13:49.726175 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.725833 2574 scope.go:117] "RemoveContainer" containerID="97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b" Jun 06 22:13:49.736210 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.736189 2574 scope.go:117] "RemoveContainer" containerID="97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b" Jun 06 22:13:49.736781 ip-10-0-141-122 kubenswrapper[2574]: E0606 22:13:49.736761 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b\": container with ID starting with 97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b not found: ID does not exist" containerID="97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b" Jun 06 22:13:49.736857 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.736791 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b"} err="failed to get container status \"97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b\": rpc error: code = NotFound desc = could not find container \"97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b\": container with ID starting with 97a57d94edfa5511801406a50bc27c3060d6bd9f649ea1024ac7a309c53acb3b not found: ID does not exist" Jun 06 22:13:49.739590 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.739554 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnz9s"] Jun 06 22:13:49.743392 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:49.743368 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-rnz9s"] Jun 06 22:13:51.208054 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:51.208017 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65c3981d-4b4a-4c1c-8537-46b1f2d78cc8" path="/var/lib/kubelet/pods/65c3981d-4b4a-4c1c-8537-46b1f2d78cc8/volumes" Jun 06 22:13:52.431262 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.431228 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-ntcg8"] Jun 06 22:13:52.431733 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.431521 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65c3981d-4b4a-4c1c-8537-46b1f2d78cc8" containerName="limitador" Jun 06 22:13:52.431733 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.431533 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="65c3981d-4b4a-4c1c-8537-46b1f2d78cc8" containerName="limitador" Jun 06 22:13:52.431733 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.431592 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="65c3981d-4b4a-4c1c-8537-46b1f2d78cc8" containerName="limitador" Jun 06 22:13:52.435826 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.435798 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ntcg8" Jun 06 22:13:52.437591 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.437564 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 06 22:13:52.441598 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.441561 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ntcg8"] Jun 06 22:13:52.467091 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.467032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t87j\" (UniqueName: \"kubernetes.io/projected/120a56e5-2559-4358-a27a-3c5379c7b860-kube-api-access-5t87j\") pod \"postgres-69fb4594cf-ntcg8\" (UID: \"120a56e5-2559-4358-a27a-3c5379c7b860\") " pod="opendatahub/postgres-69fb4594cf-ntcg8" Jun 06 22:13:52.467091 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.467083 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/120a56e5-2559-4358-a27a-3c5379c7b860-data\") pod \"postgres-69fb4594cf-ntcg8\" (UID: \"120a56e5-2559-4358-a27a-3c5379c7b860\") " pod="opendatahub/postgres-69fb4594cf-ntcg8" Jun 06 22:13:52.567559 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.567513 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t87j\" (UniqueName: \"kubernetes.io/projected/120a56e5-2559-4358-a27a-3c5379c7b860-kube-api-access-5t87j\") pod \"postgres-69fb4594cf-ntcg8\" (UID: \"120a56e5-2559-4358-a27a-3c5379c7b860\") " pod="opendatahub/postgres-69fb4594cf-ntcg8" Jun 06 22:13:52.567559 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.567560 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/120a56e5-2559-4358-a27a-3c5379c7b860-data\") pod \"postgres-69fb4594cf-ntcg8\" (UID: \"120a56e5-2559-4358-a27a-3c5379c7b860\") " pod="opendatahub/postgres-69fb4594cf-ntcg8" Jun 06 22:13:52.567920 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.567900 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/120a56e5-2559-4358-a27a-3c5379c7b860-data\") pod \"postgres-69fb4594cf-ntcg8\" (UID: \"120a56e5-2559-4358-a27a-3c5379c7b860\") " pod="opendatahub/postgres-69fb4594cf-ntcg8" Jun 06 22:13:52.575086 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.575039 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t87j\" (UniqueName: \"kubernetes.io/projected/120a56e5-2559-4358-a27a-3c5379c7b860-kube-api-access-5t87j\") pod \"postgres-69fb4594cf-ntcg8\" (UID: \"120a56e5-2559-4358-a27a-3c5379c7b860\") " pod="opendatahub/postgres-69fb4594cf-ntcg8" Jun 06 22:13:52.748423 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.748346 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-ntcg8" Jun 06 22:13:52.885450 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:52.885300 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-ntcg8"] Jun 06 22:13:52.888081 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:13:52.888028 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod120a56e5_2559_4358_a27a_3c5379c7b860.slice/crio-fdae00c59563c792448a09abc08b41bfb9949bd7631c97690f4038eee9187564 WatchSource:0}: Error finding container fdae00c59563c792448a09abc08b41bfb9949bd7631c97690f4038eee9187564: Status 404 returned error can't find the container with id fdae00c59563c792448a09abc08b41bfb9949bd7631c97690f4038eee9187564 Jun 06 22:13:53.748570 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:53.748478 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ntcg8" event={"ID":"120a56e5-2559-4358-a27a-3c5379c7b860","Type":"ContainerStarted","Data":"fdae00c59563c792448a09abc08b41bfb9949bd7631c97690f4038eee9187564"} Jun 06 22:13:55.477455 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:55.477427 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 06 22:13:55.759125 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:55.759021 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-ntcg8" event={"ID":"120a56e5-2559-4358-a27a-3c5379c7b860","Type":"ContainerStarted","Data":"1447d5263d824b401d42bd12ff8e5bf5b4c4c0fb3b5d9a75fe30172deff67ed3"} Jun 06 22:13:55.759312 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:55.759124 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-ntcg8" Jun 06 22:13:55.775971 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:13:55.775915 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-ntcg8" podStartSLOduration=1.190355703 podStartE2EDuration="3.775899084s" totalImagesPullingTime="2.585543381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:13:55.77451227 +0000 UTC m=+662.976738990" watchObservedRunningTime="2026-06-06 22:13:55.775899084 +0000 UTC m=+662.978125830" Jun 06 22:14:01.798242 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:01.798215 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-ntcg8" Jun 06 22:14:10.808916 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:10.808869 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-w9jxm"] Jun 06 22:14:10.820585 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:10.820555 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-w9jxm" Jun 06 22:14:10.820925 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:10.820888 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-w9jxm"] Jun 06 22:14:10.822690 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:10.822668 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 06 22:14:10.823113 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:10.823091 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-zm6rk\"" Jun 06 22:14:10.823113 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:10.823105 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 06 22:14:10.916976 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:10.916938 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf5ls\" (UniqueName: \"kubernetes.io/projected/8aea3983-522f-44ae-8afe-e80134391b96-kube-api-access-nf5ls\") pod \"keycloak-operator-d67dbbb48-w9jxm\" (UID: \"8aea3983-522f-44ae-8afe-e80134391b96\") " pod="keycloak-system/keycloak-operator-d67dbbb48-w9jxm" Jun 06 22:14:11.018061 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:11.018022 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf5ls\" (UniqueName: \"kubernetes.io/projected/8aea3983-522f-44ae-8afe-e80134391b96-kube-api-access-nf5ls\") pod \"keycloak-operator-d67dbbb48-w9jxm\" (UID: \"8aea3983-522f-44ae-8afe-e80134391b96\") " pod="keycloak-system/keycloak-operator-d67dbbb48-w9jxm" Jun 06 22:14:11.033167 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:11.033138 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf5ls\" (UniqueName: \"kubernetes.io/projected/8aea3983-522f-44ae-8afe-e80134391b96-kube-api-access-nf5ls\") pod \"keycloak-operator-d67dbbb48-w9jxm\" (UID: \"8aea3983-522f-44ae-8afe-e80134391b96\") " pod="keycloak-system/keycloak-operator-d67dbbb48-w9jxm" Jun 06 22:14:11.131477 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:11.131368 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-w9jxm" Jun 06 22:14:11.261454 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:11.261371 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-w9jxm"] Jun 06 22:14:11.264263 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:14:11.264230 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8aea3983_522f_44ae_8afe_e80134391b96.slice/crio-16d659ea000a7112d980dcfdbce31f983649b4d3902ed40f7260fc09b6857989 WatchSource:0}: Error finding container 16d659ea000a7112d980dcfdbce31f983649b4d3902ed40f7260fc09b6857989: Status 404 returned error can't find the container with id 16d659ea000a7112d980dcfdbce31f983649b4d3902ed40f7260fc09b6857989 Jun 06 22:14:11.829964 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:11.829926 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-w9jxm" event={"ID":"8aea3983-522f-44ae-8afe-e80134391b96","Type":"ContainerStarted","Data":"16d659ea000a7112d980dcfdbce31f983649b4d3902ed40f7260fc09b6857989"} Jun 06 22:14:16.857449 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:16.857409 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-w9jxm" event={"ID":"8aea3983-522f-44ae-8afe-e80134391b96","Type":"ContainerStarted","Data":"c36d608f636f9d8ae5320ac1381f5681dcdff805a3734306801c7cb9886216f8"} Jun 06 22:14:16.881592 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:14:16.881534 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-w9jxm" podStartSLOduration=1.6965053060000002 podStartE2EDuration="6.881516883s" totalImagesPullingTime="5.185011577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:14:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:14:16.880290315 +0000 UTC m=+684.082517033" watchObservedRunningTime="2026-06-06 22:14:16.881516883 +0000 UTC m=+684.083743599" Jun 06 22:17:53.193095 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:17:53.193008 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:17:53.194384 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:17:53.194362 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:22:53.218766 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:22:53.218740 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:22:53.220238 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:22:53.220217 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:27:53.241768 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:27:53.241741 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:27:53.244434 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:27:53.244056 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:30:00.147587 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:00.147548 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29679750-lqjfz"] Jun 06 22:30:00.150668 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:00.150637 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" Jun 06 22:30:00.152478 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:00.152453 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-w4pbt\"" Jun 06 22:30:00.165376 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:00.165347 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29679750-lqjfz"] Jun 06 22:30:00.202683 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:00.202641 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzdks\" (UniqueName: \"kubernetes.io/projected/dcf36b17-84d6-4732-bacf-e8df80792269-kube-api-access-xzdks\") pod \"maas-api-key-cleanup-29679750-lqjfz\" (UID: \"dcf36b17-84d6-4732-bacf-e8df80792269\") " pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" Jun 06 22:30:00.303832 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:00.303780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzdks\" (UniqueName: \"kubernetes.io/projected/dcf36b17-84d6-4732-bacf-e8df80792269-kube-api-access-xzdks\") pod \"maas-api-key-cleanup-29679750-lqjfz\" (UID: \"dcf36b17-84d6-4732-bacf-e8df80792269\") " pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" Jun 06 22:30:00.310986 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:00.310960 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzdks\" (UniqueName: \"kubernetes.io/projected/dcf36b17-84d6-4732-bacf-e8df80792269-kube-api-access-xzdks\") pod \"maas-api-key-cleanup-29679750-lqjfz\" (UID: \"dcf36b17-84d6-4732-bacf-e8df80792269\") " pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" Jun 06 22:30:00.460861 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:00.460771 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" Jun 06 22:30:00.588523 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:00.588495 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29679750-lqjfz"] Jun 06 22:30:00.591096 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:30:00.591051 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcf36b17_84d6_4732_bacf_e8df80792269.slice/crio-da239bf28499907a4ba13c2f1e3e9274495136cd2cab1e02bda0246a51122862 WatchSource:0}: Error finding container da239bf28499907a4ba13c2f1e3e9274495136cd2cab1e02bda0246a51122862: Status 404 returned error can't find the container with id da239bf28499907a4ba13c2f1e3e9274495136cd2cab1e02bda0246a51122862 Jun 06 22:30:00.592871 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:00.592854 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 06 22:30:00.864526 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:00.864490 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" event={"ID":"dcf36b17-84d6-4732-bacf-e8df80792269","Type":"ContainerStarted","Data":"da239bf28499907a4ba13c2f1e3e9274495136cd2cab1e02bda0246a51122862"} Jun 06 22:30:07.897457 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:07.897353 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" event={"ID":"dcf36b17-84d6-4732-bacf-e8df80792269","Type":"ContainerStarted","Data":"267d71ddddcf652a887e1a7320f98b6a81b1ab9f09821b4e10bc1643d4115463"} Jun 06 22:30:07.911932 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:07.911882 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" podStartSLOduration=1.173864794 podStartE2EDuration="7.911866407s" totalImagesPullingTime="6.738001613s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:30:07.91086079 +0000 UTC m=+1635.113087509" watchObservedRunningTime="2026-06-06 22:30:07.911866407 +0000 UTC m=+1635.114093123" Jun 06 22:30:08.904580 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:08.904541 2574 generic.go:356] "Generic (PLEG): container finished" podID="dcf36b17-84d6-4732-bacf-e8df80792269" containerID="267d71ddddcf652a887e1a7320f98b6a81b1ab9f09821b4e10bc1643d4115463" exitCode=0 Jun 06 22:30:08.905014 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:08.904624 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" event={"ID":"dcf36b17-84d6-4732-bacf-e8df80792269","Type":"ContainerDied","Data":"267d71ddddcf652a887e1a7320f98b6a81b1ab9f09821b4e10bc1643d4115463"} Jun 06 22:30:10.040885 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:10.040859 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" Jun 06 22:30:10.084929 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:10.084898 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xzdks\" (UniqueName: \"kubernetes.io/projected/dcf36b17-84d6-4732-bacf-e8df80792269-kube-api-access-xzdks\") pod \"dcf36b17-84d6-4732-bacf-e8df80792269\" (UID: \"dcf36b17-84d6-4732-bacf-e8df80792269\") " Jun 06 22:30:10.087239 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:10.087206 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcf36b17-84d6-4732-bacf-e8df80792269-kube-api-access-xzdks" (OuterVolumeSpecName: "kube-api-access-xzdks") pod "dcf36b17-84d6-4732-bacf-e8df80792269" (UID: "dcf36b17-84d6-4732-bacf-e8df80792269"). InnerVolumeSpecName "kube-api-access-xzdks". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 06 22:30:10.185988 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:10.185953 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xzdks\" (UniqueName: \"kubernetes.io/projected/dcf36b17-84d6-4732-bacf-e8df80792269-kube-api-access-xzdks\") on node \"ip-10-0-141-122.ec2.internal\" DevicePath \"\"" Jun 06 22:30:10.914668 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:10.914635 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" Jun 06 22:30:10.914668 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:10.914643 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29679750-lqjfz" event={"ID":"dcf36b17-84d6-4732-bacf-e8df80792269","Type":"ContainerDied","Data":"da239bf28499907a4ba13c2f1e3e9274495136cd2cab1e02bda0246a51122862"} Jun 06 22:30:10.914875 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:30:10.914684 2574 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da239bf28499907a4ba13c2f1e3e9274495136cd2cab1e02bda0246a51122862" Jun 06 22:31:31.025736 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.025641 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5"] Jun 06 22:31:31.026303 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.026146 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcf36b17-84d6-4732-bacf-e8df80792269" containerName="cleanup" Jun 06 22:31:31.026303 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.026166 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcf36b17-84d6-4732-bacf-e8df80792269" containerName="cleanup" Jun 06 22:31:31.026303 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.026262 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcf36b17-84d6-4732-bacf-e8df80792269" containerName="cleanup" Jun 06 22:31:31.029062 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.029041 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" Jun 06 22:31:31.030901 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.030881 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-l7rcj\"" Jun 06 22:31:31.039805 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.039784 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5"] Jun 06 22:31:31.133285 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.133244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh8dc\" (UniqueName: \"kubernetes.io/projected/badfb116-8940-456f-a9f9-57762e31fb5a-kube-api-access-mh8dc\") pod \"kuadrant-operator-controller-manager-86878c769f-flhc5\" (UID: \"badfb116-8940-456f-a9f9-57762e31fb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" Jun 06 22:31:31.133459 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.133311 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/badfb116-8940-456f-a9f9-57762e31fb5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-flhc5\" (UID: \"badfb116-8940-456f-a9f9-57762e31fb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" Jun 06 22:31:31.233962 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.233928 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh8dc\" (UniqueName: \"kubernetes.io/projected/badfb116-8940-456f-a9f9-57762e31fb5a-kube-api-access-mh8dc\") pod \"kuadrant-operator-controller-manager-86878c769f-flhc5\" (UID: \"badfb116-8940-456f-a9f9-57762e31fb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" Jun 06 22:31:31.234171 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.233976 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/badfb116-8940-456f-a9f9-57762e31fb5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-flhc5\" (UID: \"badfb116-8940-456f-a9f9-57762e31fb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" Jun 06 22:31:31.234379 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.234357 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/badfb116-8940-456f-a9f9-57762e31fb5a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-flhc5\" (UID: \"badfb116-8940-456f-a9f9-57762e31fb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" Jun 06 22:31:31.241504 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.241483 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh8dc\" (UniqueName: \"kubernetes.io/projected/badfb116-8940-456f-a9f9-57762e31fb5a-kube-api-access-mh8dc\") pod \"kuadrant-operator-controller-manager-86878c769f-flhc5\" (UID: \"badfb116-8940-456f-a9f9-57762e31fb5a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" Jun 06 22:31:31.338954 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.338917 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" Jun 06 22:31:31.485094 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:31.485054 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5"] Jun 06 22:31:31.488180 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:31:31.488147 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbadfb116_8940_456f_a9f9_57762e31fb5a.slice/crio-33275707b1dba36e166fa7d310e2432f80f4394508037a3e3fb6ed08b22564e6 WatchSource:0}: Error finding container 33275707b1dba36e166fa7d310e2432f80f4394508037a3e3fb6ed08b22564e6: Status 404 returned error can't find the container with id 33275707b1dba36e166fa7d310e2432f80f4394508037a3e3fb6ed08b22564e6 Jun 06 22:31:32.263356 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:32.263313 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" event={"ID":"badfb116-8940-456f-a9f9-57762e31fb5a","Type":"ContainerStarted","Data":"e586fb05683ff1bbdd58b73249e0490e79fb6bf1434cb23e3398fcbbb650b999"} Jun 06 22:31:32.263736 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:32.263372 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" event={"ID":"badfb116-8940-456f-a9f9-57762e31fb5a","Type":"ContainerStarted","Data":"33275707b1dba36e166fa7d310e2432f80f4394508037a3e3fb6ed08b22564e6"} Jun 06 22:31:32.263736 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:32.263397 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" Jun 06 22:31:32.280672 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:32.280621 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" podStartSLOduration=1.280604636 podStartE2EDuration="1.280604636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-06 22:31:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:31:32.278677596 +0000 UTC m=+1719.480904314" watchObservedRunningTime="2026-06-06 22:31:32.280604636 +0000 UTC m=+1719.482831353" Jun 06 22:31:43.270519 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:31:43.270485 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-flhc5" Jun 06 22:32:53.265814 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:32:53.265693 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:32:53.269063 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:32:53.269043 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:37:53.295647 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:37:53.295617 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:37:53.300790 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:37:53.300765 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-d7rct_511a926e-4880-4520-be94-6bb456910f1a/ovn-acl-logging/0.log" Jun 06 22:41:31.020246 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:31.020217 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64ff74d9d5-bzmhd_5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e/nginx/0.log" Jun 06 22:41:31.125411 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:31.125361 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-n25zl_604af505-3638-44c1-a28b-7b235cd9bd28/manager/0.log" Jun 06 22:41:31.248569 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:31.248533 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-m6n7w_c5ae21ed-d042-44d6-ac3a-505aacdebc39/manager/0.log" Jun 06 22:41:31.462469 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:31.462443 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29679750-lqjfz_dcf36b17-84d6-4732-bacf-e8df80792269/cleanup/0.log" Jun 06 22:41:31.684013 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:31.683977 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-t9rtl_7b4cadda-8423-4957-94b7-6a873831b653/server/0.log" Jun 06 22:41:31.900283 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:31.900254 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9c76bcc58-65kcf_3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef/copy-manifests/0.log" Jun 06 22:41:31.917120 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:31.917089 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9c76bcc58-65kcf_3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef/manager/0.log" Jun 06 22:41:32.246624 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:32.246544 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ntcg8_120a56e5-2559-4358-a27a-3c5379c7b860/postgres/0.log" Jun 06 22:41:34.001475 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:34.001443 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-flhc5_badfb116-8940-456f-a9f9-57762e31fb5a/manager/0.log" Jun 06 22:41:34.211757 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:34.211720 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4vm5r_7d09990f-bba5-4b8f-8d2e-1b65837a95ea/manager/0.log" Jun 06 22:41:34.675397 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:34.675358 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-l4wd2_c945804a-e773-40ce-981c-6c521780a73d/discovery/0.log" Jun 06 22:41:34.888940 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:34.888912 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d78c7b69-r9tbj_516df559-a664-46e5-9411-440540036932/kube-auth-proxy/0.log" Jun 06 22:41:43.426452 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:43.426367 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-44sh9_7ca9bddb-c443-47df-90f0-88b8db74ccd3/global-pull-secret-syncer/0.log" Jun 06 22:41:43.626236 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:43.626198 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-lpzdk_4d7697b0-6e56-40c9-ae24-47f612e0a2b0/konnectivity-agent/0.log" Jun 06 22:41:43.693564 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:43.693466 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-122.ec2.internal_0a87311d29ccf74442080aeb2ab4f1c4/haproxy/0.log" Jun 06 22:41:47.836509 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:47.836467 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-ngd5d_ad379da5-e96b-4306-82a8-b553e550e707/sail-operator/0.log" Jun 06 22:41:49.057086 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:49.057031 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-flhc5_badfb116-8940-456f-a9f9-57762e31fb5a/manager/0.log" Jun 06 22:41:49.181919 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:49.181876 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-4vm5r_7d09990f-bba5-4b8f-8d2e-1b65837a95ea/manager/0.log" Jun 06 22:41:51.226872 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:51.226844 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fvkv_efe30a75-322e-4bfb-9d8c-e3866f8cbfe8/node-exporter/0.log" Jun 06 22:41:51.247993 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:51.247960 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fvkv_efe30a75-322e-4bfb-9d8c-e3866f8cbfe8/kube-rbac-proxy/0.log" Jun 06 22:41:51.267511 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:51.267482 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-5fvkv_efe30a75-322e-4bfb-9d8c-e3866f8cbfe8/init-textfile/0.log" Jun 06 22:41:56.024298 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.024262 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892"] Jun 06 22:41:56.027507 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.027484 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.029288 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.029264 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pkwkm\"/\"openshift-service-ca.crt\"" Jun 06 22:41:56.029719 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.029703 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pkwkm\"/\"kube-root-ca.crt\"" Jun 06 22:41:56.029817 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.029702 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pkwkm\"/\"default-dockercfg-hl46c\"" Jun 06 22:41:56.033369 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.033344 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892"] Jun 06 22:41:56.066917 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.066861 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-sys\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.067134 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.066928 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l64c5\" (UniqueName: \"kubernetes.io/projected/2723596a-0343-46ef-9e6f-099d796604b1-kube-api-access-l64c5\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.067134 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.066987 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-proc\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.067134 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.067098 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-podres\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.067262 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.067142 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-lib-modules\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.168275 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.168217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-proc\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.168476 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.168295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-podres\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.168476 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.168316 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-lib-modules\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.168476 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.168341 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-proc\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.168476 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.168346 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-sys\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.168476 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.168395 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-sys\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.168476 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.168444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-podres\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.168476 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.168445 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l64c5\" (UniqueName: \"kubernetes.io/projected/2723596a-0343-46ef-9e6f-099d796604b1-kube-api-access-l64c5\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.168476 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.168461 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2723596a-0343-46ef-9e6f-099d796604b1-lib-modules\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.175407 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.175389 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l64c5\" (UniqueName: \"kubernetes.io/projected/2723596a-0343-46ef-9e6f-099d796604b1-kube-api-access-l64c5\") pod \"perf-node-gather-daemonset-6t892\" (UID: \"2723596a-0343-46ef-9e6f-099d796604b1\") " pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.339017 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.338983 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:56.467673 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.467638 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892"] Jun 06 22:41:56.470641 ip-10-0-141-122 kubenswrapper[2574]: W0606 22:41:56.470602 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2723596a_0343_46ef_9e6f_099d796604b1.slice/crio-b2d2b1d9f0baee2a60de11930eca85cbb75afe25dd0c31c178c0208474f54aa9 WatchSource:0}: Error finding container b2d2b1d9f0baee2a60de11930eca85cbb75afe25dd0c31c178c0208474f54aa9: Status 404 returned error can't find the container with id b2d2b1d9f0baee2a60de11930eca85cbb75afe25dd0c31c178c0208474f54aa9 Jun 06 22:41:56.785532 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.785495 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dq67q_d3225a74-e305-445e-aa91-2002863b6d73/dns/0.log" Jun 06 22:41:56.807566 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.807543 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dq67q_d3225a74-e305-445e-aa91-2002863b6d73/kube-rbac-proxy/0.log" Jun 06 22:41:56.970885 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:56.970802 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-x87wj_b12f3564-b124-43da-a185-597650b9b6f7/dns-node-resolver/0.log" Jun 06 22:41:57.022262 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:57.022222 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" event={"ID":"2723596a-0343-46ef-9e6f-099d796604b1","Type":"ContainerStarted","Data":"fccb68ce4f95c541e5e94cacfc32006c968059ea00b3128d78a49c2563ae4268"} Jun 06 22:41:57.022434 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:57.022282 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" event={"ID":"2723596a-0343-46ef-9e6f-099d796604b1","Type":"ContainerStarted","Data":"b2d2b1d9f0baee2a60de11930eca85cbb75afe25dd0c31c178c0208474f54aa9"} Jun 06 22:41:57.022434 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:57.022323 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:41:57.037367 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:57.037319 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" podStartSLOduration=1.037303497 podStartE2EDuration="1.037303497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-06 22:41:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-06 22:41:57.035961832 +0000 UTC m=+2344.238188559" watchObservedRunningTime="2026-06-06 22:41:57.037303497 +0000 UTC m=+2344.239530215" Jun 06 22:41:57.542358 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:57.542322 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pmp7g_b18ed7df-bfef-43ca-af32-7693909a4d7f/node-ca/0.log" Jun 06 22:41:58.648003 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:58.647968 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-l4wd2_c945804a-e773-40ce-981c-6c521780a73d/discovery/0.log" Jun 06 22:41:58.695505 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:58.695471 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d78c7b69-r9tbj_516df559-a664-46e5-9411-440540036932/kube-auth-proxy/0.log" Jun 06 22:41:59.479793 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:41:59.479761 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dr9gv_ea11ebf1-7f7c-433c-b7c2-916388355331/serve-healthcheck-canary/0.log" Jun 06 22:42:00.085528 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:00.085485 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2d5c2_d18be130-ada4-484f-b0e7-8a80c2d46fee/kube-rbac-proxy/0.log" Jun 06 22:42:00.123304 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:00.123279 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2d5c2_d18be130-ada4-484f-b0e7-8a80c2d46fee/exporter/0.log" Jun 06 22:42:00.162406 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:00.162377 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2d5c2_d18be130-ada4-484f-b0e7-8a80c2d46fee/extractor/0.log" Jun 06 22:42:02.694464 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:02.694430 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-64ff74d9d5-bzmhd_5e97e1a5-0868-4a80-be29-6ce1c9d9ba3e/nginx/0.log" Jun 06 22:42:02.720090 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:02.720048 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-n25zl_604af505-3638-44c1-a28b-7b235cd9bd28/manager/0.log" Jun 06 22:42:02.849990 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:02.849955 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-m6n7w_c5ae21ed-d042-44d6-ac3a-505aacdebc39/manager/0.log" Jun 06 22:42:02.903714 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:02.903682 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29679750-lqjfz_dcf36b17-84d6-4732-bacf-e8df80792269/cleanup/0.log" Jun 06 22:42:02.998780 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:02.998690 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-t9rtl_7b4cadda-8423-4957-94b7-6a873831b653/server/0.log" Jun 06 22:42:03.036716 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:03.036687 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pkwkm/perf-node-gather-daemonset-6t892" Jun 06 22:42:03.212743 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:03.212714 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9c76bcc58-65kcf_3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef/manager/0.log" Jun 06 22:42:03.230079 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:03.230051 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-9c76bcc58-65kcf_3151b7a1-5d0f-4b07-b80f-2ba5e238b6ef/copy-manifests/0.log" Jun 06 22:42:03.349594 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:03.349568 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-ntcg8_120a56e5-2559-4358-a27a-3c5379c7b860/postgres/0.log" Jun 06 22:42:09.391675 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:09.391633 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-l4wd2_c945804a-e773-40ce-981c-6c521780a73d/discovery/0.log" Jun 06 22:42:09.420551 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:09.420518 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d78c7b69-r9tbj_516df559-a664-46e5-9411-440540036932/kube-auth-proxy/0.log" Jun 06 22:42:10.806757 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:10.806729 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-l4wd2_c945804a-e773-40ce-981c-6c521780a73d/discovery/0.log" Jun 06 22:42:10.841696 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:10.841664 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d78c7b69-r9tbj_516df559-a664-46e5-9411-440540036932/kube-auth-proxy/0.log" Jun 06 22:42:12.112361 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.112287 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9fww_045a17d2-a35c-4d79-a9b5-93ab54128d08/kube-multus-additional-cni-plugins/0.log" Jun 06 22:42:12.132543 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.132518 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9fww_045a17d2-a35c-4d79-a9b5-93ab54128d08/egress-router-binary-copy/0.log" Jun 06 22:42:12.152899 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.152866 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9fww_045a17d2-a35c-4d79-a9b5-93ab54128d08/cni-plugins/0.log" Jun 06 22:42:12.173305 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.173275 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9fww_045a17d2-a35c-4d79-a9b5-93ab54128d08/bond-cni-plugin/0.log" Jun 06 22:42:12.194160 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.194134 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9fww_045a17d2-a35c-4d79-a9b5-93ab54128d08/routeoverride-cni/0.log" Jun 06 22:42:12.214976 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.214938 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9fww_045a17d2-a35c-4d79-a9b5-93ab54128d08/whereabouts-cni-bincopy/0.log" Jun 06 22:42:12.235392 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.235363 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-q9fww_045a17d2-a35c-4d79-a9b5-93ab54128d08/whereabouts-cni/0.log" Jun 06 22:42:12.488137 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.488034 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-w64sb_6060cc52-d6aa-4840-a8ea-bf2cc720751c/kube-multus/0.log" Jun 06 22:42:12.554594 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.554566 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hr9ch_1bb2a002-a9ac-4494-b7b1-57d94a96711b/network-metrics-daemon/0.log" Jun 06 22:42:12.573994 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.573959 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hr9ch_1bb2a002-a9ac-4494-b7b1-57d94a96711b/kube-rbac-proxy/0.log" Jun 06 22:42:12.646489 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.646455 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-l4wd2_c945804a-e773-40ce-981c-6c521780a73d/discovery/0.log" Jun 06 22:42:12.675141 ip-10-0-141-122 kubenswrapper[2574]: I0606 22:42:12.675116 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76d78c7b69-r9tbj_516df559-a664-46e5-9411-440540036932/kube-auth-proxy/0.log"