Jun 07 16:27:01.666049 ip-10-0-133-143 systemd[1]: Starting Kubernetes Kubelet... Jun 07 16:27:02.119073 ip-10-0-133-143 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:27:02.119073 ip-10-0-133-143 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 07 16:27:02.119073 ip-10-0-133-143 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:27:02.119073 ip-10-0-133-143 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 07 16:27:02.119073 ip-10-0-133-143 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 16:27:02.122026 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.121938 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 07 16:27:02.126843 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126824 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:02.126843 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126839 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:02.126843 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126844 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:02.126843 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126848 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126855 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126861 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126865 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126870 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126873 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126878 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126882 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126886 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126892 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126897 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126901 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126904 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126908 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126913 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126917 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126920 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126924 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126929 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:02.127075 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126932 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126936 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126940 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126945 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126949 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126953 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126957 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126961 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126965 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126969 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126973 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126977 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126981 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126985 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126989 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.126995 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127001 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127005 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127010 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127014 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:02.127885 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127018 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127022 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127026 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127030 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127034 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127038 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127042 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127046 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127050 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127054 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127060 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127064 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127068 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127072 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127076 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127080 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127084 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127088 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127092 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127096 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:02.128720 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127100 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127104 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127110 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127115 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127120 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127124 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127129 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127134 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127139 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127143 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127148 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127152 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127156 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127160 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127165 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127170 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127174 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127178 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127182 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127186 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:02.129611 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127191 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127195 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127199 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127203 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127208 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127212 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127216 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127220 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127224 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127228 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127232 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127237 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127241 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127245 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127249 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127253 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.127257 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128422 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128433 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128438 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:02.130482 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128443 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128447 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128453 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128457 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128464 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128469 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128473 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128478 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128482 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128486 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128491 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128495 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128499 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128503 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128507 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128511 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128515 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128519 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128524 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128528 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:02.131350 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128532 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128536 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128540 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128544 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128548 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128552 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128556 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128560 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128566 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128570 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128574 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128579 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128583 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128587 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128591 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128596 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128601 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128605 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128609 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128613 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:02.132055 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128617 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128621 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128626 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128630 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128634 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128638 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128642 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128646 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128650 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128654 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128658 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128662 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128666 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128670 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128674 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128678 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128681 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128686 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128690 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128695 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:02.132688 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128699 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128703 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128707 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128712 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128716 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128720 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128723 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128727 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128732 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128736 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128742 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128746 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128753 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128780 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128786 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128790 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128796 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128800 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128804 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:02.133275 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128808 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128812 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128817 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128820 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128825 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128829 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128833 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128837 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128844 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128849 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128853 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128857 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128862 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128867 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128871 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128875 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.128879 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129520 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129529 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129535 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:02.133783 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129540 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129546 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129551 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129555 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129560 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129564 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129568 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129572 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129576 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129580 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129584 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129588 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129592 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129597 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129603 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129609 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129613 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129617 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129621 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:02.134365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129625 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129630 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129634 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129638 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129642 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129649 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129654 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129659 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129665 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129669 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129673 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129677 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129683 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129687 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129691 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129696 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129700 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129705 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129709 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129713 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:02.134857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129717 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129721 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129725 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129729 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129733 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129738 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129742 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129746 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129750 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129772 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129777 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129781 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129785 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129789 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129793 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129797 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129801 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129807 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129811 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129815 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:02.135374 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129824 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129828 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129832 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129836 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129841 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129845 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129849 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129853 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129858 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129862 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129866 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129870 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129874 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129879 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129882 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129891 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129898 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129903 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129907 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129911 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:02.135883 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129915 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129919 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129924 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129928 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129932 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129936 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129940 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129945 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129949 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129953 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129957 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129961 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129970 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129975 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129979 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129983 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.129987 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130080 2565 flags.go:64] FLAG: --address="0.0.0.0" Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130091 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130101 2565 flags.go:64] FLAG: --anonymous-auth="true" Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130107 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 07 16:27:02.136371 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130115 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130120 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130126 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130133 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130138 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130143 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130150 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130155 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130160 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130165 2565 flags.go:64] FLAG: --cgroup-root="" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130170 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130175 2565 flags.go:64] FLAG: --client-ca-file="" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130179 2565 flags.go:64] FLAG: --cloud-provider="external" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130184 2565 flags.go:64] FLAG: --cluster-dns="[]" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130189 2565 flags.go:64] FLAG: --cluster-domain="" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130194 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130199 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130204 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130209 2565 flags.go:64] FLAG: --container-log-max-files="5" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130215 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130220 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130224 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130230 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130236 2565 flags.go:64] FLAG: --contention-profiling="false" Jun 07 16:27:02.136898 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130240 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130245 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130250 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130255 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130262 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130266 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130271 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130276 2565 flags.go:64] FLAG: --enable-load-reader="false" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130280 2565 flags.go:64] FLAG: --enable-server="true" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130285 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130293 2565 flags.go:64] FLAG: --event-burst="100" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130298 2565 flags.go:64] FLAG: --event-qps="50" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130302 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130307 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130313 2565 flags.go:64] FLAG: --eviction-hard="" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130319 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130324 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130329 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130334 2565 flags.go:64] FLAG: --eviction-soft="" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130339 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130343 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130348 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130353 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130357 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130362 2565 flags.go:64] FLAG: --fail-swap-on="true" Jun 07 16:27:02.137549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130366 2565 flags.go:64] FLAG: --feature-gates="" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130372 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130377 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130382 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130387 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130392 2565 flags.go:64] FLAG: --healthz-port="10248" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130398 2565 flags.go:64] FLAG: --help="false" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130403 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130408 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130413 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130418 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130423 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130428 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130433 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130437 2565 flags.go:64] FLAG: --image-service-endpoint="" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130442 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130446 2565 flags.go:64] FLAG: --kube-api-burst="100" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130452 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130457 2565 flags.go:64] FLAG: --kube-api-qps="50" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130462 2565 flags.go:64] FLAG: --kube-reserved="" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130467 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130473 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130478 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130482 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 07 16:27:02.138463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130486 2565 flags.go:64] FLAG: --lock-file="" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130490 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130495 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130500 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130514 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130518 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130523 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130528 2565 flags.go:64] FLAG: --logging-format="text" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130533 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130538 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130543 2565 flags.go:64] FLAG: --manifest-url="" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130547 2565 flags.go:64] FLAG: --manifest-url-header="" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130554 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130559 2565 flags.go:64] FLAG: --max-open-files="1000000" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130566 2565 flags.go:64] FLAG: --max-pods="110" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130571 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130575 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130579 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130584 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130590 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130594 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130599 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130609 2565 flags.go:64] FLAG: --node-status-max-images="50" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130614 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130619 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jun 07 16:27:02.139167 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130624 2565 flags.go:64] FLAG: --pod-cidr="" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130629 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130638 2565 flags.go:64] FLAG: --pod-manifest-path="" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130644 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130649 2565 flags.go:64] FLAG: --pods-per-core="0" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130653 2565 flags.go:64] FLAG: --port="10250" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130658 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130663 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0f89126f7248944ef" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130668 2565 flags.go:64] FLAG: --qos-reserved="" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130672 2565 flags.go:64] FLAG: --read-only-port="10255" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130676 2565 flags.go:64] FLAG: --register-node="true" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130681 2565 flags.go:64] FLAG: --register-with-taints="" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130686 2565 flags.go:64] FLAG: --registry-burst="10" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130691 2565 flags.go:64] FLAG: --registry-qps="5" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130696 2565 flags.go:64] FLAG: --reserved-cpus="" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130701 2565 flags.go:64] FLAG: --reserved-memory="" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130707 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130711 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130716 2565 flags.go:64] FLAG: --rotate-certificates="false" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130720 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130725 2565 flags.go:64] FLAG: --runonce="false" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130730 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130735 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130739 2565 flags.go:64] FLAG: --seccomp-default="false" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130744 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 07 16:27:02.139784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130749 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130753 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130777 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130782 2565 flags.go:64] FLAG: --storage-driver-password="root" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130786 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130791 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130796 2565 flags.go:64] FLAG: --storage-driver-user="root" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130801 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130806 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130812 2565 flags.go:64] FLAG: --system-cgroups="" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130816 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130825 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130830 2565 flags.go:64] FLAG: --tls-cert-file="" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130834 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130841 2565 flags.go:64] FLAG: --tls-min-version="" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130846 2565 flags.go:64] FLAG: --tls-private-key-file="" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130850 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130855 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130859 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130864 2565 flags.go:64] FLAG: --v="2" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130870 2565 flags.go:64] FLAG: --version="false" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130876 2565 flags.go:64] FLAG: --vmodule="" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130882 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.130888 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131067 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:02.140435 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131074 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131079 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131083 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131090 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131096 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131101 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131105 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131109 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131114 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131118 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131122 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131128 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131134 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131138 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131143 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131148 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131152 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131157 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131161 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:02.141111 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131165 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131170 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131174 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131178 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131182 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131186 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131190 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131194 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131198 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131202 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131207 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131211 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131215 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131219 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131223 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131227 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131232 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131236 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131240 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131244 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:02.141617 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131249 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131253 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131257 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131261 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131267 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131272 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131277 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131282 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131287 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131292 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131296 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131301 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131306 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131310 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131314 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131318 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131323 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131327 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131331 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:02.142279 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131335 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131339 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131343 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131347 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131351 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131355 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131358 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131362 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131366 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131372 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131376 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131380 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131384 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131388 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131392 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131396 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131400 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131404 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131409 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131413 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:02.143082 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131417 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131421 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131425 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131429 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131433 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131440 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131444 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131449 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131453 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131457 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131461 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131465 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131469 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131473 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131477 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131481 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131486 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131489 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131494 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:02.143844 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.131498 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.131511 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.139174 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.139283 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.139302 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.139308 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139381 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139386 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139390 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139393 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139396 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139399 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139402 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139405 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139408 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:02.144325 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139411 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139414 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139417 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139425 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139428 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139431 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139433 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139436 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139438 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139441 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139443 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139445 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139448 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139450 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139453 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139456 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139458 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139461 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139463 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139466 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:02.144912 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139469 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139472 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139475 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139477 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139479 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139482 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139484 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139487 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139489 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139491 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139494 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139496 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139498 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139501 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139503 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139506 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139514 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139516 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139519 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139521 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:02.145440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139524 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139526 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139529 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139531 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139534 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139537 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139539 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139541 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139544 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139546 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139549 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139551 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139554 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139563 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139565 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139568 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139570 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139574 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139578 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139581 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:02.145950 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139583 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139586 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139589 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139591 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139594 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139596 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139598 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139601 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139603 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139612 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139614 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139617 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139619 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139622 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139624 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139626 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139629 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139631 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139634 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139636 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:02.146483 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139640 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139643 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139646 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139649 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139653 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139656 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139658 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139661 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139663 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139665 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.139670 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139835 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139840 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139843 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139845 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 16:27:02.146974 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139848 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139850 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139853 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139855 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139858 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139860 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139863 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139872 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139876 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139879 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139881 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139884 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139886 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139889 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139891 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139894 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139896 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139899 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139902 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 16:27:02.147398 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139905 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139908 2565 feature_gate.go:328] unrecognized feature gate: Example Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139910 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139913 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139915 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139918 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139920 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139922 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139925 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139927 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139930 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139932 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139934 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139936 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139939 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139941 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139944 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139946 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139949 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139951 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 16:27:02.147884 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139953 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139962 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139965 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139968 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139970 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139972 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139975 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139977 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139979 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139983 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139986 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139989 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139991 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139994 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139997 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.139999 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140002 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140004 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140007 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 16:27:02.148425 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140009 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140011 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140014 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140016 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140018 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140021 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140023 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140025 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140028 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140030 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140033 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140035 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140038 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140040 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140042 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140050 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140053 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140055 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140058 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140060 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 16:27:02.149006 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140062 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140065 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140067 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140070 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140072 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140074 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140079 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140081 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140083 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140086 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140088 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140091 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140093 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140096 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140098 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140100 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 16:27:02.149808 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:02.140103 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 16:27:02.150453 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.140108 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 16:27:02.150453 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.140210 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jun 07 16:27:02.150453 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.144491 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 07 16:27:02.150453 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.146107 2565 server.go:1019] "Starting client certificate rotation" Jun 07 16:27:02.150453 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.146208 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:27:02.150453 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.146245 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 16:27:02.150453 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.149726 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:27:02.155882 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.155864 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 16:27:02.163601 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.163586 2565 log.go:25] "Validated CRI v1 runtime API" Jun 07 16:27:02.166980 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.166965 2565 log.go:25] "Validated CRI v1 image API" Jun 07 16:27:02.167713 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.167698 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 07 16:27:02.170330 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.170309 2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 e3849a28-4162-4d3a-9f7a-2beb2383c615:/dev/nvme0n1p3 fa83375f-80ba-4e78-8506-c0fd378f7c67:/dev/nvme0n1p4] Jun 07 16:27:02.170400 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.170329 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 07 16:27:02.176055 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.175947 2565 manager.go:216] Machine: {Timestamp:2026-06-07 16:27:02.174500474 +0000 UTC m=+0.378373736 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3115897 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2782a0690bb6f1a7383eee3efe56c8 SystemUUID:ec2782a0-690b-b6f1-a738-3eee3efe56c8 BootID:4a1d6a38-26c5-4ad2-ac16-dcdff898defc Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e2:4e:4a:3e:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e2:4e:4a:3e:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:d1:5f:87:fe:d9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 07 16:27:02.176055 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.176042 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 07 16:27:02.176218 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.176110 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:27:02.176218 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.176142 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 07 16:27:02.179644 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.179614 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 07 16:27:02.179831 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.179648 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-143.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 07 16:27:02.181247 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.181235 2565 topology_manager.go:138] "Creating topology manager with none policy" Jun 07 16:27:02.181304 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.181255 2565 container_manager_linux.go:309] "Creating device plugin manager" Jun 07 16:27:02.181304 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.181267 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:27:02.181961 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.181949 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 16:27:02.183121 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.183109 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 07 16:27:02.187498 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.187484 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:27:02.187630 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.187619 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 07 16:27:02.187685 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.187657 2565 kubelet.go:486] "Attempting to sync node with API server" Jun 07 16:27:02.187685 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.187671 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 07 16:27:02.187685 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.187685 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 07 16:27:02.187832 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.187700 2565 kubelet.go:398] "Adding apiserver pod source" Jun 07 16:27:02.187832 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.187712 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 07 16:27:02.188101 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.188087 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:27:02.188166 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.188128 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 16:27:02.191975 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.191120 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 07 16:27:02.193320 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.193303 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 07 16:27:02.193358 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.193338 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 07 16:27:02.194925 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.194911 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 07 16:27:02.194997 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.194931 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 07 16:27:02.194997 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.194938 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 07 16:27:02.194997 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.194945 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 07 16:27:02.194997 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.194958 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 07 16:27:02.194997 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.194972 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 07 16:27:02.194997 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.194981 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 07 16:27:02.194997 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.194986 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 07 16:27:02.194997 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.194995 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 07 16:27:02.194997 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.195001 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 07 16:27:02.195353 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.195011 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 07 16:27:02.195353 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.195017 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 07 16:27:02.195353 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.195129 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 07 16:27:02.195353 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.195142 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 07 16:27:02.201971 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.201952 2565 server.go:1268] "Started kubelet" Jun 07 16:27:02.202082 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.202015 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 07 16:27:02.202333 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.202285 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 07 16:27:02.202417 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.202351 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 07 16:27:02.203098 ip-10-0-133-143 systemd[1]: Started Kubernetes Kubelet. Jun 07 16:27:02.204234 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.204224 2565 server.go:310] "Adding debug handlers to kubelet server" Jun 07 16:27:02.204666 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.204646 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 07 16:27:02.204848 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.204801 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-143.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 07 16:27:02.204943 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.204915 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 07 16:27:02.204988 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.204943 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 07 16:27:02.210805 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.210786 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 07 16:27:02.211673 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.211656 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 07 16:27:02.211673 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.211667 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 07 16:27:02.211845 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.211793 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found" Jun 07 16:27:02.212946 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.212925 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 07 16:27:02.213599 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.213511 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 07 16:27:02.213599 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.213528 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 07 16:27:02.213701 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.213671 2565 reconstruct.go:97] "Volume reconstruction finished" Jun 07 16:27:02.213701 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.213679 2565 reconciler.go:29] "Reconciler: start to sync state" Jun 07 16:27:02.214077 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.214053 2565 factory.go:55] Registering systemd factory Jun 07 16:27:02.214077 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.214072 2565 factory.go:223] Registration of the systemd container factory successfully Jun 07 16:27:02.214331 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.214312 2565 factory.go:153] Registering CRI-O factory Jun 07 16:27:02.214331 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.214332 2565 factory.go:223] Registration of the crio container factory successfully Jun 07 16:27:02.214686 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.214400 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 07 16:27:02.214686 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.214424 2565 factory.go:103] Registering Raw factory Jun 07 16:27:02.214686 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.214440 2565 manager.go:1196] Started watching for new ooms in manager Jun 07 16:27:02.214686 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.213414 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-143.ec2.internal.18b6d94bc9bbd6a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-143.ec2.internal,UID:ip-10-0-133-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-143.ec2.internal,},FirstTimestamp:2026-06-07 16:27:02.201915042 +0000 UTC m=+0.405788306,LastTimestamp:2026-06-07 16:27:02.201915042 +0000 UTC m=+0.405788306,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-143.ec2.internal,}" Jun 07 16:27:02.214939 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.214869 2565 manager.go:349] Starting recovery of all containers Jun 07 16:27:02.218977 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.218951 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 07 16:27:02.219076 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.219013 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-143.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 07 16:27:02.219653 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.219630 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9vxfc" Jun 07 16:27:02.226659 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.226637 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9vxfc" Jun 07 16:27:02.227225 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.227209 2565 manager.go:354] Recovery completed Jun 07 16:27:02.231614 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.231601 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:02.233442 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.233425 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:02.233530 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.233457 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:02.233530 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.233468 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:02.234023 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.234007 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 07 16:27:02.234023 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.234022 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 07 16:27:02.234106 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.234013 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:02.234106 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.234036 2565 state_mem.go:36] "Initialized new in-memory state store" Jun 07 16:27:02.234648 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.234633 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:02.234739 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.234664 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:02.234739 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.234679 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:02.235404 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.235342 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-143.ec2.internal.18b6d94bcb9ce78a default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-143.ec2.internal,UID:ip-10-0-133-143.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-143.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-143.ec2.internal,},FirstTimestamp:2026-06-07 16:27:02.233442186 +0000 UTC m=+0.437315453,LastTimestamp:2026-06-07 16:27:02.233442186 +0000 UTC m=+0.437315453,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-143.ec2.internal,}" Jun 07 16:27:02.235749 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.235739 2565 policy_none.go:49] "None policy: Start" Jun 07 16:27:02.235801 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.235754 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 07 16:27:02.235801 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.235781 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 07 16:27:02.237501 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.237489 2565 policy_none.go:47] "Start" Jun 07 16:27:02.279315 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.279299 2565 manager.go:337] "Starting Device Plugin manager" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.279334 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.279346 2565 server.go:87] "Starting device plugin registration server" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.279583 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.279597 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.279703 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.279805 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.279814 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.280815 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.280865 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-143.ec2.internal\" not found" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.287186 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.288480 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.288523 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.288547 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.288582 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 07 16:27:02.299820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.290530 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:02.379907 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.379821 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:02.380932 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.380911 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:02.381032 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.380951 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:02.381032 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.380962 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:02.381032 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.380985 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.388816 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.388795 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal"] Jun 07 16:27:02.388923 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.388912 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:02.389718 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.389697 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:02.389839 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.389729 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:02.389839 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.389739 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:02.390730 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.390715 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.390806 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.390742 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-143.ec2.internal\": node \"ip-10-0-133-143.ec2.internal\" not found" Jun 07 16:27:02.391974 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.391962 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:02.392087 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.392072 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.392133 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.392099 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:02.392682 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.392663 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:02.392777 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.392698 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:02.392777 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.392709 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:02.393323 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.393307 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:02.393404 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.393331 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:02.393404 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.393344 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:02.395869 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.395853 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.395957 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.395909 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 16:27:02.396555 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.396538 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientMemory" Jun 07 16:27:02.396618 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.396573 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 16:27:02.396618 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.396589 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeHasSufficientPID" Jun 07 16:27:02.414686 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.414670 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found" Jun 07 16:27:02.414798 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.414752 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c2e177197e413ea6daf68a13dc2c9df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"3c2e177197e413ea6daf68a13dc2c9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.414845 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.414808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c2e177197e413ea6daf68a13dc2c9df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"3c2e177197e413ea6daf68a13dc2c9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.414845 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.414825 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56149dfbdfcaf47e3122c7dfcc85ae60-config\") pod \"kube-apiserver-proxy-ip-10-0-133-143.ec2.internal\" (UID: \"56149dfbdfcaf47e3122c7dfcc85ae60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.416378 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.416361 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-143.ec2.internal\" not found" node="ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.420798 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.420782 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-143.ec2.internal\" not found" node="ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.515221 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.515197 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found" Jun 07 16:27:02.515346 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.515255 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56149dfbdfcaf47e3122c7dfcc85ae60-config\") pod \"kube-apiserver-proxy-ip-10-0-133-143.ec2.internal\" (UID: \"56149dfbdfcaf47e3122c7dfcc85ae60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.515346 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.515285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c2e177197e413ea6daf68a13dc2c9df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"3c2e177197e413ea6daf68a13dc2c9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.515346 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.515312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c2e177197e413ea6daf68a13dc2c9df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"3c2e177197e413ea6daf68a13dc2c9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.515346 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.515338 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/56149dfbdfcaf47e3122c7dfcc85ae60-config\") pod \"kube-apiserver-proxy-ip-10-0-133-143.ec2.internal\" (UID: \"56149dfbdfcaf47e3122c7dfcc85ae60\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.515503 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.515371 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3c2e177197e413ea6daf68a13dc2c9df-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"3c2e177197e413ea6daf68a13dc2c9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.515503 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.515382 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3c2e177197e413ea6daf68a13dc2c9df-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal\" (UID: \"3c2e177197e413ea6daf68a13dc2c9df\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.615690 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.615647 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found" Jun 07 16:27:02.716339 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.716263 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found" Jun 07 16:27:02.723456 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.723432 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.727487 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:02.727317 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" Jun 07 16:27:02.817142 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.817106 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found" Jun 07 16:27:02.917568 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:02.917529 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found" Jun 07 16:27:03.018038 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.017957 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found" Jun 07 16:27:03.091834 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.091805 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:03.118248 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.118212 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-143.ec2.internal\" not found" Jun 07 16:27:03.119358 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.119338 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:03.145311 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.145279 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 07 16:27:03.145509 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.145437 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:27:03.145509 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.145445 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:27:03.145509 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.145437 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 16:27:03.188627 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.188595 2565 apiserver.go:52] "Watching apiserver" Jun 07 16:27:03.212090 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.212061 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 07 16:27:03.212090 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.212089 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" Jun 07 16:27:03.212257 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.212118 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 07 16:27:03.212490 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.212470 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-wrsz8","kube-system/konnectivity-agent-828b6","openshift-cluster-node-tuning-operator/tuned-4vwdl","openshift-dns/node-resolver-p6kgd","openshift-multus/multus-additional-cni-plugins-vmpj6","openshift-multus/network-metrics-daemon-f4wl2","openshift-ovn-kubernetes/ovnkube-node-95fkp","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6","openshift-image-registry/node-ca-mj69l","openshift-multus/multus-7jqtk","openshift-network-diagnostics/network-check-target-fmcbl","openshift-network-operator/iptables-alerter-lktfq"] Jun 07 16:27:03.214864 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.214844 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:03.214947 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.214926 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:03.216535 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.216518 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:03.218710 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.218687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1ae50c5-29b5-41aa-af9e-082fcf808170-kubelet-config\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:03.218836 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.218730 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1ae50c5-29b5-41aa-af9e-082fcf808170-dbus\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:03.218836 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.218771 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:03.218959 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.218939 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-n2wcf\"" Jun 07 16:27:03.219045 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.219027 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.219100 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.219078 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 07 16:27:03.219146 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.219123 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 07 16:27:03.221276 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.221258 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:27:03.221336 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.221311 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 07 16:27:03.221371 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.221358 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-626gd\"" Jun 07 16:27:03.221575 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.221559 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6kgd" Jun 07 16:27:03.223102 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.223086 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 16:27:03.223511 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.223494 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.224108 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.224091 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 07 16:27:03.224197 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.224183 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 07 16:27:03.224297 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.224282 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9v698\"" Jun 07 16:27:03.224358 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.224325 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:27:03.224410 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.224381 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" Jun 07 16:27:03.225511 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.225494 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:03.225583 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.225563 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:03.225852 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.225837 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-rtwzz\"" Jun 07 16:27:03.225911 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.225849 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 07 16:27:03.225980 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.225962 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 07 16:27:03.226034 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.225997 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 07 16:27:03.226034 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.226026 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 07 16:27:03.226156 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.226145 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 07 16:27:03.229327 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.229304 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.230123 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.230096 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-06 16:22:02 +0000 UTC" deadline="2027-11-05 02:08:33.696300763 +0000 UTC" Jun 07 16:27:03.230214 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.230124 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12369h41m30.466180533s" Jun 07 16:27:03.231880 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.231442 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.232020 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.232003 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 07 16:27:03.232088 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.232050 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 07 16:27:03.232195 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.232156 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 07 16:27:03.232976 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.232958 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 07 16:27:03.233106 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.232989 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 07 16:27:03.233106 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.232990 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 07 16:27:03.233234 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.233161 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 16:27:03.233472 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.233456 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fknfb\"" Jun 07 16:27:03.233659 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.233644 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 07 16:27:03.233732 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.233674 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 07 16:27:03.233973 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.233961 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mj69l" Jun 07 16:27:03.234344 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.234330 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 07 16:27:03.234720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.234706 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hbmgx\"" Jun 07 16:27:03.238508 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.236563 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 07 16:27:03.238508 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.236578 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.238508 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.236679 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-l687z\"" Jun 07 16:27:03.238508 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.236865 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 07 16:27:03.238508 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.236934 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 07 16:27:03.239340 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.239325 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 07 16:27:03.239485 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.239469 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-994m5\"" Jun 07 16:27:03.239689 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.239674 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:03.239781 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.239733 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:03.242278 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.242262 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal"] Jun 07 16:27:03.242361 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.242288 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal"] Jun 07 16:27:03.242361 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.242352 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lktfq" Jun 07 16:27:03.244485 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.244461 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 07 16:27:03.244603 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.244547 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-84w2s\"" Jun 07 16:27:03.244731 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.244717 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 07 16:27:03.244851 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.244816 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 07 16:27:03.247663 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.247646 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-x76wk" Jun 07 16:27:03.255693 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.255675 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-x76wk" Jun 07 16:27:03.293018 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:03.292991 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56149dfbdfcaf47e3122c7dfcc85ae60.slice/crio-d0f245b8ce7b535b4eeef2be64c24e3df2104b2db7d75e4505b68a0834a99ff2 WatchSource:0}: Error finding container d0f245b8ce7b535b4eeef2be64c24e3df2104b2db7d75e4505b68a0834a99ff2: Status 404 returned error can't find the container with id d0f245b8ce7b535b4eeef2be64c24e3df2104b2db7d75e4505b68a0834a99ff2 Jun 07 16:27:03.293440 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:03.293417 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2e177197e413ea6daf68a13dc2c9df.slice/crio-d78a0d4952be3520603536af62285d929d0491d21f32254a94d96cd1f719e4ae WatchSource:0}: Error finding container d78a0d4952be3520603536af62285d929d0491d21f32254a94d96cd1f719e4ae: Status 404 returned error can't find the container with id d78a0d4952be3520603536af62285d929d0491d21f32254a94d96cd1f719e4ae Jun 07 16:27:03.299740 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.299725 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:27:03.314114 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.314096 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 07 16:27:03.318950 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.318931 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15582473-22c1-490c-965f-50d3ad3edb0d-multus-daemon-config\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.319056 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.318954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr5v6\" (UniqueName: \"kubernetes.io/projected/15582473-22c1-490c-965f-50d3ad3edb0d-kube-api-access-lr5v6\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.319056 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.318970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-var-lib-kubelet\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.319056 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.318990 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-tuned\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.319056 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319011 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-system-cni-dir\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.319056 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319051 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-slash\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.319338 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-run-ovn\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.319338 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319099 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-cnibin\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.319338 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319124 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-multus-socket-dir-parent\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.319338 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03667af4-2c7e-4ef4-b020-2637ee3a42ed-tmp\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.319338 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73c30ff5-7ddf-4957-9100-db90b88afc15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.319338 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319221 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.319338 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319245 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-env-overrides\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.319338 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319269 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-var-lib-cni-bin\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.319338 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-lib-modules\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73c30ff5-7ddf-4957-9100-db90b88afc15-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319376 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-run-openvswitch\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319402 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e-serviceca\") pod \"node-ca-mj69l\" (UID: \"2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e\") " pod="openshift-image-registry/node-ca-mj69l" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319434 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1ae50c5-29b5-41aa-af9e-082fcf808170-kubelet-config\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319470 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319537 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-socket-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319549 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d1ae50c5-29b5-41aa-af9e-082fcf808170-kubelet-config\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.319566 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlbb2\" (UniqueName: \"kubernetes.io/projected/82c18a47-d134-4c9b-8974-99bc8db3e3f2-kube-api-access-zlbb2\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319770 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3c33448-c2c4-4cc4-909f-e9a07079d6e1-iptables-alerter-script\") pod \"iptables-alerter-lktfq\" (UID: \"d3c33448-c2c4-4cc4-909f-e9a07079d6e1\") " pod="openshift-network-operator/iptables-alerter-lktfq" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319802 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-node-log\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319831 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-ovn-node-metrics-cert\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319861 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-cnibin\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.319891 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.319886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-os-release\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.320426 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320304 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-sys-fs\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.320426 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320340 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15582473-22c1-490c-965f-50d3ad3edb0d-cni-binary-copy\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.320426 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.320378 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret podName:d1ae50c5-29b5-41aa-af9e-082fcf808170 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:03.820349879 +0000 UTC m=+2.024223148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret") pod "global-pull-secret-syncer-wrsz8" (UID: "d1ae50c5-29b5-41aa-af9e-082fcf808170") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:03.320426 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320416 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-multus-conf-dir\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320455 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-sysconfig\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320483 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-kubernetes\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320529 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kzb4\" (UniqueName: \"kubernetes.io/projected/d1ca383f-3d23-47a0-9d10-5203404b496a-kube-api-access-2kzb4\") pod \"node-resolver-p6kgd\" (UID: \"d1ca383f-3d23-47a0-9d10-5203404b496a\") " pod="openshift-dns/node-resolver-p6kgd" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320583 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-etc-openvswitch\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320611 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-cni-bin\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320667 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-registration-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320713 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-hostroot\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-sysctl-conf\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-run-systemd\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-log-socket\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.320954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320944 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-os-release\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320974 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-run-netns\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.320997 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1ca383f-3d23-47a0-9d10-5203404b496a-tmp-dir\") pod \"node-resolver-p6kgd\" (UID: \"d1ca383f-3d23-47a0-9d10-5203404b496a\") " pod="openshift-dns/node-resolver-p6kgd" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321026 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-kubelet\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321066 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpqmd\" (UniqueName: \"kubernetes.io/projected/2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e-kube-api-access-qpqmd\") pod \"node-ca-mj69l\" (UID: \"2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e\") " pod="openshift-image-registry/node-ca-mj69l" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321106 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321134 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-multus-cni-dir\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321165 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3c33448-c2c4-4cc4-909f-e9a07079d6e1-host-slash\") pod \"iptables-alerter-lktfq\" (UID: \"d3c33448-c2c4-4cc4-909f-e9a07079d6e1\") " pod="openshift-network-operator/iptables-alerter-lktfq" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4babfa83-0a29-4eee-a10b-e49cae1ba10d-konnectivity-ca\") pod \"konnectivity-agent-828b6\" (UID: \"4babfa83-0a29-4eee-a10b-e49cae1ba10d\") " pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321221 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-modprobe-d\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-sys\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-run-netns\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321455 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-ovnkube-script-lib\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.321484 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321485 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-system-cni-dir\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-var-lib-cni-multus\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321541 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-etc-kubernetes\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-ovnkube-config\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321604 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k479\" (UniqueName: \"kubernetes.io/projected/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-kube-api-access-8k479\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321696 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1ae50c5-29b5-41aa-af9e-082fcf808170-dbus\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321745 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-var-lib-openvswitch\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321901 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-device-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321905 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d1ae50c5-29b5-41aa-af9e-082fcf808170-dbus\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.321952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-host\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322007 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmwhx\" (UniqueName: \"kubernetes.io/projected/73c30ff5-7ddf-4957-9100-db90b88afc15-kube-api-access-gmwhx\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e-host\") pod \"node-ca-mj69l\" (UID: \"2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e\") " pod="openshift-image-registry/node-ca-mj69l" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-run-multus-certs\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322102 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d26d\" (UniqueName: \"kubernetes.io/projected/d3c33448-c2c4-4cc4-909f-e9a07079d6e1-kube-api-access-2d26d\") pod \"iptables-alerter-lktfq\" (UID: \"d3c33448-c2c4-4cc4-909f-e9a07079d6e1\") " pod="openshift-network-operator/iptables-alerter-lktfq" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-sysctl-d\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322158 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-systemd\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.322191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322186 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-run\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322214 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-systemd-units\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322247 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322281 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b92vt\" (UniqueName: \"kubernetes.io/projected/d12ea486-aafe-455d-9f01-565eabcf0ca0-kube-api-access-b92vt\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322320 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4babfa83-0a29-4eee-a10b-e49cae1ba10d-agent-certs\") pod \"konnectivity-agent-828b6\" (UID: \"4babfa83-0a29-4eee-a10b-e49cae1ba10d\") " pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322354 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-var-lib-kubelet\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322387 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p46q\" (UniqueName: \"kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q\") pod \"network-check-target-fmcbl\" (UID: \"07139989-b03c-4498-b73e-c9053c9769b4\") " pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgfw7\" (UniqueName: \"kubernetes.io/projected/03667af4-2c7e-4ef4-b020-2637ee3a42ed-kube-api-access-wgfw7\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322451 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1ca383f-3d23-47a0-9d10-5203404b496a-hosts-file\") pod \"node-resolver-p6kgd\" (UID: \"d1ca383f-3d23-47a0-9d10-5203404b496a\") " pod="openshift-dns/node-resolver-p6kgd" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322473 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73c30ff5-7ddf-4957-9100-db90b88afc15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322504 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-run-k8s-cni-cncf-io\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322547 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.322916 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.322569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-cni-netd\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.422810 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422753 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-sys-fs\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.422810 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422811 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15582473-22c1-490c-965f-50d3ad3edb0d-cni-binary-copy\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422829 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-multus-conf-dir\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-sysconfig\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-kubernetes\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422897 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kzb4\" (UniqueName: \"kubernetes.io/projected/d1ca383f-3d23-47a0-9d10-5203404b496a-kube-api-access-2kzb4\") pod \"node-resolver-p6kgd\" (UID: \"d1ca383f-3d23-47a0-9d10-5203404b496a\") " pod="openshift-dns/node-resolver-p6kgd" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422912 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-multus-conf-dir\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422923 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-kubernetes\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422918 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-etc-openvswitch\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422950 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-sysconfig\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422959 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-etc-openvswitch\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422870 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-sys-fs\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.422975 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-cni-bin\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423005 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-cni-bin\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.423039 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-registration-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-hostroot\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423083 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423089 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-sysctl-conf\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-run-systemd\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423127 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-hostroot\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423136 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-log-socket\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423135 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-registration-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423169 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-run-systemd\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423159 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-os-release\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423186 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-log-socket\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423201 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-run-netns\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1ca383f-3d23-47a0-9d10-5203404b496a-tmp-dir\") pod \"node-resolver-p6kgd\" (UID: \"d1ca383f-3d23-47a0-9d10-5203404b496a\") " pod="openshift-dns/node-resolver-p6kgd" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423227 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-os-release\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-kubelet\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423266 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpqmd\" (UniqueName: \"kubernetes.io/projected/2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e-kube-api-access-qpqmd\") pod \"node-ca-mj69l\" (UID: \"2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e\") " pod="openshift-image-registry/node-ca-mj69l" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423281 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-kubelet\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423291 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.423684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423286 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-run-netns\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423294 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-sysctl-conf\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423336 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-multus-cni-dir\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423362 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423370 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3c33448-c2c4-4cc4-909f-e9a07079d6e1-host-slash\") pod \"iptables-alerter-lktfq\" (UID: \"d3c33448-c2c4-4cc4-909f-e9a07079d6e1\") " pod="openshift-network-operator/iptables-alerter-lktfq" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423414 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3c33448-c2c4-4cc4-909f-e9a07079d6e1-host-slash\") pod \"iptables-alerter-lktfq\" (UID: \"d3c33448-c2c4-4cc4-909f-e9a07079d6e1\") " pod="openshift-network-operator/iptables-alerter-lktfq" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423420 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-multus-cni-dir\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423442 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4babfa83-0a29-4eee-a10b-e49cae1ba10d-konnectivity-ca\") pod \"konnectivity-agent-828b6\" (UID: \"4babfa83-0a29-4eee-a10b-e49cae1ba10d\") " pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423452 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15582473-22c1-490c-965f-50d3ad3edb0d-cni-binary-copy\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423461 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-modprobe-d\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423483 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-sys\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-run-netns\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423499 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1ca383f-3d23-47a0-9d10-5203404b496a-tmp-dir\") pod \"node-resolver-p6kgd\" (UID: \"d1ca383f-3d23-47a0-9d10-5203404b496a\") " pod="openshift-dns/node-resolver-p6kgd" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423512 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-ovnkube-script-lib\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423566 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-sys\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423570 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-system-cni-dir\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423586 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-run-netns\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423590 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-modprobe-d\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.424569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423597 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-var-lib-cni-multus\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423624 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-etc-kubernetes\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423637 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-var-lib-cni-multus\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423651 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-ovnkube-config\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423660 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-system-cni-dir\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423668 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k479\" (UniqueName: \"kubernetes.io/projected/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-kube-api-access-8k479\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423679 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-etc-kubernetes\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-var-lib-openvswitch\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423747 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-device-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423774 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-var-lib-openvswitch\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.423811 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423823 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-device-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423822 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-host\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.423888 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs podName:d12ea486-aafe-455d-9f01-565eabcf0ca0 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:03.923868701 +0000 UTC m=+2.127741952 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs") pod "network-metrics-daemon-f4wl2" (UID: "d12ea486-aafe-455d-9f01-565eabcf0ca0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423781 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-host\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423929 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmwhx\" (UniqueName: \"kubernetes.io/projected/73c30ff5-7ddf-4957-9100-db90b88afc15-kube-api-access-gmwhx\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.425342 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423958 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e-host\") pod \"node-ca-mj69l\" (UID: \"2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e\") " pod="openshift-image-registry/node-ca-mj69l" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423983 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-run-multus-certs\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.423999 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/4babfa83-0a29-4eee-a10b-e49cae1ba10d-konnectivity-ca\") pod \"konnectivity-agent-828b6\" (UID: \"4babfa83-0a29-4eee-a10b-e49cae1ba10d\") " pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424007 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d26d\" (UniqueName: \"kubernetes.io/projected/d3c33448-c2c4-4cc4-909f-e9a07079d6e1-kube-api-access-2d26d\") pod \"iptables-alerter-lktfq\" (UID: \"d3c33448-c2c4-4cc4-909f-e9a07079d6e1\") " pod="openshift-network-operator/iptables-alerter-lktfq" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424024 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e-host\") pod \"node-ca-mj69l\" (UID: \"2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e\") " pod="openshift-image-registry/node-ca-mj69l" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424030 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-sysctl-d\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424048 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-run-multus-certs\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-systemd\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424093 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-run\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424098 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-systemd\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424117 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-systemd-units\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424141 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-sysctl-d\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424143 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424158 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-systemd-units\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424169 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-run\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b92vt\" (UniqueName: \"kubernetes.io/projected/d12ea486-aafe-455d-9f01-565eabcf0ca0-kube-api-access-b92vt\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424196 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424206 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-ovnkube-script-lib\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.426130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4babfa83-0a29-4eee-a10b-e49cae1ba10d-agent-certs\") pod \"konnectivity-agent-828b6\" (UID: \"4babfa83-0a29-4eee-a10b-e49cae1ba10d\") " pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-var-lib-kubelet\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424299 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p46q\" (UniqueName: \"kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q\") pod \"network-check-target-fmcbl\" (UID: \"07139989-b03c-4498-b73e-c9053c9769b4\") " pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424323 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-var-lib-kubelet\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424359 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgfw7\" (UniqueName: \"kubernetes.io/projected/03667af4-2c7e-4ef4-b020-2637ee3a42ed-kube-api-access-wgfw7\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424385 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1ca383f-3d23-47a0-9d10-5203404b496a-hosts-file\") pod \"node-resolver-p6kgd\" (UID: \"d1ca383f-3d23-47a0-9d10-5203404b496a\") " pod="openshift-dns/node-resolver-p6kgd" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424452 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d1ca383f-3d23-47a0-9d10-5203404b496a-hosts-file\") pod \"node-resolver-p6kgd\" (UID: \"d1ca383f-3d23-47a0-9d10-5203404b496a\") " pod="openshift-dns/node-resolver-p6kgd" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424486 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73c30ff5-7ddf-4957-9100-db90b88afc15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-run-k8s-cni-cncf-io\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424489 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424525 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424554 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-cni-netd\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424570 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-run-k8s-cni-cncf-io\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424582 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15582473-22c1-490c-965f-50d3ad3edb0d-multus-daemon-config\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr5v6\" (UniqueName: \"kubernetes.io/projected/15582473-22c1-490c-965f-50d3ad3edb0d-kube-api-access-lr5v6\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424626 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-cni-netd\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424636 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-var-lib-kubelet\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424693 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-var-lib-kubelet\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.426720 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424706 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424737 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-tuned\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424822 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-ovnkube-config\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424887 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-system-cni-dir\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.424996 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/73c30ff5-7ddf-4957-9100-db90b88afc15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425072 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-system-cni-dir\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425281 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-slash\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425298 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-run-ovn\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-cnibin\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425328 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-multus-socket-dir-parent\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425355 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03667af4-2c7e-4ef4-b020-2637ee3a42ed-tmp\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425154 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15582473-22c1-490c-965f-50d3ad3edb0d-multus-daemon-config\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425430 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-cnibin\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425453 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73c30ff5-7ddf-4957-9100-db90b88afc15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425454 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-slash\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425472 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425495 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-env-overrides\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425515 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-run-ovn\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425530 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-multus-socket-dir-parent\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425531 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425555 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-var-lib-cni-bin\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425581 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-lib-modules\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425604 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73c30ff5-7ddf-4957-9100-db90b88afc15-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-run-openvswitch\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425638 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15582473-22c1-490c-965f-50d3ad3edb0d-host-var-lib-cni-bin\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425652 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e-serviceca\") pod \"node-ca-mj69l\" (UID: \"2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e\") " pod="openshift-image-registry/node-ca-mj69l" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425697 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-socket-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425725 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlbb2\" (UniqueName: \"kubernetes.io/projected/82c18a47-d134-4c9b-8974-99bc8db3e3f2-kube-api-access-zlbb2\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425749 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3c33448-c2c4-4cc4-909f-e9a07079d6e1-iptables-alerter-script\") pod \"iptables-alerter-lktfq\" (UID: \"d3c33448-c2c4-4cc4-909f-e9a07079d6e1\") " pod="openshift-network-operator/iptables-alerter-lktfq" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-node-log\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425816 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-ovn-node-metrics-cert\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-cnibin\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425856 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/03667af4-2c7e-4ef4-b020-2637ee3a42ed-lib-modules\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425861 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-os-release\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425891 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-env-overrides\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.427896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-os-release\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.425962 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/73c30ff5-7ddf-4957-9100-db90b88afc15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.426175 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/82c18a47-d134-4c9b-8974-99bc8db3e3f2-socket-dir\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.426198 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/73c30ff5-7ddf-4957-9100-db90b88afc15-cni-binary-copy\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.426217 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-run-openvswitch\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.426254 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/73c30ff5-7ddf-4957-9100-db90b88afc15-cnibin\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.426261 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-node-log\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.426495 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d3c33448-c2c4-4cc4-909f-e9a07079d6e1-iptables-alerter-script\") pod \"iptables-alerter-lktfq\" (UID: \"d3c33448-c2c4-4cc4-909f-e9a07079d6e1\") " pod="openshift-network-operator/iptables-alerter-lktfq" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.426501 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e-serviceca\") pod \"node-ca-mj69l\" (UID: \"2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e\") " pod="openshift-image-registry/node-ca-mj69l" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.428025 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/03667af4-2c7e-4ef4-b020-2637ee3a42ed-tmp\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.428072 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/03667af4-2c7e-4ef4-b020-2637ee3a42ed-etc-tuned\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.428089 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/4babfa83-0a29-4eee-a10b-e49cae1ba10d-agent-certs\") pod \"konnectivity-agent-828b6\" (UID: \"4babfa83-0a29-4eee-a10b-e49cae1ba10d\") " pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:03.428580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.428327 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-ovn-node-metrics-cert\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.432048 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.432026 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kzb4\" (UniqueName: \"kubernetes.io/projected/d1ca383f-3d23-47a0-9d10-5203404b496a-kube-api-access-2kzb4\") pod \"node-resolver-p6kgd\" (UID: \"d1ca383f-3d23-47a0-9d10-5203404b496a\") " pod="openshift-dns/node-resolver-p6kgd" Jun 07 16:27:03.432710 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.432688 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:03.432883 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.432714 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:03.432883 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.432728 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9p46q for pod openshift-network-diagnostics/network-check-target-fmcbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:03.432883 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.432810 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q podName:07139989-b03c-4498-b73e-c9053c9769b4 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:03.932792706 +0000 UTC m=+2.136665974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9p46q" (UniqueName: "kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q") pod "network-check-target-fmcbl" (UID: "07139989-b03c-4498-b73e-c9053c9769b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:03.433529 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.433486 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgfw7\" (UniqueName: \"kubernetes.io/projected/03667af4-2c7e-4ef4-b020-2637ee3a42ed-kube-api-access-wgfw7\") pod \"tuned-4vwdl\" (UID: \"03667af4-2c7e-4ef4-b020-2637ee3a42ed\") " pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.433846 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.433824 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d26d\" (UniqueName: \"kubernetes.io/projected/d3c33448-c2c4-4cc4-909f-e9a07079d6e1-kube-api-access-2d26d\") pod \"iptables-alerter-lktfq\" (UID: \"d3c33448-c2c4-4cc4-909f-e9a07079d6e1\") " pod="openshift-network-operator/iptables-alerter-lktfq" Jun 07 16:27:03.433985 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.433963 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmwhx\" (UniqueName: \"kubernetes.io/projected/73c30ff5-7ddf-4957-9100-db90b88afc15-kube-api-access-gmwhx\") pod \"multus-additional-cni-plugins-vmpj6\" (UID: \"73c30ff5-7ddf-4957-9100-db90b88afc15\") " pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.434045 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.433997 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr5v6\" (UniqueName: \"kubernetes.io/projected/15582473-22c1-490c-965f-50d3ad3edb0d-kube-api-access-lr5v6\") pod \"multus-7jqtk\" (UID: \"15582473-22c1-490c-965f-50d3ad3edb0d\") " pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.434682 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.434662 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b92vt\" (UniqueName: \"kubernetes.io/projected/d12ea486-aafe-455d-9f01-565eabcf0ca0-kube-api-access-b92vt\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:03.435598 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.435572 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpqmd\" (UniqueName: \"kubernetes.io/projected/2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e-kube-api-access-qpqmd\") pod \"node-ca-mj69l\" (UID: \"2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e\") " pod="openshift-image-registry/node-ca-mj69l" Jun 07 16:27:03.435947 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.435929 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlbb2\" (UniqueName: \"kubernetes.io/projected/82c18a47-d134-4c9b-8974-99bc8db3e3f2-kube-api-access-zlbb2\") pod \"aws-ebs-csi-driver-node-rglv6\" (UID: \"82c18a47-d134-4c9b-8974-99bc8db3e3f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.436594 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.436575 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k479\" (UniqueName: \"kubernetes.io/projected/bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea-kube-api-access-8k479\") pod \"ovnkube-node-95fkp\" (UID: \"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.542955 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.542885 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:03.549149 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.549124 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" Jun 07 16:27:03.552590 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:03.552568 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4babfa83_0a29_4eee_a10b_e49cae1ba10d.slice/crio-0d4ccfb52561995bd2071cfb953c63eaf05ccd6da971b8db6042f2d5ba4f781f WatchSource:0}: Error finding container 0d4ccfb52561995bd2071cfb953c63eaf05ccd6da971b8db6042f2d5ba4f781f: Status 404 returned error can't find the container with id 0d4ccfb52561995bd2071cfb953c63eaf05ccd6da971b8db6042f2d5ba4f781f Jun 07 16:27:03.556882 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:03.556860 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03667af4_2c7e_4ef4_b020_2637ee3a42ed.slice/crio-d0ce661f74e7381e6937423d3f72b08688d64b1910dd6c8be0da7807542086aa WatchSource:0}: Error finding container d0ce661f74e7381e6937423d3f72b08688d64b1910dd6c8be0da7807542086aa: Status 404 returned error can't find the container with id d0ce661f74e7381e6937423d3f72b08688d64b1910dd6c8be0da7807542086aa Jun 07 16:27:03.576861 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.576836 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p6kgd" Jun 07 16:27:03.585801 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:03.585777 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ca383f_3d23_47a0_9d10_5203404b496a.slice/crio-c72c6700bcc1f009857f672276cd8a927b82966fd11e48d7c1d5de904d70bffa WatchSource:0}: Error finding container c72c6700bcc1f009857f672276cd8a927b82966fd11e48d7c1d5de904d70bffa: Status 404 returned error can't find the container with id c72c6700bcc1f009857f672276cd8a927b82966fd11e48d7c1d5de904d70bffa Jun 07 16:27:03.590505 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.590490 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vmpj6" Jun 07 16:27:03.597864 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:03.597841 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73c30ff5_7ddf_4957_9100_db90b88afc15.slice/crio-d50062dcec60b25d5ab6f548697870b9dd32131daafebec7bde97b3e3193e8c6 WatchSource:0}: Error finding container d50062dcec60b25d5ab6f548697870b9dd32131daafebec7bde97b3e3193e8c6: Status 404 returned error can't find the container with id d50062dcec60b25d5ab6f548697870b9dd32131daafebec7bde97b3e3193e8c6 Jun 07 16:27:03.604353 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.604335 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:03.609608 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.609591 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" Jun 07 16:27:03.612524 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:03.612503 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9e7adf_2af8_4b34_b9d6_9b1d90f160ea.slice/crio-23b711fb76910ca157859c4581995bf326758446d0e43ada16595ea74f8c2cde WatchSource:0}: Error finding container 23b711fb76910ca157859c4581995bf326758446d0e43ada16595ea74f8c2cde: Status 404 returned error can't find the container with id 23b711fb76910ca157859c4581995bf326758446d0e43ada16595ea74f8c2cde Jun 07 16:27:03.615690 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.615667 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mj69l" Jun 07 16:27:03.617250 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:03.617231 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82c18a47_d134_4c9b_8974_99bc8db3e3f2.slice/crio-f25975ca35e0ce08c79885b7ebcc9712a21689363c07f9bac4fafa5698a3c194 WatchSource:0}: Error finding container f25975ca35e0ce08c79885b7ebcc9712a21689363c07f9bac4fafa5698a3c194: Status 404 returned error can't find the container with id f25975ca35e0ce08c79885b7ebcc9712a21689363c07f9bac4fafa5698a3c194 Jun 07 16:27:03.624504 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:03.624480 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d2c42f9_769c_4b4d_90ac_2f0fd9e3f69e.slice/crio-8306381452b9443e51e52ec82ecf66b594ddd64f1050273377d47e7933f0d9f6 WatchSource:0}: Error finding container 8306381452b9443e51e52ec82ecf66b594ddd64f1050273377d47e7933f0d9f6: Status 404 returned error can't find the container with id 8306381452b9443e51e52ec82ecf66b594ddd64f1050273377d47e7933f0d9f6 Jun 07 16:27:03.625375 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.625358 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7jqtk" Jun 07 16:27:03.629189 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.629174 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lktfq" Jun 07 16:27:03.635303 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:03.635283 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15582473_22c1_490c_965f_50d3ad3edb0d.slice/crio-e05e7238521e780dc3d1e9caf29436575118356634b932166acd6b1e218afe19 WatchSource:0}: Error finding container e05e7238521e780dc3d1e9caf29436575118356634b932166acd6b1e218afe19: Status 404 returned error can't find the container with id e05e7238521e780dc3d1e9caf29436575118356634b932166acd6b1e218afe19 Jun 07 16:27:03.637530 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:03.637509 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3c33448_c2c4_4cc4_909f_e9a07079d6e1.slice/crio-1159a934c8d1ee2303f6ba8ae8633ef22a0f0a9ad4dfebdc3139b90e2e5b8df8 WatchSource:0}: Error finding container 1159a934c8d1ee2303f6ba8ae8633ef22a0f0a9ad4dfebdc3139b90e2e5b8df8: Status 404 returned error can't find the container with id 1159a934c8d1ee2303f6ba8ae8633ef22a0f0a9ad4dfebdc3139b90e2e5b8df8 Jun 07 16:27:03.673523 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.673498 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:03.828582 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.828474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:03.828726 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.828657 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:03.828808 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.828729 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret podName:d1ae50c5-29b5-41aa-af9e-082fcf808170 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:04.828709153 +0000 UTC m=+3.032582406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret") pod "global-pull-secret-syncer-wrsz8" (UID: "d1ae50c5-29b5-41aa-af9e-082fcf808170") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:03.929965 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:03.929910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:03.930134 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.930053 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:03.930134 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:03.930131 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs podName:d12ea486-aafe-455d-9f01-565eabcf0ca0 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:04.93011089 +0000 UTC m=+3.133984144 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs") pod "network-metrics-daemon-f4wl2" (UID: "d12ea486-aafe-455d-9f01-565eabcf0ca0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:04.033781 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.030933 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p46q\" (UniqueName: \"kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q\") pod \"network-check-target-fmcbl\" (UID: \"07139989-b03c-4498-b73e-c9053c9769b4\") " pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:04.033781 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:04.031093 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:04.033781 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:04.031110 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:04.033781 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:04.031123 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9p46q for pod openshift-network-diagnostics/network-check-target-fmcbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:04.033781 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:04.031191 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q podName:07139989-b03c-4498-b73e-c9053c9769b4 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:05.031171756 +0000 UTC m=+3.235045009 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9p46q" (UniqueName: "kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q") pod "network-check-target-fmcbl" (UID: "07139989-b03c-4498-b73e-c9053c9769b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:04.259284 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.259118 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 16:22:03 +0000 UTC" deadline="2028-02-20 02:58:02.744218312 +0000 UTC" Jun 07 16:27:04.259284 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.259180 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14938h30m58.485042852s" Jun 07 16:27:04.312115 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.312013 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" event={"ID":"03667af4-2c7e-4ef4-b020-2637ee3a42ed","Type":"ContainerStarted","Data":"d0ce661f74e7381e6937423d3f72b08688d64b1910dd6c8be0da7807542086aa"} Jun 07 16:27:04.322723 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.322652 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lktfq" event={"ID":"d3c33448-c2c4-4cc4-909f-e9a07079d6e1","Type":"ContainerStarted","Data":"1159a934c8d1ee2303f6ba8ae8633ef22a0f0a9ad4dfebdc3139b90e2e5b8df8"} Jun 07 16:27:04.338805 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.338714 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mj69l" event={"ID":"2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e","Type":"ContainerStarted","Data":"8306381452b9443e51e52ec82ecf66b594ddd64f1050273377d47e7933f0d9f6"} Jun 07 16:27:04.357786 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.357575 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmpj6" event={"ID":"73c30ff5-7ddf-4957-9100-db90b88afc15","Type":"ContainerStarted","Data":"d50062dcec60b25d5ab6f548697870b9dd32131daafebec7bde97b3e3193e8c6"} Jun 07 16:27:04.374453 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.374420 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6kgd" event={"ID":"d1ca383f-3d23-47a0-9d10-5203404b496a","Type":"ContainerStarted","Data":"c72c6700bcc1f009857f672276cd8a927b82966fd11e48d7c1d5de904d70bffa"} Jun 07 16:27:04.397277 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.397187 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-828b6" event={"ID":"4babfa83-0a29-4eee-a10b-e49cae1ba10d","Type":"ContainerStarted","Data":"0d4ccfb52561995bd2071cfb953c63eaf05ccd6da971b8db6042f2d5ba4f781f"} Jun 07 16:27:04.413754 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.413555 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:04.420376 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.420308 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" event={"ID":"56149dfbdfcaf47e3122c7dfcc85ae60","Type":"ContainerStarted","Data":"d0f245b8ce7b535b4eeef2be64c24e3df2104b2db7d75e4505b68a0834a99ff2"} Jun 07 16:27:04.432819 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.432789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" event={"ID":"3c2e177197e413ea6daf68a13dc2c9df","Type":"ContainerStarted","Data":"d78a0d4952be3520603536af62285d929d0491d21f32254a94d96cd1f719e4ae"} Jun 07 16:27:04.459473 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.459432 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7jqtk" event={"ID":"15582473-22c1-490c-965f-50d3ad3edb0d","Type":"ContainerStarted","Data":"e05e7238521e780dc3d1e9caf29436575118356634b932166acd6b1e218afe19"} Jun 07 16:27:04.461352 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.461323 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" event={"ID":"82c18a47-d134-4c9b-8974-99bc8db3e3f2","Type":"ContainerStarted","Data":"f25975ca35e0ce08c79885b7ebcc9712a21689363c07f9bac4fafa5698a3c194"} Jun 07 16:27:04.467348 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.467322 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" event={"ID":"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea","Type":"ContainerStarted","Data":"23b711fb76910ca157859c4581995bf326758446d0e43ada16595ea74f8c2cde"} Jun 07 16:27:04.837942 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.837904 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:04.838132 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:04.838076 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:04.838210 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:04.838174 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret podName:d1ae50c5-29b5-41aa-af9e-082fcf808170 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:06.838123231 +0000 UTC m=+5.041996496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret") pod "global-pull-secret-syncer-wrsz8" (UID: "d1ae50c5-29b5-41aa-af9e-082fcf808170") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:04.939239 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:04.938635 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:04.939239 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:04.938819 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:04.939239 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:04.938882 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs podName:d12ea486-aafe-455d-9f01-565eabcf0ca0 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:06.938863546 +0000 UTC m=+5.142736820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs") pod "network-metrics-daemon-f4wl2" (UID: "d12ea486-aafe-455d-9f01-565eabcf0ca0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:05.039427 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:05.039386 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p46q\" (UniqueName: \"kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q\") pod \"network-check-target-fmcbl\" (UID: \"07139989-b03c-4498-b73e-c9053c9769b4\") " pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:05.039593 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:05.039573 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:05.039593 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:05.039593 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:05.039707 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:05.039605 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9p46q for pod openshift-network-diagnostics/network-check-target-fmcbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:05.039707 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:05.039661 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q podName:07139989-b03c-4498-b73e-c9053c9769b4 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:07.039643807 +0000 UTC m=+5.243517073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9p46q" (UniqueName: "kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q") pod "network-check-target-fmcbl" (UID: "07139989-b03c-4498-b73e-c9053c9769b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:05.260042 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:05.259951 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 16:22:03 +0000 UTC" deadline="2028-01-02 07:45:00.489713566 +0000 UTC" Jun 07 16:27:05.260042 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:05.259995 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13767h17m55.229723844s" Jun 07 16:27:05.289527 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:05.289488 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:05.289710 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:05.289615 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:05.290089 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:05.290069 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:05.290187 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:05.290167 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:05.290251 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:05.290236 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:05.290355 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:05.290323 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:05.911078 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:05.911044 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:06.018310 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:06.018259 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 16:27:06.857884 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:06.857306 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:06.857884 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:06.857458 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:06.857884 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:06.857523 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret podName:d1ae50c5-29b5-41aa-af9e-082fcf808170 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:10.857504233 +0000 UTC m=+9.061377488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret") pod "global-pull-secret-syncer-wrsz8" (UID: "d1ae50c5-29b5-41aa-af9e-082fcf808170") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:06.958392 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:06.957776 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:06.958392 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:06.957950 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:06.958392 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:06.958005 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs podName:d12ea486-aafe-455d-9f01-565eabcf0ca0 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:10.957987406 +0000 UTC m=+9.161860658 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs") pod "network-metrics-daemon-f4wl2" (UID: "d12ea486-aafe-455d-9f01-565eabcf0ca0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:07.058915 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:07.058872 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p46q\" (UniqueName: \"kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q\") pod \"network-check-target-fmcbl\" (UID: \"07139989-b03c-4498-b73e-c9053c9769b4\") " pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:07.059125 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:07.059040 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:07.059125 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:07.059062 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:07.059125 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:07.059075 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9p46q for pod openshift-network-diagnostics/network-check-target-fmcbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:07.059228 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:07.059133 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q podName:07139989-b03c-4498-b73e-c9053c9769b4 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:11.05911482 +0000 UTC m=+9.262988074 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9p46q" (UniqueName: "kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q") pod "network-check-target-fmcbl" (UID: "07139989-b03c-4498-b73e-c9053c9769b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:07.289634 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:07.289558 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:07.289813 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:07.289689 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:07.290100 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:07.290074 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:07.290220 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:07.290197 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:07.290292 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:07.290257 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:07.290354 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:07.290332 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:09.289439 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:09.289403 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:09.289923 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:09.289441 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:09.289923 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:09.289446 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:09.289923 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:09.289523 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:09.289923 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:09.289601 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:09.289923 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:09.289712 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:10.890217 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:10.889650 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:10.890217 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:10.889811 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:10.890217 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:10.889878 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret podName:d1ae50c5-29b5-41aa-af9e-082fcf808170 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:18.889858234 +0000 UTC m=+17.093731501 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret") pod "global-pull-secret-syncer-wrsz8" (UID: "d1ae50c5-29b5-41aa-af9e-082fcf808170") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:10.990741 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:10.990700 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:10.990932 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:10.990914 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:10.990984 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:10.990976 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs podName:d12ea486-aafe-455d-9f01-565eabcf0ca0 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:18.990962031 +0000 UTC m=+17.194835282 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs") pod "network-metrics-daemon-f4wl2" (UID: "d12ea486-aafe-455d-9f01-565eabcf0ca0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:11.091142 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:11.091105 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p46q\" (UniqueName: \"kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q\") pod \"network-check-target-fmcbl\" (UID: \"07139989-b03c-4498-b73e-c9053c9769b4\") " pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:11.091334 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:11.091302 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:11.091334 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:11.091337 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:11.091514 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:11.091352 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9p46q for pod openshift-network-diagnostics/network-check-target-fmcbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:11.091514 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:11.091414 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q podName:07139989-b03c-4498-b73e-c9053c9769b4 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:19.091395157 +0000 UTC m=+17.295268412 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9p46q" (UniqueName: "kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q") pod "network-check-target-fmcbl" (UID: "07139989-b03c-4498-b73e-c9053c9769b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:11.289572 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:11.289482 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:11.289701 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:11.289616 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:11.290101 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:11.290079 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:11.290207 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:11.290178 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:11.290268 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:11.290229 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:11.290312 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:11.290301 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:13.289442 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:13.289348 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:13.289903 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:13.289484 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:13.289903 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:13.289497 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:13.289903 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:13.289520 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:13.289903 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:13.289617 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:13.289903 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:13.289697 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:15.289615 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:15.289589 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:15.290078 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:15.289623 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:15.290078 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:15.289675 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:15.290078 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:15.289721 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:15.290078 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:15.289854 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:15.290078 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:15.289953 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:17.289021 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:17.288980 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:17.289021 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:17.289028 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:17.289472 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:17.289033 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:17.289472 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:17.289118 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:17.289472 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:17.289229 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:17.289472 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:17.289288 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:18.947147 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:18.947112 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:18.947574 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:18.947256 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:18.947574 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:18.947308 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret podName:d1ae50c5-29b5-41aa-af9e-082fcf808170 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:34.94729384 +0000 UTC m=+33.151167091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret") pod "global-pull-secret-syncer-wrsz8" (UID: "d1ae50c5-29b5-41aa-af9e-082fcf808170") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:19.048128 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:19.048094 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:19.048295 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:19.048230 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:19.048295 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:19.048294 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs podName:d12ea486-aafe-455d-9f01-565eabcf0ca0 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:35.048278476 +0000 UTC m=+33.252151744 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs") pod "network-metrics-daemon-f4wl2" (UID: "d12ea486-aafe-455d-9f01-565eabcf0ca0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:19.148804 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:19.148768 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p46q\" (UniqueName: \"kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q\") pod \"network-check-target-fmcbl\" (UID: \"07139989-b03c-4498-b73e-c9053c9769b4\") " pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:19.148958 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:19.148903 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:19.148958 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:19.148920 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:19.148958 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:19.148929 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9p46q for pod openshift-network-diagnostics/network-check-target-fmcbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:19.149093 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:19.148978 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q podName:07139989-b03c-4498-b73e-c9053c9769b4 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:35.148961678 +0000 UTC m=+33.352834931 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9p46q" (UniqueName: "kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q") pod "network-check-target-fmcbl" (UID: "07139989-b03c-4498-b73e-c9053c9769b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:19.289470 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:19.289398 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:19.289470 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:19.289433 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:19.289636 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:19.289494 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:19.289636 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:19.289571 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:19.289636 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:19.289619 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:19.289775 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:19.289627 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:21.289467 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:21.289436 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:21.290032 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:21.289470 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:21.290032 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:21.289470 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:21.290032 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:21.289534 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:21.290032 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:21.289660 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:21.290032 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:21.289744 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:23.289777 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:23.289729 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:23.290222 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:23.289785 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:23.290222 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:23.289877 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:23.290222 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:23.290024 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:23.290393 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:23.290255 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:23.290393 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:23.290351 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:24.524040 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:24.523795 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" event={"ID":"56149dfbdfcaf47e3122c7dfcc85ae60","Type":"ContainerStarted","Data":"bdc974c39ec2c7109cb180300e36bd620fdd2f2ecdebd3c002aef9f8a7f1f0ff"} Jun 07 16:27:24.525345 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:24.525320 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7jqtk" event={"ID":"15582473-22c1-490c-965f-50d3ad3edb0d","Type":"ContainerStarted","Data":"2930f7a6db8ef66ee69288525cda74115257eccfabe93a4f716435d16d4b861e"} Jun 07 16:27:24.527457 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:24.527431 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" event={"ID":"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea","Type":"ContainerStarted","Data":"4854c1691c7924336f44463a7ce8071b6ad5d2b081149a92faacec5023cd0d27"} Jun 07 16:27:24.527559 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:24.527508 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" event={"ID":"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea","Type":"ContainerStarted","Data":"a8a8ddf2feaa47259bd911b8abdd2a1452877ebd110514c13b955b96737b1c00"} Jun 07 16:27:24.528970 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:24.528951 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" event={"ID":"03667af4-2c7e-4ef4-b020-2637ee3a42ed","Type":"ContainerStarted","Data":"3f20bd642f2dc50700f60f5f744361286618dd37eae6fb3501ad4b501b51609d"} Jun 07 16:27:24.536825 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:24.536786 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-143.ec2.internal" podStartSLOduration=21.536754749 podStartE2EDuration="21.536754749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:24.536262056 +0000 UTC m=+22.740135330" watchObservedRunningTime="2026-06-07 16:27:24.536754749 +0000 UTC m=+22.740628021" Jun 07 16:27:24.565712 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:24.565676 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7jqtk" podStartSLOduration=2.4970107 podStartE2EDuration="22.565663018s" totalImagesPullingTime="20.068652318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:24.550659634 +0000 UTC m=+22.754532907" watchObservedRunningTime="2026-06-07 16:27:24.565663018 +0000 UTC m=+22.769536291" Jun 07 16:27:24.566190 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:24.566149 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4vwdl" podStartSLOduration=2.460999772 podStartE2EDuration="22.566138198s" totalImagesPullingTime="20.105138426s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:24.565609232 +0000 UTC m=+22.769482504" watchObservedRunningTime="2026-06-07 16:27:24.566138198 +0000 UTC m=+22.770011474" Jun 07 16:27:25.289319 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.289292 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:25.289442 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.289377 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:25.289442 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.289389 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:25.289519 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:25.289463 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:25.289560 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:25.289517 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:25.289592 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:25.289574 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:25.532176 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.532105 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lktfq" event={"ID":"d3c33448-c2c4-4cc4-909f-e9a07079d6e1","Type":"ContainerStarted","Data":"774b9fea8ca7ebb1eeccc5968dc58501eec72edb69fc749ce4bc6408fb29cfda"} Jun 07 16:27:25.533591 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.533564 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mj69l" event={"ID":"2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e","Type":"ContainerStarted","Data":"dc0ff1318cedf6b69ba28b9b5eced66e305b78652a18088bb89b85e1bd5a77c0"} Jun 07 16:27:25.535085 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.535059 2565 generic.go:356] "Generic (PLEG): container finished" podID="73c30ff5-7ddf-4957-9100-db90b88afc15" containerID="6d8566528dc64fb6ed8afdd46b53257a8e5a48636fcdd6972f6fc1ed267c3bb1" exitCode=0 Jun 07 16:27:25.535176 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.535128 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmpj6" event={"ID":"73c30ff5-7ddf-4957-9100-db90b88afc15","Type":"ContainerDied","Data":"6d8566528dc64fb6ed8afdd46b53257a8e5a48636fcdd6972f6fc1ed267c3bb1"} Jun 07 16:27:25.536609 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.536587 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p6kgd" event={"ID":"d1ca383f-3d23-47a0-9d10-5203404b496a","Type":"ContainerStarted","Data":"029c831b0881185cc52162e3a20c69e6826f6814cbb735af9a4abb32671b45df"} Jun 07 16:27:25.538088 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.538062 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-828b6" event={"ID":"4babfa83-0a29-4eee-a10b-e49cae1ba10d","Type":"ContainerStarted","Data":"da44c9036e849dfc2cf8e15c8c6273ce72371c0a55992edbce4afe121c2a93f0"} Jun 07 16:27:25.539528 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.539508 2565 generic.go:356] "Generic (PLEG): container finished" podID="3c2e177197e413ea6daf68a13dc2c9df" containerID="f8d21ac04a4e9daf4267307055a171c4dfffc40214f3feaadc4b401f7ea77db3" exitCode=0 Jun 07 16:27:25.539640 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.539572 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" event={"ID":"3c2e177197e413ea6daf68a13dc2c9df","Type":"ContainerDied","Data":"f8d21ac04a4e9daf4267307055a171c4dfffc40214f3feaadc4b401f7ea77db3"} Jun 07 16:27:25.540995 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.540968 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" event={"ID":"82c18a47-d134-4c9b-8974-99bc8db3e3f2","Type":"ContainerStarted","Data":"af92634687789b6170d1dc80fde0b2e51362bb1ee96d60f2de169cda7ff1221c"} Jun 07 16:27:25.543833 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.543816 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:27:25.544114 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.544095 2565 generic.go:356] "Generic (PLEG): container finished" podID="bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea" containerID="4854c1691c7924336f44463a7ce8071b6ad5d2b081149a92faacec5023cd0d27" exitCode=1 Jun 07 16:27:25.544196 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.544166 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" event={"ID":"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea","Type":"ContainerDied","Data":"4854c1691c7924336f44463a7ce8071b6ad5d2b081149a92faacec5023cd0d27"} Jun 07 16:27:25.544257 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.544226 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" event={"ID":"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea","Type":"ContainerStarted","Data":"ac961210ae161314bc714a68981181a28e63b27bb54c9b8f401a0a07f5bafa76"} Jun 07 16:27:25.544298 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.544265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" event={"ID":"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea","Type":"ContainerStarted","Data":"1b968e740b5737579c080b5706da0263c3a1a485dfb64f98817ea7bacbeb41bf"} Jun 07 16:27:25.544298 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.544293 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" event={"ID":"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea","Type":"ContainerStarted","Data":"deb9bee91df595e2989a1dbd7210bc01b04ade45a26f41b273c131643f80b958"} Jun 07 16:27:25.544360 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.544327 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" event={"ID":"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea","Type":"ContainerStarted","Data":"5da9bd1354e45e5eca2f669f79047227483186198f5d015908262dbda0f43025"} Jun 07 16:27:25.546136 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.546102 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lktfq" podStartSLOduration=3.521519694 podStartE2EDuration="23.546091648s" totalImagesPullingTime="20.024571954s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:25.545635462 +0000 UTC m=+23.749508735" watchObservedRunningTime="2026-06-07 16:27:25.546091648 +0000 UTC m=+23.749964918" Jun 07 16:27:25.572102 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.572063 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-828b6" podStartSLOduration=7.791110346 podStartE2EDuration="23.572050499s" totalImagesPullingTime="15.780940153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:25.572028012 +0000 UTC m=+23.775901284" watchObservedRunningTime="2026-06-07 16:27:25.572050499 +0000 UTC m=+23.775923771" Jun 07 16:27:25.586329 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.586284 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p6kgd" podStartSLOduration=3.510081808 podStartE2EDuration="23.586272763s" totalImagesPullingTime="20.076190955s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:25.585755092 +0000 UTC m=+23.789628366" watchObservedRunningTime="2026-06-07 16:27:25.586272763 +0000 UTC m=+23.790146036" Jun 07 16:27:25.626246 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.626202 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mj69l" podStartSLOduration=3.579823007 podStartE2EDuration="23.626188368s" totalImagesPullingTime="20.046365361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:25.625737901 +0000 UTC m=+23.829611175" watchObservedRunningTime="2026-06-07 16:27:25.626188368 +0000 UTC m=+23.830061640" Jun 07 16:27:25.835176 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.835109 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:25.835710 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:25.835691 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:26.346559 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:26.346396 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 07 16:27:26.549319 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:26.549202 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" event={"ID":"3c2e177197e413ea6daf68a13dc2c9df","Type":"ContainerStarted","Data":"e80585a26549f130f381eea56ca100f25d32c993e95f36ea0c70561efb7d1862"} Jun 07 16:27:26.551660 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:26.551629 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" event={"ID":"82c18a47-d134-4c9b-8974-99bc8db3e3f2","Type":"ContainerStarted","Data":"9515e3d2b0ae7f1fff453561c72da8ca124808a5d52e92a5bf353811c7438290"} Jun 07 16:27:26.552109 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:26.552091 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:26.552471 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:26.552451 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-828b6" Jun 07 16:27:26.563371 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:26.563321 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-143.ec2.internal" podStartSLOduration=23.563303391 podStartE2EDuration="23.563303391s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:26.562828051 +0000 UTC m=+24.766701325" watchObservedRunningTime="2026-06-07 16:27:26.563303391 +0000 UTC m=+24.767176666" Jun 07 16:27:27.289906 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:27.289806 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:27.289906 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:27.289844 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:27.290130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:27.289833 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:27.290130 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:27.289961 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:27.290130 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:27.290061 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:27.290256 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:27.290148 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:27.291423 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:27.290722 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-07T16:27:26.346557151Z","UUID":"06bdbad4-6b8c-471a-880c-a248e1f94625","Handler":null,"Name":"","Endpoint":""} Jun 07 16:27:27.292547 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:27.292522 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 07 16:27:27.292670 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:27.292576 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 07 16:27:27.559417 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:27.559393 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:27:27.560356 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:27.560330 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" event={"ID":"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea","Type":"ContainerStarted","Data":"8d373279d83384e5590b4cc8f1c9e39009e3b1d9ba347152e441ea23b6ac5909"} Jun 07 16:27:28.565569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:28.565528 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" event={"ID":"82c18a47-d134-4c9b-8974-99bc8db3e3f2","Type":"ContainerStarted","Data":"80658d3f785f291e825a4eae422d90e45548ea0b26a0ccc7be6865fe207c0578"} Jun 07 16:27:28.582472 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:28.582421 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rglv6" podStartSLOduration=4.472790429 podStartE2EDuration="26.582402748s" totalImagesPullingTime="22.109612319s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:28.580821934 +0000 UTC m=+26.784695206" watchObservedRunningTime="2026-06-07 16:27:28.582402748 +0000 UTC m=+26.786276051" Jun 07 16:27:29.289681 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:29.289643 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:29.289864 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:29.289659 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:29.289864 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:29.289796 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:29.289864 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:29.289660 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:29.289864 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:29.289855 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:29.290054 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:29.289912 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:30.573382 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:30.573157 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:27:30.573729 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:30.573703 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" event={"ID":"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea","Type":"ContainerStarted","Data":"e4ef81fea7e11fccb60148c3cfcfd27ccc958c84276cba11ac668f6d2103e18d"} Jun 07 16:27:30.574108 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:30.574082 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:30.574206 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:30.574160 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:30.574206 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:30.574163 2565 scope.go:117] "RemoveContainer" containerID="4854c1691c7924336f44463a7ce8071b6ad5d2b081149a92faacec5023cd0d27" Jun 07 16:27:30.576532 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:30.576512 2565 generic.go:356] "Generic (PLEG): container finished" podID="73c30ff5-7ddf-4957-9100-db90b88afc15" containerID="c5634ff4299bc1caa9f7a914fca466666c9c34892f9e1548fbf2ba306a1f346c" exitCode=0 Jun 07 16:27:30.576626 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:30.576556 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmpj6" event={"ID":"73c30ff5-7ddf-4957-9100-db90b88afc15","Type":"ContainerDied","Data":"c5634ff4299bc1caa9f7a914fca466666c9c34892f9e1548fbf2ba306a1f346c"} Jun 07 16:27:30.591698 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:30.591671 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:31.289984 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:31.289746 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:31.290317 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:31.289809 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:31.290317 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:31.290082 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:31.290317 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:31.290141 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:31.290317 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:31.289819 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:31.290317 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:31.290243 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:31.581821 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:31.581738 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:27:31.582286 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:31.582111 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" event={"ID":"bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea","Type":"ContainerStarted","Data":"1609847d09a502adf55bb042912bb1857cd53eaf0b8fd139b6352195fe6d0411"} Jun 07 16:27:31.582411 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:31.582386 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:31.597639 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:31.597616 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:27:31.611416 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:31.611381 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" podStartSLOduration=8.936550617 podStartE2EDuration="29.611367101s" totalImagesPullingTime="20.674816484s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:31.611209298 +0000 UTC m=+29.815082570" watchObservedRunningTime="2026-06-07 16:27:31.611367101 +0000 UTC m=+29.815240376" Jun 07 16:27:32.043265 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:32.043176 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wrsz8"] Jun 07 16:27:32.043439 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:32.043311 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:32.043439 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:32.043424 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:32.047008 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:32.046970 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fmcbl"] Jun 07 16:27:32.047132 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:32.047079 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:32.047209 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:32.047171 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:32.047775 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:32.047733 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f4wl2"] Jun 07 16:27:32.047875 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:32.047854 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:32.047955 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:32.047934 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:32.586625 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:32.586590 2565 generic.go:356] "Generic (PLEG): container finished" podID="73c30ff5-7ddf-4957-9100-db90b88afc15" containerID="35a9ba281ca1676f6ff04fdfcef5d008f2d682e236f3c227ed6f61b5e94f5c0e" exitCode=0 Jun 07 16:27:32.587085 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:32.586673 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmpj6" event={"ID":"73c30ff5-7ddf-4957-9100-db90b88afc15","Type":"ContainerDied","Data":"35a9ba281ca1676f6ff04fdfcef5d008f2d682e236f3c227ed6f61b5e94f5c0e"} Jun 07 16:27:33.288928 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:33.288901 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:33.289094 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:33.288947 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:33.289094 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:33.289035 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:33.289193 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:33.289172 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:34.289616 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:34.289588 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:34.290200 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:34.289677 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:34.593940 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:34.593906 2565 generic.go:356] "Generic (PLEG): container finished" podID="73c30ff5-7ddf-4957-9100-db90b88afc15" containerID="a02a1a4b69ae44509b98bc68a4dc479e5b79bba7039c1076dba3c6c99087a5ba" exitCode=0 Jun 07 16:27:34.594096 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:34.593955 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmpj6" event={"ID":"73c30ff5-7ddf-4957-9100-db90b88afc15","Type":"ContainerDied","Data":"a02a1a4b69ae44509b98bc68a4dc479e5b79bba7039c1076dba3c6c99087a5ba"} Jun 07 16:27:34.984228 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:34.984043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:34.984344 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:34.984202 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:34.984344 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:34.984321 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret podName:d1ae50c5-29b5-41aa-af9e-082fcf808170 nodeName:}" failed. No retries permitted until 2026-06-07 16:28:06.984306079 +0000 UTC m=+65.188179330 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret") pod "global-pull-secret-syncer-wrsz8" (UID: "d1ae50c5-29b5-41aa-af9e-082fcf808170") : object "kube-system"/"original-pull-secret" not registered Jun 07 16:27:35.084806 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:35.084774 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:35.084965 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:35.084914 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:35.085033 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:35.084970 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs podName:d12ea486-aafe-455d-9f01-565eabcf0ca0 nodeName:}" failed. No retries permitted until 2026-06-07 16:28:07.084953931 +0000 UTC m=+65.288827184 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs") pod "network-metrics-daemon-f4wl2" (UID: "d12ea486-aafe-455d-9f01-565eabcf0ca0") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 16:27:35.185881 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:35.185845 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p46q\" (UniqueName: \"kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q\") pod \"network-check-target-fmcbl\" (UID: \"07139989-b03c-4498-b73e-c9053c9769b4\") " pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:35.186028 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:35.185974 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 16:27:35.186028 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:35.185993 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 16:27:35.186028 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:35.186002 2565 projected.go:196] Error preparing data for projected volume kube-api-access-9p46q for pod openshift-network-diagnostics/network-check-target-fmcbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:35.186135 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:35.186057 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q podName:07139989-b03c-4498-b73e-c9053c9769b4 nodeName:}" failed. No retries permitted until 2026-06-07 16:28:07.186037302 +0000 UTC m=+65.389910557 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9p46q" (UniqueName: "kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q") pod "network-check-target-fmcbl" (UID: "07139989-b03c-4498-b73e-c9053c9769b4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 16:27:35.289494 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:35.289459 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:35.289494 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:35.289485 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:35.290007 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:35.289579 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrsz8" podUID="d1ae50c5-29b5-41aa-af9e-082fcf808170" Jun 07 16:27:35.290007 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:35.289709 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:27:36.289531 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:36.289496 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:36.289715 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:36.289640 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fmcbl" podUID="07139989-b03c-4498-b73e-c9053c9769b4" Jun 07 16:27:37.123239 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.123206 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-143.ec2.internal" event="NodeReady" Jun 07 16:27:37.123412 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.123372 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 07 16:27:37.156119 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.156092 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h"] Jun 07 16:27:37.158584 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.158563 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:37.160752 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.160728 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb"] Jun 07 16:27:37.162245 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.161954 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 07 16:27:37.162245 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.162009 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 07 16:27:37.162245 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.162019 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 07 16:27:37.162245 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.162104 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 07 16:27:37.162988 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.162969 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6"] Jun 07 16:27:37.163116 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.163096 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.165144 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.165124 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67df8cdf5b-4b6rm"] Jun 07 16:27:37.165286 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.165267 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" Jun 07 16:27:37.165816 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.165657 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 07 16:27:37.165816 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.165682 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 07 16:27:37.166010 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.165990 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 07 16:27:37.166255 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.166239 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 07 16:27:37.166698 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.166681 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.167671 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.167655 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-vbfd9\"" Jun 07 16:27:37.167862 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.167697 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 07 16:27:37.170361 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.169678 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 07 16:27:37.170361 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.169733 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8v6gq\"" Jun 07 16:27:37.170361 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.169861 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 07 16:27:37.170361 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.170303 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h"] Jun 07 16:27:37.170581 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.170520 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 07 16:27:37.175788 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.172836 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6"] Jun 07 16:27:37.176800 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.176022 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-jc2wf"] Jun 07 16:27:37.179082 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.178863 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb"] Jun 07 16:27:37.179082 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.178957 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jc2wf" Jun 07 16:27:37.181268 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.179799 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67df8cdf5b-4b6rm"] Jun 07 16:27:37.181268 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.180697 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-d7k2w"] Jun 07 16:27:37.181268 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.180905 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 07 16:27:37.182347 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.182326 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 07 16:27:37.182935 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.182365 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8l4v2\"" Jun 07 16:27:37.182935 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.182610 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 07 16:27:37.183222 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.183199 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 07 16:27:37.184459 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.184442 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.186537 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.186514 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 07 16:27:37.186676 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.186657 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bl7z8\"" Jun 07 16:27:37.186752 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.186659 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 07 16:27:37.189512 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.189490 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jc2wf"] Jun 07 16:27:37.193239 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.193211 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d7k2w"] Jun 07 16:27:37.289217 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.289195 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:27:37.289416 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.289355 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:27:37.291899 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.291824 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:27:37.291899 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.291831 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6ng2d\"" Jun 07 16:27:37.292308 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.291903 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:27:37.301303 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-hub\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.301405 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgbs2\" (UniqueName: \"kubernetes.io/projected/366f7f1f-876d-4799-a191-a51b1f0c4326-kube-api-access-mgbs2\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.301405 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301354 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/91e673ce-f8a9-4716-b4b5-861a743b9d20-klusterlet-config\") pod \"klusterlet-addon-workmgr-959d95d-vld9h\" (UID: \"91e673ce-f8a9-4716-b4b5-861a743b9d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:37.301506 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5vl8\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-kube-api-access-z5vl8\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.301506 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301452 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-tmp-dir\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.301506 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301480 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmhfg\" (UniqueName: \"kubernetes.io/projected/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-kube-api-access-gmhfg\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.301632 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301516 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91e673ce-f8a9-4716-b4b5-861a743b9d20-tmp\") pod \"klusterlet-addon-workmgr-959d95d-vld9h\" (UID: \"91e673ce-f8a9-4716-b4b5-861a743b9d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:37.301632 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301539 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad0e2266-63fa-4b2b-9891-1af906de0c51-cert\") pod \"ingress-canary-jc2wf\" (UID: \"ad0e2266-63fa-4b2b-9891-1af906de0c51\") " pod="openshift-ingress-canary/ingress-canary-jc2wf" Jun 07 16:27:37.301632 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301567 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.301632 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301590 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-ca-trust-extracted\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.301632 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301615 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-installation-pull-secrets\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.301827 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301648 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-trusted-ca\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.301827 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301688 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvzfd\" (UniqueName: \"kubernetes.io/projected/ad0e2266-63fa-4b2b-9891-1af906de0c51-kube-api-access-kvzfd\") pod \"ingress-canary-jc2wf\" (UID: \"ad0e2266-63fa-4b2b-9891-1af906de0c51\") " pod="openshift-ingress-canary/ingress-canary-jc2wf" Jun 07 16:27:37.301827 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301715 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-config-volume\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.301827 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2cjt\" (UniqueName: \"kubernetes.io/projected/caf11cda-dfc0-4e6b-8f55-171fbe319860-kube-api-access-n2cjt\") pod \"managed-serviceaccount-addon-agent-585645458d-ndcz6\" (UID: \"caf11cda-dfc0-4e6b-8f55-171fbe319860\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" Jun 07 16:27:37.301992 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301851 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/366f7f1f-876d-4799-a191-a51b1f0c4326-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.301992 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301877 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf7t5\" (UniqueName: \"kubernetes.io/projected/91e673ce-f8a9-4716-b4b5-861a743b9d20-kube-api-access-wf7t5\") pod \"klusterlet-addon-workmgr-959d95d-vld9h\" (UID: \"91e673ce-f8a9-4716-b4b5-861a743b9d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:37.301992 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.301910 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-bound-sa-token\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.302134 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.302006 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/caf11cda-dfc0-4e6b-8f55-171fbe319860-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-585645458d-ndcz6\" (UID: \"caf11cda-dfc0-4e6b-8f55-171fbe319860\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" Jun 07 16:27:37.302134 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.302033 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-ca\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.302134 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.302052 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-image-registry-private-configuration\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.302134 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.302078 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.302134 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.302101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-certificates\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.302134 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.302117 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.302450 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.302167 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.402596 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.402509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-config-volume\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.402596 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.402551 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2cjt\" (UniqueName: \"kubernetes.io/projected/caf11cda-dfc0-4e6b-8f55-171fbe319860-kube-api-access-n2cjt\") pod \"managed-serviceaccount-addon-agent-585645458d-ndcz6\" (UID: \"caf11cda-dfc0-4e6b-8f55-171fbe319860\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" Jun 07 16:27:37.402866 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.402619 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/366f7f1f-876d-4799-a191-a51b1f0c4326-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.402866 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.402773 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf7t5\" (UniqueName: \"kubernetes.io/projected/91e673ce-f8a9-4716-b4b5-861a743b9d20-kube-api-access-wf7t5\") pod \"klusterlet-addon-workmgr-959d95d-vld9h\" (UID: \"91e673ce-f8a9-4716-b4b5-861a743b9d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:37.402866 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.402813 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-bound-sa-token\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.402866 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.402846 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/caf11cda-dfc0-4e6b-8f55-171fbe319860-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-585645458d-ndcz6\" (UID: \"caf11cda-dfc0-4e6b-8f55-171fbe319860\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" Jun 07 16:27:37.403096 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.402884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-ca\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.403096 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.402912 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-image-registry-private-configuration\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.403096 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.402943 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.403096 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.402968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-certificates\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.403096 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.402995 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.403261 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403202 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-config-volume\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.403319 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403258 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.403319 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403297 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-hub\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.403394 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403326 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgbs2\" (UniqueName: \"kubernetes.io/projected/366f7f1f-876d-4799-a191-a51b1f0c4326-kube-api-access-mgbs2\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.403394 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/91e673ce-f8a9-4716-b4b5-861a743b9d20-klusterlet-config\") pod \"klusterlet-addon-workmgr-959d95d-vld9h\" (UID: \"91e673ce-f8a9-4716-b4b5-861a743b9d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:37.403394 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:37.403359 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:27:37.403394 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:37.403376 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67df8cdf5b-4b6rm: secret "image-registry-tls" not found Jun 07 16:27:37.403394 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403377 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5vl8\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-kube-api-access-z5vl8\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.403535 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403403 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-tmp-dir\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.403535 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:37.403423 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls podName:804be58c-3f9e-4ff7-8a1d-e19e10f57a59 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:37.903407438 +0000 UTC m=+36.107280706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls") pod "image-registry-67df8cdf5b-4b6rm" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59") : secret "image-registry-tls" not found Jun 07 16:27:37.403535 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403450 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmhfg\" (UniqueName: \"kubernetes.io/projected/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-kube-api-access-gmhfg\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.403535 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403487 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91e673ce-f8a9-4716-b4b5-861a743b9d20-tmp\") pod \"klusterlet-addon-workmgr-959d95d-vld9h\" (UID: \"91e673ce-f8a9-4716-b4b5-861a743b9d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:37.403535 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403507 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad0e2266-63fa-4b2b-9891-1af906de0c51-cert\") pod \"ingress-canary-jc2wf\" (UID: \"ad0e2266-63fa-4b2b-9891-1af906de0c51\") " pod="openshift-ingress-canary/ingress-canary-jc2wf" Jun 07 16:27:37.403712 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403533 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.403712 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403559 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-ca-trust-extracted\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.403712 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403581 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-installation-pull-secrets\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.403712 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-trusted-ca\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.403712 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403296 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/366f7f1f-876d-4799-a191-a51b1f0c4326-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.403712 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403673 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvzfd\" (UniqueName: \"kubernetes.io/projected/ad0e2266-63fa-4b2b-9891-1af906de0c51-kube-api-access-kvzfd\") pod \"ingress-canary-jc2wf\" (UID: \"ad0e2266-63fa-4b2b-9891-1af906de0c51\") " pod="openshift-ingress-canary/ingress-canary-jc2wf" Jun 07 16:27:37.404415 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403620 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-tmp-dir\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.404620 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.403615 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-certificates\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.404964 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.404940 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/91e673ce-f8a9-4716-b4b5-861a743b9d20-tmp\") pod \"klusterlet-addon-workmgr-959d95d-vld9h\" (UID: \"91e673ce-f8a9-4716-b4b5-861a743b9d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:37.405436 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.405404 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-ca-trust-extracted\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.405527 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:37.405511 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:37.405590 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.405557 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-trusted-ca\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.405648 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:37.405569 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls podName:4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec nodeName:}" failed. No retries permitted until 2026-06-07 16:27:37.905552407 +0000 UTC m=+36.109425673 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls") pod "dns-default-d7k2w" (UID: "4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec") : secret "dns-default-metrics-tls" not found Jun 07 16:27:37.408940 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.408919 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/91e673ce-f8a9-4716-b4b5-861a743b9d20-klusterlet-config\") pod \"klusterlet-addon-workmgr-959d95d-vld9h\" (UID: \"91e673ce-f8a9-4716-b4b5-861a743b9d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:37.409044 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.409026 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-hub\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.409110 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.409033 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.409275 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.409246 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-ca\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.409512 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.409490 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-image-registry-private-configuration\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.410151 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.410108 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/caf11cda-dfc0-4e6b-8f55-171fbe319860-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-585645458d-ndcz6\" (UID: \"caf11cda-dfc0-4e6b-8f55-171fbe319860\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" Jun 07 16:27:37.411143 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.411121 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-installation-pull-secrets\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.411248 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.411166 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/366f7f1f-876d-4799-a191-a51b1f0c4326-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.411248 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.411211 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad0e2266-63fa-4b2b-9891-1af906de0c51-cert\") pod \"ingress-canary-jc2wf\" (UID: \"ad0e2266-63fa-4b2b-9891-1af906de0c51\") " pod="openshift-ingress-canary/ingress-canary-jc2wf" Jun 07 16:27:37.414954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.414374 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5vl8\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-kube-api-access-z5vl8\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.414954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.414411 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2cjt\" (UniqueName: \"kubernetes.io/projected/caf11cda-dfc0-4e6b-8f55-171fbe319860-kube-api-access-n2cjt\") pod \"managed-serviceaccount-addon-agent-585645458d-ndcz6\" (UID: \"caf11cda-dfc0-4e6b-8f55-171fbe319860\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" Jun 07 16:27:37.414954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.414571 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvzfd\" (UniqueName: \"kubernetes.io/projected/ad0e2266-63fa-4b2b-9891-1af906de0c51-kube-api-access-kvzfd\") pod \"ingress-canary-jc2wf\" (UID: \"ad0e2266-63fa-4b2b-9891-1af906de0c51\") " pod="openshift-ingress-canary/ingress-canary-jc2wf" Jun 07 16:27:37.414954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.414726 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-bound-sa-token\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.414954 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.414915 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf7t5\" (UniqueName: \"kubernetes.io/projected/91e673ce-f8a9-4716-b4b5-861a743b9d20-kube-api-access-wf7t5\") pod \"klusterlet-addon-workmgr-959d95d-vld9h\" (UID: \"91e673ce-f8a9-4716-b4b5-861a743b9d20\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:37.415564 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.415540 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgbs2\" (UniqueName: \"kubernetes.io/projected/366f7f1f-876d-4799-a191-a51b1f0c4326-kube-api-access-mgbs2\") pod \"cluster-proxy-proxy-agent-6ff4f6946d-rqhhb\" (UID: \"366f7f1f-876d-4799-a191-a51b1f0c4326\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.415791 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.415770 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmhfg\" (UniqueName: \"kubernetes.io/projected/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-kube-api-access-gmhfg\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.474136 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.474102 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:37.496070 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.496046 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:27:37.503830 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.503807 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" Jun 07 16:27:37.526472 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.526451 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-jc2wf" Jun 07 16:27:37.906840 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.906804 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:37.907011 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:37.906857 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:37.907011 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:37.906962 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:37.907011 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:37.906993 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:27:37.907011 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:37.907010 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67df8cdf5b-4b6rm: secret "image-registry-tls" not found Jun 07 16:27:37.907150 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:37.907049 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls podName:4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec nodeName:}" failed. No retries permitted until 2026-06-07 16:27:38.907030888 +0000 UTC m=+37.110904139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls") pod "dns-default-d7k2w" (UID: "4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec") : secret "dns-default-metrics-tls" not found Jun 07 16:27:37.907150 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:37.907065 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls podName:804be58c-3f9e-4ff7-8a1d-e19e10f57a59 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:38.907058536 +0000 UTC m=+37.110931786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls") pod "image-registry-67df8cdf5b-4b6rm" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59") : secret "image-registry-tls" not found Jun 07 16:27:38.289011 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:38.288978 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:27:38.292114 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:38.291917 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:27:38.292114 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:38.291921 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:27:38.292114 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:38.291922 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8469t\"" Jun 07 16:27:38.739429 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:38.739229 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-jc2wf"] Jun 07 16:27:38.743448 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:38.743417 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0e2266_63fa_4b2b_9891_1af906de0c51.slice/crio-117fd8d9faa488f015c49c3a89e7767aeaa2d4a8912944a91a2c56434a1de548 WatchSource:0}: Error finding container 117fd8d9faa488f015c49c3a89e7767aeaa2d4a8912944a91a2c56434a1de548: Status 404 returned error can't find the container with id 117fd8d9faa488f015c49c3a89e7767aeaa2d4a8912944a91a2c56434a1de548 Jun 07 16:27:38.746103 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:38.745814 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6"] Jun 07 16:27:38.749604 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:38.749525 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcaf11cda_dfc0_4e6b_8f55_171fbe319860.slice/crio-02cc149421f43414b0ac49434d9dbf1ab7614f1d4b4079e929375b60143e780c WatchSource:0}: Error finding container 02cc149421f43414b0ac49434d9dbf1ab7614f1d4b4079e929375b60143e780c: Status 404 returned error can't find the container with id 02cc149421f43414b0ac49434d9dbf1ab7614f1d4b4079e929375b60143e780c Jun 07 16:27:38.751066 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:38.751044 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h"] Jun 07 16:27:38.763668 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:38.763641 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb"] Jun 07 16:27:38.767173 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:27:38.767145 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod366f7f1f_876d_4799_a191_a51b1f0c4326.slice/crio-290f9395c8451f39a2ce547080c5caddffb38e87241333b9004322fcbc63b79d WatchSource:0}: Error finding container 290f9395c8451f39a2ce547080c5caddffb38e87241333b9004322fcbc63b79d: Status 404 returned error can't find the container with id 290f9395c8451f39a2ce547080c5caddffb38e87241333b9004322fcbc63b79d Jun 07 16:27:38.916668 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:38.916642 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:38.916777 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:38.916684 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:38.916830 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:38.916817 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:38.916865 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:38.916832 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:27:38.916865 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:38.916843 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67df8cdf5b-4b6rm: secret "image-registry-tls" not found Jun 07 16:27:38.916925 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:38.916914 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls podName:804be58c-3f9e-4ff7-8a1d-e19e10f57a59 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:40.916901231 +0000 UTC m=+39.120774483 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls") pod "image-registry-67df8cdf5b-4b6rm" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59") : secret "image-registry-tls" not found Jun 07 16:27:38.916962 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:38.916926 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls podName:4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec nodeName:}" failed. No retries permitted until 2026-06-07 16:27:40.916920278 +0000 UTC m=+39.120793529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls") pod "dns-default-d7k2w" (UID: "4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec") : secret "dns-default-metrics-tls" not found Jun 07 16:27:39.613289 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:39.613090 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jc2wf" event={"ID":"ad0e2266-63fa-4b2b-9891-1af906de0c51","Type":"ContainerStarted","Data":"117fd8d9faa488f015c49c3a89e7767aeaa2d4a8912944a91a2c56434a1de548"} Jun 07 16:27:39.615987 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:39.615908 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" event={"ID":"366f7f1f-876d-4799-a191-a51b1f0c4326","Type":"ContainerStarted","Data":"290f9395c8451f39a2ce547080c5caddffb38e87241333b9004322fcbc63b79d"} Jun 07 16:27:39.617984 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:39.617951 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" event={"ID":"91e673ce-f8a9-4716-b4b5-861a743b9d20","Type":"ContainerStarted","Data":"992568dbd546f556a338bcb4eff163cdaa0749d2166f2944bc5000d1b42faf91"} Jun 07 16:27:39.620098 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:39.619990 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" event={"ID":"caf11cda-dfc0-4e6b-8f55-171fbe319860","Type":"ContainerStarted","Data":"02cc149421f43414b0ac49434d9dbf1ab7614f1d4b4079e929375b60143e780c"} Jun 07 16:27:39.625721 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:39.625692 2565 generic.go:356] "Generic (PLEG): container finished" podID="73c30ff5-7ddf-4957-9100-db90b88afc15" containerID="e75a114ab5a30d7256fc939afd9625cd11dc4577b32390450def33bbfc665307" exitCode=0 Jun 07 16:27:39.625833 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:39.625743 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmpj6" event={"ID":"73c30ff5-7ddf-4957-9100-db90b88afc15","Type":"ContainerDied","Data":"e75a114ab5a30d7256fc939afd9625cd11dc4577b32390450def33bbfc665307"} Jun 07 16:27:40.641677 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:40.641639 2565 generic.go:356] "Generic (PLEG): container finished" podID="73c30ff5-7ddf-4957-9100-db90b88afc15" containerID="c77989faf76c4325c13431c2cda64f4f878ee14ff14d2d9b99630f7b095f810a" exitCode=0 Jun 07 16:27:40.642286 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:40.641702 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmpj6" event={"ID":"73c30ff5-7ddf-4957-9100-db90b88afc15","Type":"ContainerDied","Data":"c77989faf76c4325c13431c2cda64f4f878ee14ff14d2d9b99630f7b095f810a"} Jun 07 16:27:40.936488 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:40.936410 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:40.936488 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:40.936473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:40.936692 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:40.936612 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:27:40.936692 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:40.936629 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67df8cdf5b-4b6rm: secret "image-registry-tls" not found Jun 07 16:27:40.936692 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:40.936686 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls podName:804be58c-3f9e-4ff7-8a1d-e19e10f57a59 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:44.936667252 +0000 UTC m=+43.140540506 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls") pod "image-registry-67df8cdf5b-4b6rm" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59") : secret "image-registry-tls" not found Jun 07 16:27:40.937107 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:40.937086 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:40.937204 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:40.937143 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls podName:4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec nodeName:}" failed. No retries permitted until 2026-06-07 16:27:44.937127239 +0000 UTC m=+43.141000491 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls") pod "dns-default-d7k2w" (UID: "4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec") : secret "dns-default-metrics-tls" not found Jun 07 16:27:41.649096 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:41.649050 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vmpj6" event={"ID":"73c30ff5-7ddf-4957-9100-db90b88afc15","Type":"ContainerStarted","Data":"5a8cb734be51a99411d2efaa1911b384e64df4e5c4b5f1b1cf3f1e6e696ec9ba"} Jun 07 16:27:41.672858 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:41.672793 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vmpj6" podStartSLOduration=9.017901139 podStartE2EDuration="39.672753614s" totalImagesPullingTime="30.654852475s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:41.671329292 +0000 UTC m=+39.875202565" watchObservedRunningTime="2026-06-07 16:27:41.672753614 +0000 UTC m=+39.876626890" Jun 07 16:27:44.973420 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:44.973377 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:44.973987 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:44.973443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:44.973987 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:44.973520 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:44.973987 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:44.973580 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:27:44.973987 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:44.973594 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls podName:4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec nodeName:}" failed. No retries permitted until 2026-06-07 16:27:52.973573997 +0000 UTC m=+51.177447271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls") pod "dns-default-d7k2w" (UID: "4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec") : secret "dns-default-metrics-tls" not found Jun 07 16:27:44.973987 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:44.973595 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67df8cdf5b-4b6rm: secret "image-registry-tls" not found Jun 07 16:27:44.973987 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:44.973633 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls podName:804be58c-3f9e-4ff7-8a1d-e19e10f57a59 nodeName:}" failed. No retries permitted until 2026-06-07 16:27:52.973620899 +0000 UTC m=+51.177494155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls") pod "image-registry-67df8cdf5b-4b6rm" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59") : secret "image-registry-tls" not found Jun 07 16:27:48.669257 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.669220 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-jc2wf" event={"ID":"ad0e2266-63fa-4b2b-9891-1af906de0c51","Type":"ContainerStarted","Data":"dcfbea837f56451258e92f631bb5e69df939508c51c8493f57b3c97615eeaaf8"} Jun 07 16:27:48.671130 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.671105 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" event={"ID":"366f7f1f-876d-4799-a191-a51b1f0c4326","Type":"ContainerStarted","Data":"4f65c229f7dd68fc17588e9d90e45cb2af183e0eb481c0fa76d2eaf574096c17"} Jun 07 16:27:48.671267 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.671148 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" event={"ID":"366f7f1f-876d-4799-a191-a51b1f0c4326","Type":"ContainerStarted","Data":"e0e0c23c106e6046124c21e2ca0f99c4f53b6f1df62b6f73a3f7424fc279eac7"} Jun 07 16:27:48.671267 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.671170 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" event={"ID":"366f7f1f-876d-4799-a191-a51b1f0c4326","Type":"ContainerStarted","Data":"7221f62fdd02ea93f73ea5c9802bccc478224dfd09b3508105484c4f6d54038a"} Jun 07 16:27:48.672423 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.672403 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" event={"ID":"91e673ce-f8a9-4716-b4b5-861a743b9d20","Type":"ContainerStarted","Data":"e7c39309a97da524e1f8ee73d6b63174e3bf6c74189b66590607b528f040b392"} Jun 07 16:27:48.672549 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.672532 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:48.674015 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.673992 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" event={"ID":"caf11cda-dfc0-4e6b-8f55-171fbe319860","Type":"ContainerStarted","Data":"3ff810a52fcd52d310c9dcf5c7300c8a53d038be68a56f86dd4edc64fb2c54bb"} Jun 07 16:27:48.674517 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.674499 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:27:48.684949 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.684912 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-jc2wf" podStartSLOduration=2.879943559 podStartE2EDuration="11.684878142s" totalImagesPullingTime="8.804934583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:48.683725556 +0000 UTC m=+46.887598831" watchObservedRunningTime="2026-06-07 16:27:48.684878142 +0000 UTC m=+46.888751414" Jun 07 16:27:48.696697 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.696654 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" podStartSLOduration=30.865812348 podStartE2EDuration="39.696643089s" totalImagesPullingTime="8.830830741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:48.696528965 +0000 UTC m=+46.900402232" watchObservedRunningTime="2026-06-07 16:27:48.696643089 +0000 UTC m=+46.900516344" Jun 07 16:27:48.713417 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.713377 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" podStartSLOduration=30.910236491 podStartE2EDuration="39.713364674s" totalImagesPullingTime="8.803128183s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:48.712635315 +0000 UTC m=+46.916508592" watchObservedRunningTime="2026-06-07 16:27:48.713364674 +0000 UTC m=+46.917237947" Jun 07 16:27:48.726998 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:48.726960 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" podStartSLOduration=30.912120179 podStartE2EDuration="39.726948078s" totalImagesPullingTime="8.814827899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:27:48.726160531 +0000 UTC m=+46.930033806" watchObservedRunningTime="2026-06-07 16:27:48.726948078 +0000 UTC m=+46.930821372" Jun 07 16:27:53.033331 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:53.033295 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:27:53.033721 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:27:53.033348 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:27:53.033721 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:53.033460 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:27:53.033721 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:53.033463 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:27:53.033721 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:53.033527 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls podName:4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec nodeName:}" failed. No retries permitted until 2026-06-07 16:28:09.03351275 +0000 UTC m=+67.237386001 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls") pod "dns-default-d7k2w" (UID: "4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec") : secret "dns-default-metrics-tls" not found Jun 07 16:27:53.033721 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:53.033471 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67df8cdf5b-4b6rm: secret "image-registry-tls" not found Jun 07 16:27:53.033721 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:27:53.033602 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls podName:804be58c-3f9e-4ff7-8a1d-e19e10f57a59 nodeName:}" failed. No retries permitted until 2026-06-07 16:28:09.033590999 +0000 UTC m=+67.237464249 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls") pod "image-registry-67df8cdf5b-4b6rm" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59") : secret "image-registry-tls" not found Jun 07 16:28:03.606931 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:03.606903 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-95fkp" Jun 07 16:28:07.028126 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.028085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:28:07.030952 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.030934 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 16:28:07.042216 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.042193 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d1ae50c5-29b5-41aa-af9e-082fcf808170-original-pull-secret\") pod \"global-pull-secret-syncer-wrsz8\" (UID: \"d1ae50c5-29b5-41aa-af9e-082fcf808170\") " pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:28:07.129251 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.129209 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:28:07.131749 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.131732 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 16:28:07.139803 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:07.139788 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:28:07.139854 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:07.139849 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs podName:d12ea486-aafe-455d-9f01-565eabcf0ca0 nodeName:}" failed. No retries permitted until 2026-06-07 16:29:11.139834394 +0000 UTC m=+129.343707646 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs") pod "network-metrics-daemon-f4wl2" (UID: "d12ea486-aafe-455d-9f01-565eabcf0ca0") : secret "metrics-daemon-secret" not found Jun 07 16:28:07.230260 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.230227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p46q\" (UniqueName: \"kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q\") pod \"network-check-target-fmcbl\" (UID: \"07139989-b03c-4498-b73e-c9053c9769b4\") " pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:28:07.233351 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.233324 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 16:28:07.243480 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.243462 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 16:28:07.253808 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.253780 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p46q\" (UniqueName: \"kubernetes.io/projected/07139989-b03c-4498-b73e-c9053c9769b4-kube-api-access-9p46q\") pod \"network-check-target-fmcbl\" (UID: \"07139989-b03c-4498-b73e-c9053c9769b4\") " pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:28:07.299498 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.299437 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrsz8" Jun 07 16:28:07.402293 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.402268 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8469t\"" Jun 07 16:28:07.410266 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.410235 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:28:07.424018 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.423992 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wrsz8"] Jun 07 16:28:07.427704 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:28:07.427678 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ae50c5_29b5_41aa_af9e_082fcf808170.slice/crio-7bbdc0dd1d4c3ee929dbbc9ba7b21c31009a60e7263c06f6bd46d2b5c0be8e5d WatchSource:0}: Error finding container 7bbdc0dd1d4c3ee929dbbc9ba7b21c31009a60e7263c06f6bd46d2b5c0be8e5d: Status 404 returned error can't find the container with id 7bbdc0dd1d4c3ee929dbbc9ba7b21c31009a60e7263c06f6bd46d2b5c0be8e5d Jun 07 16:28:07.536360 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.536327 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fmcbl"] Jun 07 16:28:07.539879 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:28:07.539849 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07139989_b03c_4498_b73e_c9053c9769b4.slice/crio-bfcfb786888e5e05efcb851dd830472261aecdd308bae6a09930c679c616744a WatchSource:0}: Error finding container bfcfb786888e5e05efcb851dd830472261aecdd308bae6a09930c679c616744a: Status 404 returned error can't find the container with id bfcfb786888e5e05efcb851dd830472261aecdd308bae6a09930c679c616744a Jun 07 16:28:07.727123 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.727026 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wrsz8" event={"ID":"d1ae50c5-29b5-41aa-af9e-082fcf808170","Type":"ContainerStarted","Data":"7bbdc0dd1d4c3ee929dbbc9ba7b21c31009a60e7263c06f6bd46d2b5c0be8e5d"} Jun 07 16:28:07.728076 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:07.728049 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fmcbl" event={"ID":"07139989-b03c-4498-b73e-c9053c9769b4","Type":"ContainerStarted","Data":"bfcfb786888e5e05efcb851dd830472261aecdd308bae6a09930c679c616744a"} Jun 07 16:28:09.044605 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:09.044528 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:28:09.044605 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:09.044581 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:28:09.045199 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:09.044715 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:28:09.045199 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:09.044728 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:28:09.045199 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:09.044748 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67df8cdf5b-4b6rm: secret "image-registry-tls" not found Jun 07 16:28:09.045199 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:09.044811 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls podName:4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec nodeName:}" failed. No retries permitted until 2026-06-07 16:28:41.044786855 +0000 UTC m=+99.248660126 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls") pod "dns-default-d7k2w" (UID: "4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec") : secret "dns-default-metrics-tls" not found Jun 07 16:28:09.045199 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:09.044833 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls podName:804be58c-3f9e-4ff7-8a1d-e19e10f57a59 nodeName:}" failed. No retries permitted until 2026-06-07 16:28:41.044822359 +0000 UTC m=+99.248695614 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls") pod "image-registry-67df8cdf5b-4b6rm" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59") : secret "image-registry-tls" not found Jun 07 16:28:12.746347 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:12.746256 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wrsz8" event={"ID":"d1ae50c5-29b5-41aa-af9e-082fcf808170","Type":"ContainerStarted","Data":"7608d20efb6789f0647b118d953c695a85ce16194d2289f9a1b9c568c513816a"} Jun 07 16:28:12.747787 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:12.747750 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fmcbl" event={"ID":"07139989-b03c-4498-b73e-c9053c9769b4","Type":"ContainerStarted","Data":"ca7a6c71cf61687ca44edcd0b3c5d6ed7857092944a9bade3bcb93b543f79b1d"} Jun 07 16:28:12.747912 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:12.747896 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:28:12.763721 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:12.763674 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wrsz8" podStartSLOduration=65.877405085 podStartE2EDuration="1m10.763661293s" totalImagesPullingTime="4.886256208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:28:12.762998808 +0000 UTC m=+70.966872081" watchObservedRunningTime="2026-06-07 16:28:12.763661293 +0000 UTC m=+70.967534565" Jun 07 16:28:12.779280 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:12.779238 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fmcbl" podStartSLOduration=66.017305933 podStartE2EDuration="1m10.779225337s" totalImagesPullingTime="4.761919404s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:28:12.778274636 +0000 UTC m=+70.982147909" watchObservedRunningTime="2026-06-07 16:28:12.779225337 +0000 UTC m=+70.983098609" Jun 07 16:28:41.075227 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:41.075184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:28:41.075227 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:41.075229 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:28:41.075749 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:41.075322 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:28:41.075749 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:41.075342 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:28:41.075749 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:41.075356 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67df8cdf5b-4b6rm: secret "image-registry-tls" not found Jun 07 16:28:41.075749 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:41.075384 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls podName:4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec nodeName:}" failed. No retries permitted until 2026-06-07 16:29:45.075368091 +0000 UTC m=+163.279241341 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls") pod "dns-default-d7k2w" (UID: "4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec") : secret "dns-default-metrics-tls" not found Jun 07 16:28:41.075749 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:28:41.075417 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls podName:804be58c-3f9e-4ff7-8a1d-e19e10f57a59 nodeName:}" failed. No retries permitted until 2026-06-07 16:29:45.075399802 +0000 UTC m=+163.279273069 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls") pod "image-registry-67df8cdf5b-4b6rm" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59") : secret "image-registry-tls" not found Jun 07 16:28:43.753455 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:28:43.753420 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fmcbl" Jun 07 16:29:11.190479 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:11.190441 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:29:11.190974 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:29:11.190589 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 16:29:11.190974 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:29:11.190667 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs podName:d12ea486-aafe-455d-9f01-565eabcf0ca0 nodeName:}" failed. No retries permitted until 2026-06-07 16:31:13.190650372 +0000 UTC m=+251.394523622 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs") pod "network-metrics-daemon-f4wl2" (UID: "d12ea486-aafe-455d-9f01-565eabcf0ca0") : secret "metrics-daemon-secret" not found Jun 07 16:29:40.211567 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:29:40.211518 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" podUID="804be58c-3f9e-4ff7-8a1d-e19e10f57a59" Jun 07 16:29:40.231687 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:29:40.231656 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d7k2w" podUID="4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec" Jun 07 16:29:40.305569 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:29:40.305530 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-f4wl2" podUID="d12ea486-aafe-455d-9f01-565eabcf0ca0" Jun 07 16:29:41.011467 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:41.011438 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:29:41.011677 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:41.011480 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d7k2w" Jun 07 16:29:45.131778 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:45.131735 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:29:45.132211 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:45.131799 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:29:45.132211 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:29:45.131887 2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 16:29:45.132211 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:29:45.131932 2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 07 16:29:45.132211 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:29:45.131948 2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-67df8cdf5b-4b6rm: secret "image-registry-tls" not found Jun 07 16:29:45.132211 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:29:45.131963 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls podName:4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec nodeName:}" failed. No retries permitted until 2026-06-07 16:31:47.131940532 +0000 UTC m=+285.335813782 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls") pod "dns-default-d7k2w" (UID: "4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec") : secret "dns-default-metrics-tls" not found Jun 07 16:29:45.132211 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:29:45.131995 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls podName:804be58c-3f9e-4ff7-8a1d-e19e10f57a59 nodeName:}" failed. No retries permitted until 2026-06-07 16:31:47.131979777 +0000 UTC m=+285.335853028 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls") pod "image-registry-67df8cdf5b-4b6rm" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59") : secret "image-registry-tls" not found Jun 07 16:29:48.033741 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:48.033703 2565 generic.go:356] "Generic (PLEG): container finished" podID="91e673ce-f8a9-4716-b4b5-861a743b9d20" containerID="e7c39309a97da524e1f8ee73d6b63174e3bf6c74189b66590607b528f040b392" exitCode=1 Jun 07 16:29:48.034211 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:48.033785 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" event={"ID":"91e673ce-f8a9-4716-b4b5-861a743b9d20","Type":"ContainerDied","Data":"e7c39309a97da524e1f8ee73d6b63174e3bf6c74189b66590607b528f040b392"} Jun 07 16:29:48.034211 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:48.034196 2565 scope.go:117] "RemoveContainer" containerID="e7c39309a97da524e1f8ee73d6b63174e3bf6c74189b66590607b528f040b392" Jun 07 16:29:48.035325 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:48.035296 2565 generic.go:356] "Generic (PLEG): container finished" podID="caf11cda-dfc0-4e6b-8f55-171fbe319860" containerID="3ff810a52fcd52d310c9dcf5c7300c8a53d038be68a56f86dd4edc64fb2c54bb" exitCode=255 Jun 07 16:29:48.035438 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:48.035350 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" event={"ID":"caf11cda-dfc0-4e6b-8f55-171fbe319860","Type":"ContainerDied","Data":"3ff810a52fcd52d310c9dcf5c7300c8a53d038be68a56f86dd4edc64fb2c54bb"} Jun 07 16:29:48.035608 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:48.035596 2565 scope.go:117] "RemoveContainer" containerID="3ff810a52fcd52d310c9dcf5c7300c8a53d038be68a56f86dd4edc64fb2c54bb" Jun 07 16:29:48.672988 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:48.672950 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:29:49.040090 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:49.040058 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" event={"ID":"91e673ce-f8a9-4716-b4b5-861a743b9d20","Type":"ContainerStarted","Data":"16292cabf30c2044abd0311dcc0384fcfc9ef338436c623756b36b59a6af12d5"} Jun 07 16:29:49.040536 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:49.040215 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:29:49.040880 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:49.040860 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:29:49.041838 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:49.041819 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" event={"ID":"caf11cda-dfc0-4e6b-8f55-171fbe319860","Type":"ContainerStarted","Data":"ed992b0d8b52dace7f9bce97adbbb836cf23dbae1ee235a885c1aac4e7f24f6e"} Jun 07 16:29:53.289214 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:29:53.289128 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:30:32.419920 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:32.419888 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6kgd_d1ca383f-3d23-47a0-9d10-5203404b496a/dns-node-resolver/0.log" Jun 07 16:30:33.220069 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:33.220042 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mj69l_2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e/node-ca/0.log" Jun 07 16:30:34.020268 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:34.020242 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jc2wf_ad0e2266-63fa-4b2b-9891-1af906de0c51/serve-healthcheck-canary/0.log" Jun 07 16:30:53.515796 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.515747 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-8v9jb"] Jun 07 16:30:53.518804 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.518783 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.522090 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.522064 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 07 16:30:53.523297 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.523281 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 07 16:30:53.523394 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.523307 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 07 16:30:53.523394 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.523311 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4dd7s\"" Jun 07 16:30:53.523512 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.523502 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 07 16:30:53.535322 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.535297 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8v9jb"] Jun 07 16:30:53.613230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.613198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51e560dd-6bb4-4901-95db-370271187796-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.613230 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.613232 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx725\" (UniqueName: \"kubernetes.io/projected/51e560dd-6bb4-4901-95db-370271187796-kube-api-access-jx725\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.613403 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.613257 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51e560dd-6bb4-4901-95db-370271187796-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.613403 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.613389 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51e560dd-6bb4-4901-95db-370271187796-data-volume\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.613480 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.613428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51e560dd-6bb4-4901-95db-370271187796-crio-socket\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.714187 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.714153 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51e560dd-6bb4-4901-95db-370271187796-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.714187 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.714185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx725\" (UniqueName: \"kubernetes.io/projected/51e560dd-6bb4-4901-95db-370271187796-kube-api-access-jx725\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.714401 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.714202 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51e560dd-6bb4-4901-95db-370271187796-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.714401 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.714263 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51e560dd-6bb4-4901-95db-370271187796-data-volume\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.714401 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.714288 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51e560dd-6bb4-4901-95db-370271187796-crio-socket\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.714401 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.714373 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/51e560dd-6bb4-4901-95db-370271187796-crio-socket\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.714619 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.714594 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/51e560dd-6bb4-4901-95db-370271187796-data-volume\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.714824 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.714809 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/51e560dd-6bb4-4901-95db-370271187796-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.716544 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.716526 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/51e560dd-6bb4-4901-95db-370271187796-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.722286 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.722266 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx725\" (UniqueName: \"kubernetes.io/projected/51e560dd-6bb4-4901-95db-370271187796-kube-api-access-jx725\") pod \"insights-runtime-extractor-8v9jb\" (UID: \"51e560dd-6bb4-4901-95db-370271187796\") " pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.827647 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.827586 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-8v9jb" Jun 07 16:30:53.948909 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:53.948733 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-8v9jb"] Jun 07 16:30:53.951351 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:30:53.951328 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e560dd_6bb4_4901_95db_370271187796.slice/crio-eac4fc96fa247dea9719a796870fb34e56e9151675bee7e3973613c66dafd662 WatchSource:0}: Error finding container eac4fc96fa247dea9719a796870fb34e56e9151675bee7e3973613c66dafd662: Status 404 returned error can't find the container with id eac4fc96fa247dea9719a796870fb34e56e9151675bee7e3973613c66dafd662 Jun 07 16:30:54.225526 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:54.225455 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8v9jb" event={"ID":"51e560dd-6bb4-4901-95db-370271187796","Type":"ContainerStarted","Data":"2535438b6c6a4c7d349ed24226a2d5b818ae432de970928be66918118d68b8c7"} Jun 07 16:30:54.225526 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:54.225512 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8v9jb" event={"ID":"51e560dd-6bb4-4901-95db-370271187796","Type":"ContainerStarted","Data":"eac4fc96fa247dea9719a796870fb34e56e9151675bee7e3973613c66dafd662"} Jun 07 16:30:55.230658 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:55.230620 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8v9jb" event={"ID":"51e560dd-6bb4-4901-95db-370271187796","Type":"ContainerStarted","Data":"b4e10b199c117ec073e5426252d6e272b7adec2e101519beb8e89ea6a5fd3d08"} Jun 07 16:30:56.235102 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:56.235076 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-8v9jb" event={"ID":"51e560dd-6bb4-4901-95db-370271187796","Type":"ContainerStarted","Data":"5c8f84e5dfc451fc2c29adb562809bd770af129ed0d80ba3768b307748f11aa0"} Jun 07 16:30:56.250396 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:30:56.250350 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-8v9jb" podStartSLOduration=1.139143104 podStartE2EDuration="3.250336s" totalImagesPullingTime="2.111192896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:30:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:30:56.249942216 +0000 UTC m=+234.453815486" watchObservedRunningTime="2026-06-07 16:30:56.250336 +0000 UTC m=+234.454209273" Jun 07 16:31:08.496077 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.496032 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-58pgg"] Jun 07 16:31:08.499288 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.499268 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.501918 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.501896 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 07 16:31:08.502045 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.501938 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 07 16:31:08.502408 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.502385 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 07 16:31:08.502510 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.502391 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 07 16:31:08.503072 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.503052 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 07 16:31:08.503150 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.503077 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 07 16:31:08.503333 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.503319 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wsm7l\"" Jun 07 16:31:08.618507 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.618472 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1215740a-c6c9-442e-b74b-9be1f4109551-metrics-client-ca\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.618667 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.618517 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-accelerators-collector-config\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.618667 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.618569 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1215740a-c6c9-442e-b74b-9be1f4109551-root\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.618667 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.618608 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgtdl\" (UniqueName: \"kubernetes.io/projected/1215740a-c6c9-442e-b74b-9be1f4109551-kube-api-access-mgtdl\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.618863 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.618674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-wtmp\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.618863 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.618699 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-textfile\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.618863 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.618734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-tls\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.618863 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.618812 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.618863 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.618840 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1215740a-c6c9-442e-b74b-9be1f4109551-sys\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720131 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720099 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgtdl\" (UniqueName: \"kubernetes.io/projected/1215740a-c6c9-442e-b74b-9be1f4109551-kube-api-access-mgtdl\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720305 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720182 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-wtmp\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720305 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-textfile\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720305 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-tls\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720469 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720469 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720443 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1215740a-c6c9-442e-b74b-9be1f4109551-sys\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720469 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720394 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-wtmp\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720610 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720504 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1215740a-c6c9-442e-b74b-9be1f4109551-sys\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720610 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:31:08.720508 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 07 16:31:08.720610 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720567 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-textfile\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720610 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720505 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1215740a-c6c9-442e-b74b-9be1f4109551-metrics-client-ca\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720610 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:31:08.720589 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-tls podName:1215740a-c6c9-442e-b74b-9be1f4109551 nodeName:}" failed. No retries permitted until 2026-06-07 16:31:09.2205658 +0000 UTC m=+247.424439051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-tls") pod "node-exporter-58pgg" (UID: "1215740a-c6c9-442e-b74b-9be1f4109551") : secret "node-exporter-tls" not found Jun 07 16:31:08.720846 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720665 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-accelerators-collector-config\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720846 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1215740a-c6c9-442e-b74b-9be1f4109551-root\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.720846 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.720807 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1215740a-c6c9-442e-b74b-9be1f4109551-root\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.721044 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.721022 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1215740a-c6c9-442e-b74b-9be1f4109551-metrics-client-ca\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.721205 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.721183 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-accelerators-collector-config\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.722901 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.722879 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:08.730852 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:08.730824 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgtdl\" (UniqueName: \"kubernetes.io/projected/1215740a-c6c9-442e-b74b-9be1f4109551-kube-api-access-mgtdl\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:09.224899 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:09.224862 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-tls\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:09.227268 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:09.227247 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1215740a-c6c9-442e-b74b-9be1f4109551-node-exporter-tls\") pod \"node-exporter-58pgg\" (UID: \"1215740a-c6c9-442e-b74b-9be1f4109551\") " pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:09.408794 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:09.408749 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-58pgg" Jun 07 16:31:09.418641 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:31:09.418616 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1215740a_c6c9_442e_b74b_9be1f4109551.slice/crio-5f1c63919a3fc69a48a0f1c021a95f8684effd9fcf4ee940f9a5d12071e56f09 WatchSource:0}: Error finding container 5f1c63919a3fc69a48a0f1c021a95f8684effd9fcf4ee940f9a5d12071e56f09: Status 404 returned error can't find the container with id 5f1c63919a3fc69a48a0f1c021a95f8684effd9fcf4ee940f9a5d12071e56f09 Jun 07 16:31:10.277212 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:10.277188 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-58pgg" event={"ID":"1215740a-c6c9-442e-b74b-9be1f4109551","Type":"ContainerStarted","Data":"68cc8a1c579a8c8eda56e74f71a97c4118c7d0e08d341bd7fc7f02a3ef9f1b42"} Jun 07 16:31:10.277581 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:10.277289 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-58pgg" event={"ID":"1215740a-c6c9-442e-b74b-9be1f4109551","Type":"ContainerStarted","Data":"5f1c63919a3fc69a48a0f1c021a95f8684effd9fcf4ee940f9a5d12071e56f09"} Jun 07 16:31:11.281185 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:11.281151 2565 generic.go:356] "Generic (PLEG): container finished" podID="1215740a-c6c9-442e-b74b-9be1f4109551" containerID="68cc8a1c579a8c8eda56e74f71a97c4118c7d0e08d341bd7fc7f02a3ef9f1b42" exitCode=0 Jun 07 16:31:11.281575 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:11.281196 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-58pgg" event={"ID":"1215740a-c6c9-442e-b74b-9be1f4109551","Type":"ContainerDied","Data":"68cc8a1c579a8c8eda56e74f71a97c4118c7d0e08d341bd7fc7f02a3ef9f1b42"} Jun 07 16:31:12.286554 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:12.286518 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-58pgg" event={"ID":"1215740a-c6c9-442e-b74b-9be1f4109551","Type":"ContainerStarted","Data":"4447fe8de4f936dc268f9835e6c69f7260a15992c372f2c7053aa65b7a5bdffb"} Jun 07 16:31:12.286947 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:12.286584 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-58pgg" event={"ID":"1215740a-c6c9-442e-b74b-9be1f4109551","Type":"ContainerStarted","Data":"bf01967468a7987d6cdcc20b147d06bd2161d70c557f742f574725efd1afad8a"} Jun 07 16:31:12.306328 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:12.306285 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-58pgg" podStartSLOduration=3.440182945 podStartE2EDuration="4.306271648s" totalImagesPullingTime="792.477016ms" totalInitContainerRuntime="73.611687ms" isStatefulPod=true podCreationTimestamp="2026-06-07 16:31:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:12.305796201 +0000 UTC m=+250.509669474" watchObservedRunningTime="2026-06-07 16:31:12.306271648 +0000 UTC m=+250.510144921" Jun 07 16:31:13.256266 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:13.256215 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:31:13.258749 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:13.258725 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d12ea486-aafe-455d-9f01-565eabcf0ca0-metrics-certs\") pod \"network-metrics-daemon-f4wl2\" (UID: \"d12ea486-aafe-455d-9f01-565eabcf0ca0\") " pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:31:13.392799 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:13.392747 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6ng2d\"" Jun 07 16:31:13.401388 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:13.401365 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-f4wl2" Jun 07 16:31:13.525310 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:13.525110 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-f4wl2"] Jun 07 16:31:13.527639 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:31:13.527613 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd12ea486_aafe_455d_9f01_565eabcf0ca0.slice/crio-2a01a90834ca3072d734579988196d0c1c24495a7465b795949b8fa099901d0f WatchSource:0}: Error finding container 2a01a90834ca3072d734579988196d0c1c24495a7465b795949b8fa099901d0f: Status 404 returned error can't find the container with id 2a01a90834ca3072d734579988196d0c1c24495a7465b795949b8fa099901d0f Jun 07 16:31:14.294446 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:14.294408 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f4wl2" event={"ID":"d12ea486-aafe-455d-9f01-565eabcf0ca0","Type":"ContainerStarted","Data":"2a01a90834ca3072d734579988196d0c1c24495a7465b795949b8fa099901d0f"} Jun 07 16:31:15.299430 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:15.299396 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f4wl2" event={"ID":"d12ea486-aafe-455d-9f01-565eabcf0ca0","Type":"ContainerStarted","Data":"3ee8428289d646d5982646b5793025a29d10a8f930ff69c1e40f9c72ee352958"} Jun 07 16:31:15.299850 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:15.299445 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-f4wl2" event={"ID":"d12ea486-aafe-455d-9f01-565eabcf0ca0","Type":"ContainerStarted","Data":"73039a29936f7d3a872f54c14246823311c9b24f9f9bd3dcf1e9270b9680d5bb"} Jun 07 16:31:15.314722 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:15.314673 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-f4wl2" podStartSLOduration=252.20604789 podStartE2EDuration="4m13.314658646s" totalImagesPullingTime="1.108610756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:15.314124359 +0000 UTC m=+253.517997634" watchObservedRunningTime="2026-06-07 16:31:15.314658646 +0000 UTC m=+253.518531919" Jun 07 16:31:37.497873 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:37.497811 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" podUID="366f7f1f-876d-4799-a191-a51b1f0c4326" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 16:31:44.012538 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:31:44.012487 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" podUID="804be58c-3f9e-4ff7-8a1d-e19e10f57a59" Jun 07 16:31:44.012964 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:31:44.012538 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-d7k2w" podUID="4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec" Jun 07 16:31:44.382142 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:44.382057 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d7k2w" Jun 07 16:31:44.382286 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:44.382057 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:31:47.209670 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:47.209630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:31:47.209670 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:47.209671 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:31:47.212127 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:47.212093 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec-metrics-tls\") pod \"dns-default-d7k2w\" (UID: \"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec\") " pod="openshift-dns/dns-default-d7k2w" Jun 07 16:31:47.212388 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:47.212366 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"image-registry-67df8cdf5b-4b6rm\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:31:47.386631 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:47.386597 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8v6gq\"" Jun 07 16:31:47.386837 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:47.386606 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bl7z8\"" Jun 07 16:31:47.394287 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:47.394268 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:31:47.394287 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:47.394279 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-d7k2w" Jun 07 16:31:47.497661 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:47.497625 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" podUID="366f7f1f-876d-4799-a191-a51b1f0c4326" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 16:31:47.538043 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:47.538014 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-d7k2w"] Jun 07 16:31:47.540857 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:31:47.540829 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc5a9ae_9c6c_441d_bb79_34d4a9f1f3ec.slice/crio-01a1c0f3592a8969c0c3d44d4a7e108eb1d4e7f9042f572db8fa0643a1d9b041 WatchSource:0}: Error finding container 01a1c0f3592a8969c0c3d44d4a7e108eb1d4e7f9042f572db8fa0643a1d9b041: Status 404 returned error can't find the container with id 01a1c0f3592a8969c0c3d44d4a7e108eb1d4e7f9042f572db8fa0643a1d9b041 Jun 07 16:31:47.554603 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:47.554578 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67df8cdf5b-4b6rm"] Jun 07 16:31:47.557859 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:31:47.557834 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod804be58c_3f9e_4ff7_8a1d_e19e10f57a59.slice/crio-a174450a45f3de700205160e4a4b9bfc7f4f1b7bc2d438b1b5dbab589636e1eb WatchSource:0}: Error finding container a174450a45f3de700205160e4a4b9bfc7f4f1b7bc2d438b1b5dbab589636e1eb: Status 404 returned error can't find the container with id a174450a45f3de700205160e4a4b9bfc7f4f1b7bc2d438b1b5dbab589636e1eb Jun 07 16:31:48.397587 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.397548 2565 generic.go:356] "Generic (PLEG): container finished" podID="91e673ce-f8a9-4716-b4b5-861a743b9d20" containerID="16292cabf30c2044abd0311dcc0384fcfc9ef338436c623756b36b59a6af12d5" exitCode=1 Jun 07 16:31:48.398081 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.397627 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" event={"ID":"91e673ce-f8a9-4716-b4b5-861a743b9d20","Type":"ContainerDied","Data":"16292cabf30c2044abd0311dcc0384fcfc9ef338436c623756b36b59a6af12d5"} Jun 07 16:31:48.398081 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.397723 2565 scope.go:117] "RemoveContainer" containerID="e7c39309a97da524e1f8ee73d6b63174e3bf6c74189b66590607b528f040b392" Jun 07 16:31:48.398081 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.398071 2565 scope.go:117] "RemoveContainer" containerID="16292cabf30c2044abd0311dcc0384fcfc9ef338436c623756b36b59a6af12d5" Jun 07 16:31:48.398297 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:31:48.398270 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-959d95d-vld9h_open-cluster-management-agent-addon(91e673ce-f8a9-4716-b4b5-861a743b9d20)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" podUID="91e673ce-f8a9-4716-b4b5-861a743b9d20" Jun 07 16:31:48.399340 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.399284 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7k2w" event={"ID":"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec","Type":"ContainerStarted","Data":"01a1c0f3592a8969c0c3d44d4a7e108eb1d4e7f9042f572db8fa0643a1d9b041"} Jun 07 16:31:48.401033 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.400977 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" event={"ID":"804be58c-3f9e-4ff7-8a1d-e19e10f57a59","Type":"ContainerStarted","Data":"a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2"} Jun 07 16:31:48.401033 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.401024 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" event={"ID":"804be58c-3f9e-4ff7-8a1d-e19e10f57a59","Type":"ContainerStarted","Data":"a174450a45f3de700205160e4a4b9bfc7f4f1b7bc2d438b1b5dbab589636e1eb"} Jun 07 16:31:48.401180 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.401054 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:31:48.403547 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.403522 2565 generic.go:356] "Generic (PLEG): container finished" podID="caf11cda-dfc0-4e6b-8f55-171fbe319860" containerID="ed992b0d8b52dace7f9bce97adbbb836cf23dbae1ee235a885c1aac4e7f24f6e" exitCode=255 Jun 07 16:31:48.403664 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.403592 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" event={"ID":"caf11cda-dfc0-4e6b-8f55-171fbe319860","Type":"ContainerDied","Data":"ed992b0d8b52dace7f9bce97adbbb836cf23dbae1ee235a885c1aac4e7f24f6e"} Jun 07 16:31:48.403909 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.403893 2565 scope.go:117] "RemoveContainer" containerID="ed992b0d8b52dace7f9bce97adbbb836cf23dbae1ee235a885c1aac4e7f24f6e" Jun 07 16:31:48.404060 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:31:48.404040 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-585645458d-ndcz6_open-cluster-management-agent-addon(caf11cda-dfc0-4e6b-8f55-171fbe319860)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" podUID="caf11cda-dfc0-4e6b-8f55-171fbe319860" Jun 07 16:31:48.409992 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.409906 2565 scope.go:117] "RemoveContainer" containerID="3ff810a52fcd52d310c9dcf5c7300c8a53d038be68a56f86dd4edc64fb2c54bb" Jun 07 16:31:48.432623 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:48.432581 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" podStartSLOduration=286.432566424 podStartE2EDuration="4m46.432566424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:48.431641342 +0000 UTC m=+286.635514614" watchObservedRunningTime="2026-06-07 16:31:48.432566424 +0000 UTC m=+286.636439732" Jun 07 16:31:49.040421 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:49.040394 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:31:49.408511 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:49.408485 2565 scope.go:117] "RemoveContainer" containerID="16292cabf30c2044abd0311dcc0384fcfc9ef338436c623756b36b59a6af12d5" Jun 07 16:31:49.408934 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:31:49.408655 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-959d95d-vld9h_open-cluster-management-agent-addon(91e673ce-f8a9-4716-b4b5-861a743b9d20)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" podUID="91e673ce-f8a9-4716-b4b5-861a743b9d20" Jun 07 16:31:49.410013 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:49.409990 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7k2w" event={"ID":"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec","Type":"ContainerStarted","Data":"529b1d4f204028197ff2f16e134e5f3c7d066ecfd29d8090257603c6e1390769"} Jun 07 16:31:49.410123 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:49.410032 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-d7k2w" event={"ID":"4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec","Type":"ContainerStarted","Data":"9d2d3aaaf648a1a5115a7473a99a701c09eadf01dee3e8d8cf01a0e3fcedb0bd"} Jun 07 16:31:49.410123 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:49.410059 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-d7k2w" Jun 07 16:31:49.440777 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:49.440709 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-d7k2w" podStartSLOduration=250.999113673 podStartE2EDuration="4m12.440694865s" totalImagesPullingTime="1.441581192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:27:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:31:49.439935767 +0000 UTC m=+287.643809042" watchObservedRunningTime="2026-06-07 16:31:49.440694865 +0000 UTC m=+287.644568138" Jun 07 16:31:57.474889 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:57.474845 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:31:57.475282 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:57.475233 2565 scope.go:117] "RemoveContainer" containerID="16292cabf30c2044abd0311dcc0384fcfc9ef338436c623756b36b59a6af12d5" Jun 07 16:31:57.475395 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:31:57.475375 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-959d95d-vld9h_open-cluster-management-agent-addon(91e673ce-f8a9-4716-b4b5-861a743b9d20)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" podUID="91e673ce-f8a9-4716-b4b5-861a743b9d20" Jun 07 16:31:57.497570 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:57.497533 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" podUID="366f7f1f-876d-4799-a191-a51b1f0c4326" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 07 16:31:57.497700 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:57.497604 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" Jun 07 16:31:57.498096 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:57.498064 2565 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"4f65c229f7dd68fc17588e9d90e45cb2af183e0eb481c0fa76d2eaf574096c17"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 07 16:31:57.498135 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:57.498118 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" podUID="366f7f1f-876d-4799-a191-a51b1f0c4326" containerName="service-proxy" containerID="cri-o://4f65c229f7dd68fc17588e9d90e45cb2af183e0eb481c0fa76d2eaf574096c17" gracePeriod=30 Jun 07 16:31:57.504731 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:57.504708 2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" Jun 07 16:31:57.505028 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:57.505016 2565 scope.go:117] "RemoveContainer" containerID="ed992b0d8b52dace7f9bce97adbbb836cf23dbae1ee235a885c1aac4e7f24f6e" Jun 07 16:31:57.505184 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:31:57.505166 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-585645458d-ndcz6_open-cluster-management-agent-addon(caf11cda-dfc0-4e6b-8f55-171fbe319860)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" podUID="caf11cda-dfc0-4e6b-8f55-171fbe319860" Jun 07 16:31:58.447834 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:58.447796 2565 generic.go:356] "Generic (PLEG): container finished" podID="366f7f1f-876d-4799-a191-a51b1f0c4326" containerID="4f65c229f7dd68fc17588e9d90e45cb2af183e0eb481c0fa76d2eaf574096c17" exitCode=2 Jun 07 16:31:58.448004 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:58.447867 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" event={"ID":"366f7f1f-876d-4799-a191-a51b1f0c4326","Type":"ContainerDied","Data":"4f65c229f7dd68fc17588e9d90e45cb2af183e0eb481c0fa76d2eaf574096c17"} Jun 07 16:31:58.448004 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:58.447913 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6ff4f6946d-rqhhb" event={"ID":"366f7f1f-876d-4799-a191-a51b1f0c4326","Type":"ContainerStarted","Data":"7626fbed1cde91f616b8f53a7c225cf1b87f824498936a248943cf6ff6c433cc"} Jun 07 16:31:59.417804 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:59.417747 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-d7k2w" Jun 07 16:31:59.893256 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:31:59.893229 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-58pgg_1215740a-c6c9-442e-b74b-9be1f4109551/init-textfile/0.log" Jun 07 16:32:00.094654 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:00.094626 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-58pgg_1215740a-c6c9-442e-b74b-9be1f4109551/node-exporter/0.log" Jun 07 16:32:00.293005 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:00.292977 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-58pgg_1215740a-c6c9-442e-b74b-9be1f4109551/kube-rbac-proxy/0.log" Jun 07 16:32:02.228237 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:02.228207 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:32:02.230486 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:02.230460 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:32:02.234700 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:02.234290 2565 kubelet.go:1648] "Image garbage collection succeeded" Jun 07 16:32:07.093655 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:07.093620 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d7k2w_4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec/dns/0.log" Jun 07 16:32:07.293591 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:07.293559 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d7k2w_4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec/kube-rbac-proxy/0.log" Jun 07 16:32:07.398446 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:07.398362 2565 patch_prober.go:28] interesting pod/image-registry-67df8cdf5b-4b6rm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 07 16:32:07.398446 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:07.398410 2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" podUID="804be58c-3f9e-4ff7-8a1d-e19e10f57a59" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:32:08.292405 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:08.292376 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6kgd_d1ca383f-3d23-47a0-9d10-5203404b496a/dns-node-resolver/0.log" Jun 07 16:32:08.493320 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:08.493293 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67df8cdf5b-4b6rm_804be58c-3f9e-4ff7-8a1d-e19e10f57a59/registry/0.log" Jun 07 16:32:09.092782 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:09.092725 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mj69l_2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e/node-ca/0.log" Jun 07 16:32:09.289920 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:09.289888 2565 scope.go:117] "RemoveContainer" containerID="ed992b0d8b52dace7f9bce97adbbb836cf23dbae1ee235a885c1aac4e7f24f6e" Jun 07 16:32:09.415504 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:09.415471 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:32:09.486182 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:09.486144 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-585645458d-ndcz6" event={"ID":"caf11cda-dfc0-4e6b-8f55-171fbe319860","Type":"ContainerStarted","Data":"7ca08ad40cd427c222ba6426bea93515b3e4ac2a8f008be3e0970dd72895f114"} Jun 07 16:32:09.894017 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:09.893979 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jc2wf_ad0e2266-63fa-4b2b-9891-1af906de0c51/serve-healthcheck-canary/0.log" Jun 07 16:32:11.289411 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:11.289377 2565 scope.go:117] "RemoveContainer" containerID="16292cabf30c2044abd0311dcc0384fcfc9ef338436c623756b36b59a6af12d5" Jun 07 16:32:11.495097 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:11.495064 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" event={"ID":"91e673ce-f8a9-4716-b4b5-861a743b9d20","Type":"ContainerStarted","Data":"a4893c5104279779d8da14f3e5e51f6fa55f4b2015d69544f72cc88d50bad875"} Jun 07 16:32:11.495486 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:11.495435 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:32:11.497137 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:11.497115 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-959d95d-vld9h" Jun 07 16:32:21.580878 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:21.580848 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67df8cdf5b-4b6rm"] Jun 07 16:32:46.601084 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:46.601024 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" podUID="804be58c-3f9e-4ff7-8a1d-e19e10f57a59" containerName="registry" containerID="cri-o://a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2" gracePeriod=30 Jun 07 16:32:47.839090 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.839065 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:32:47.936924 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.936840 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-certificates\") pod \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " Jun 07 16:32:47.936924 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.936884 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") pod \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " Jun 07 16:32:47.936924 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.936908 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5vl8\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-kube-api-access-z5vl8\") pod \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " Jun 07 16:32:47.937172 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.936943 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-bound-sa-token\") pod \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " Jun 07 16:32:47.937172 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.937003 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-installation-pull-secrets\") pod \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " Jun 07 16:32:47.937172 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.937043 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-image-registry-private-configuration\") pod \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " Jun 07 16:32:47.937172 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.937067 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-ca-trust-extracted\") pod \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " Jun 07 16:32:47.937172 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.937094 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-trusted-ca\") pod \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\" (UID: \"804be58c-3f9e-4ff7-8a1d-e19e10f57a59\") " Jun 07 16:32:47.937683 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.937293 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "804be58c-3f9e-4ff7-8a1d-e19e10f57a59" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:32:47.937683 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.937623 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "804be58c-3f9e-4ff7-8a1d-e19e10f57a59" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:32:47.939629 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.939574 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "804be58c-3f9e-4ff7-8a1d-e19e10f57a59" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:32:47.939752 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.939630 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "804be58c-3f9e-4ff7-8a1d-e19e10f57a59" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:32:47.939752 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.939636 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "804be58c-3f9e-4ff7-8a1d-e19e10f57a59" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 16:32:47.939899 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.939802 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "804be58c-3f9e-4ff7-8a1d-e19e10f57a59" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:32:47.939953 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.939914 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-kube-api-access-z5vl8" (OuterVolumeSpecName: "kube-api-access-z5vl8") pod "804be58c-3f9e-4ff7-8a1d-e19e10f57a59" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59"). InnerVolumeSpecName "kube-api-access-z5vl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:32:47.946191 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:47.946162 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "804be58c-3f9e-4ff7-8a1d-e19e10f57a59" (UID: "804be58c-3f9e-4ff7-8a1d-e19e10f57a59"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 16:32:48.038036 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.038000 2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-installation-pull-secrets\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:32:48.038036 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.038031 2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-image-registry-private-configuration\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:32:48.038036 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.038041 2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-ca-trust-extracted\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:32:48.038248 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.038051 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-trusted-ca\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:32:48.038248 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.038059 2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-certificates\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:32:48.038248 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.038067 2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-registry-tls\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:32:48.038248 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.038075 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5vl8\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-kube-api-access-z5vl8\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:32:48.038248 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.038083 2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/804be58c-3f9e-4ff7-8a1d-e19e10f57a59-bound-sa-token\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:32:48.621473 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.621368 2565 generic.go:356] "Generic (PLEG): container finished" podID="804be58c-3f9e-4ff7-8a1d-e19e10f57a59" containerID="a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2" exitCode=0 Jun 07 16:32:48.621473 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.621420 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" Jun 07 16:32:48.621699 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.621464 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" event={"ID":"804be58c-3f9e-4ff7-8a1d-e19e10f57a59","Type":"ContainerDied","Data":"a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2"} Jun 07 16:32:48.621699 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.621516 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67df8cdf5b-4b6rm" event={"ID":"804be58c-3f9e-4ff7-8a1d-e19e10f57a59","Type":"ContainerDied","Data":"a174450a45f3de700205160e4a4b9bfc7f4f1b7bc2d438b1b5dbab589636e1eb"} Jun 07 16:32:48.621699 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.621539 2565 scope.go:117] "RemoveContainer" containerID="a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2" Jun 07 16:32:48.629405 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.629386 2565 scope.go:117] "RemoveContainer" containerID="a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2" Jun 07 16:32:48.629698 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:32:48.629676 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2\": container with ID starting with a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2 not found: ID does not exist" containerID="a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2" Jun 07 16:32:48.629751 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.629705 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2"} err="failed to get container status \"a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2\": rpc error: code = NotFound desc = could not find container \"a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2\": container with ID starting with a1944381c5a8020825533adb8c3297d26342a52ca2cb663f2060685bd6458ba2 not found: ID does not exist" Jun 07 16:32:48.638931 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.638905 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-67df8cdf5b-4b6rm"] Jun 07 16:32:48.641870 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:48.641852 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-67df8cdf5b-4b6rm"] Jun 07 16:32:50.293329 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:32:50.293251 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="804be58c-3f9e-4ff7-8a1d-e19e10f57a59" path="/var/lib/kubelet/pods/804be58c-3f9e-4ff7-8a1d-e19e10f57a59/volumes" Jun 07 16:34:23.802890 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.802810 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-64w2r"] Jun 07 16:34:23.803323 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.803025 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="804be58c-3f9e-4ff7-8a1d-e19e10f57a59" containerName="registry" Jun 07 16:34:23.803323 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.803036 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="804be58c-3f9e-4ff7-8a1d-e19e10f57a59" containerName="registry" Jun 07 16:34:23.803323 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.803080 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="804be58c-3f9e-4ff7-8a1d-e19e10f57a59" containerName="registry" Jun 07 16:34:23.805736 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.805720 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-64w2r" Jun 07 16:34:23.808454 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.808426 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 07 16:34:23.808593 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.808425 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 07 16:34:23.809506 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.809491 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tkznk\"" Jun 07 16:34:23.814596 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.814576 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-64w2r"] Jun 07 16:34:23.873407 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.873377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b5lm\" (UniqueName: \"kubernetes.io/projected/30626b2c-2995-42a9-b610-639ad4439898-kube-api-access-4b5lm\") pod \"cert-manager-59c77684cc-64w2r\" (UID: \"30626b2c-2995-42a9-b610-639ad4439898\") " pod="cert-manager/cert-manager-59c77684cc-64w2r" Jun 07 16:34:23.873552 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.873415 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30626b2c-2995-42a9-b610-639ad4439898-bound-sa-token\") pod \"cert-manager-59c77684cc-64w2r\" (UID: \"30626b2c-2995-42a9-b610-639ad4439898\") " pod="cert-manager/cert-manager-59c77684cc-64w2r" Jun 07 16:34:23.974045 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.974015 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b5lm\" (UniqueName: \"kubernetes.io/projected/30626b2c-2995-42a9-b610-639ad4439898-kube-api-access-4b5lm\") pod \"cert-manager-59c77684cc-64w2r\" (UID: \"30626b2c-2995-42a9-b610-639ad4439898\") " pod="cert-manager/cert-manager-59c77684cc-64w2r" Jun 07 16:34:23.974176 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.974054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30626b2c-2995-42a9-b610-639ad4439898-bound-sa-token\") pod \"cert-manager-59c77684cc-64w2r\" (UID: \"30626b2c-2995-42a9-b610-639ad4439898\") " pod="cert-manager/cert-manager-59c77684cc-64w2r" Jun 07 16:34:23.982838 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.982811 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/30626b2c-2995-42a9-b610-639ad4439898-bound-sa-token\") pod \"cert-manager-59c77684cc-64w2r\" (UID: \"30626b2c-2995-42a9-b610-639ad4439898\") " pod="cert-manager/cert-manager-59c77684cc-64w2r" Jun 07 16:34:23.983008 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:23.982986 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b5lm\" (UniqueName: \"kubernetes.io/projected/30626b2c-2995-42a9-b610-639ad4439898-kube-api-access-4b5lm\") pod \"cert-manager-59c77684cc-64w2r\" (UID: \"30626b2c-2995-42a9-b610-639ad4439898\") " pod="cert-manager/cert-manager-59c77684cc-64w2r" Jun 07 16:34:24.114659 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:24.114587 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-64w2r" Jun 07 16:34:24.242412 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:24.242381 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-64w2r"] Jun 07 16:34:24.245535 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:34:24.245503 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30626b2c_2995_42a9_b610_639ad4439898.slice/crio-d8cd47cad84eb884ee256e1306e10e9bf8515fc4a518419091b053afc6322e0e WatchSource:0}: Error finding container d8cd47cad84eb884ee256e1306e10e9bf8515fc4a518419091b053afc6322e0e: Status 404 returned error can't find the container with id d8cd47cad84eb884ee256e1306e10e9bf8515fc4a518419091b053afc6322e0e Jun 07 16:34:24.247963 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:24.247947 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:34:24.932670 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:24.932635 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-64w2r" event={"ID":"30626b2c-2995-42a9-b610-639ad4439898","Type":"ContainerStarted","Data":"d8cd47cad84eb884ee256e1306e10e9bf8515fc4a518419091b053afc6322e0e"} Jun 07 16:34:26.941419 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:26.941382 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-64w2r" event={"ID":"30626b2c-2995-42a9-b610-639ad4439898","Type":"ContainerStarted","Data":"88d65998016296956019a9fb99b59cd892dc20c1b994a85b16ad6ed154243233"} Jun 07 16:34:26.959855 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:26.959809 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-64w2r" podStartSLOduration=1.8053382999999998 podStartE2EDuration="3.95979441s" totalImagesPullingTime="2.15445611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:34:26.958048325 +0000 UTC m=+445.161921600" watchObservedRunningTime="2026-06-07 16:34:26.95979441 +0000 UTC m=+445.163667682" Jun 07 16:34:49.463472 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.463438 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22"] Jun 07 16:34:49.468020 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.468003 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.476314 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.476292 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 07 16:34:49.476466 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.476443 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 07 16:34:49.476562 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.476544 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ff967\"" Jun 07 16:34:49.476632 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.476558 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 07 16:34:49.476632 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.476604 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 07 16:34:49.502577 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.502551 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22"] Jun 07 16:34:49.556539 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.556508 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c3fcc5c6-b7fe-4761-90b9-c382431554a6-manifests\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.556705 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.556544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3fcc5c6-b7fe-4761-90b9-c382431554a6-tmp\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.556705 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.556572 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c3fcc5c6-b7fe-4761-90b9-c382431554a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.556705 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.556591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jtvr\" (UniqueName: \"kubernetes.io/projected/c3fcc5c6-b7fe-4761-90b9-c382431554a6-kube-api-access-2jtvr\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.556868 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.556701 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3fcc5c6-b7fe-4761-90b9-c382431554a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.657336 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.657297 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3fcc5c6-b7fe-4761-90b9-c382431554a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.657537 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.657342 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c3fcc5c6-b7fe-4761-90b9-c382431554a6-manifests\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.657537 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.657371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3fcc5c6-b7fe-4761-90b9-c382431554a6-tmp\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.657537 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.657404 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c3fcc5c6-b7fe-4761-90b9-c382431554a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.657537 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.657425 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jtvr\" (UniqueName: \"kubernetes.io/projected/c3fcc5c6-b7fe-4761-90b9-c382431554a6-kube-api-access-2jtvr\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.657830 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.657803 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c3fcc5c6-b7fe-4761-90b9-c382431554a6-manifests\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.659948 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.659921 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c3fcc5c6-b7fe-4761-90b9-c382431554a6-tmp\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.660063 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.659995 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c3fcc5c6-b7fe-4761-90b9-c382431554a6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.660122 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.660074 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c3fcc5c6-b7fe-4761-90b9-c382431554a6-webhook-cert\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.669571 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.669549 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jtvr\" (UniqueName: \"kubernetes.io/projected/c3fcc5c6-b7fe-4761-90b9-c382431554a6-kube-api-access-2jtvr\") pod \"opendatahub-operator-controller-manager-768db79f96-4nv22\" (UID: \"c3fcc5c6-b7fe-4761-90b9-c382431554a6\") " pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.777734 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.777706 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:49.950593 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:49.950562 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22"] Jun 07 16:34:49.953652 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:34:49.953624 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3fcc5c6_b7fe_4761_90b9_c382431554a6.slice/crio-b4c44f6bb8581ad324408e52ba27d4e07bcc4e946f4b58288bb8264699d701ef WatchSource:0}: Error finding container b4c44f6bb8581ad324408e52ba27d4e07bcc4e946f4b58288bb8264699d701ef: Status 404 returned error can't find the container with id b4c44f6bb8581ad324408e52ba27d4e07bcc4e946f4b58288bb8264699d701ef Jun 07 16:34:50.015212 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:50.015180 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" event={"ID":"c3fcc5c6-b7fe-4761-90b9-c382431554a6","Type":"ContainerStarted","Data":"b4c44f6bb8581ad324408e52ba27d4e07bcc4e946f4b58288bb8264699d701ef"} Jun 07 16:34:53.031023 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:53.030931 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" event={"ID":"c3fcc5c6-b7fe-4761-90b9-c382431554a6","Type":"ContainerStarted","Data":"e7487d15d075b49f6391e58af9aecb4c53cefb96fc218d9f928ff4536c44f7a2"} Jun 07 16:34:54.036236 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:54.036130 2565 generic.go:356] "Generic (PLEG): container finished" podID="c3fcc5c6-b7fe-4761-90b9-c382431554a6" containerID="e7487d15d075b49f6391e58af9aecb4c53cefb96fc218d9f928ff4536c44f7a2" exitCode=0 Jun 07 16:34:54.036236 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:54.036201 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" event={"ID":"c3fcc5c6-b7fe-4761-90b9-c382431554a6","Type":"ContainerDied","Data":"e7487d15d075b49f6391e58af9aecb4c53cefb96fc218d9f928ff4536c44f7a2"} Jun 07 16:34:55.041003 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:55.040962 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" event={"ID":"c3fcc5c6-b7fe-4761-90b9-c382431554a6","Type":"ContainerStarted","Data":"54cb6a3deb3e51f72976aee23245ed6a0aa3c705a2567f3781686832a5649b6a"} Jun 07 16:34:55.041500 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:55.041067 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:34:55.065966 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:34:55.065899 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" podStartSLOduration=1.956472224 podStartE2EDuration="6.065877981s" totalImagesPullingTime="3.191783473s" totalInitContainerRuntime="917.622284ms" isStatefulPod=false podCreationTimestamp="2026-06-07 16:34:49 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:34:55.064182317 +0000 UTC m=+473.268055586" watchObservedRunningTime="2026-06-07 16:34:55.065877981 +0000 UTC m=+473.269751255" Jun 07 16:35:06.046554 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:06.046519 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-768db79f96-4nv22" Jun 07 16:35:09.558088 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:09.558052 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-llvwb"] Jun 07 16:35:09.566370 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:09.566345 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" Jun 07 16:35:09.570793 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:09.570739 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jun 07 16:35:09.570937 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:09.570854 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lt87c\"" Jun 07 16:35:09.596882 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:09.596846 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-llvwb"] Jun 07 16:35:09.699753 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:09.699710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa97ca69-8645-4a65-a336-24044deff8dd-cert\") pod \"odh-model-controller-6dc94f689f-llvwb\" (UID: \"fa97ca69-8645-4a65-a336-24044deff8dd\") " pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" Jun 07 16:35:09.699952 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:09.699818 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89fh2\" (UniqueName: \"kubernetes.io/projected/fa97ca69-8645-4a65-a336-24044deff8dd-kube-api-access-89fh2\") pod \"odh-model-controller-6dc94f689f-llvwb\" (UID: \"fa97ca69-8645-4a65-a336-24044deff8dd\") " pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" Jun 07 16:35:09.801161 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:09.801121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa97ca69-8645-4a65-a336-24044deff8dd-cert\") pod \"odh-model-controller-6dc94f689f-llvwb\" (UID: \"fa97ca69-8645-4a65-a336-24044deff8dd\") " pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" Jun 07 16:35:09.801334 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:09.801191 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89fh2\" (UniqueName: \"kubernetes.io/projected/fa97ca69-8645-4a65-a336-24044deff8dd-kube-api-access-89fh2\") pod \"odh-model-controller-6dc94f689f-llvwb\" (UID: \"fa97ca69-8645-4a65-a336-24044deff8dd\") " pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" Jun 07 16:35:09.801334 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:35:09.801276 2565 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jun 07 16:35:09.801421 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:35:09.801352 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa97ca69-8645-4a65-a336-24044deff8dd-cert podName:fa97ca69-8645-4a65-a336-24044deff8dd nodeName:}" failed. No retries permitted until 2026-06-07 16:35:10.301333626 +0000 UTC m=+488.505206885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa97ca69-8645-4a65-a336-24044deff8dd-cert") pod "odh-model-controller-6dc94f689f-llvwb" (UID: "fa97ca69-8645-4a65-a336-24044deff8dd") : secret "odh-model-controller-webhook-cert" not found Jun 07 16:35:09.814295 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:09.814234 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89fh2\" (UniqueName: \"kubernetes.io/projected/fa97ca69-8645-4a65-a336-24044deff8dd-kube-api-access-89fh2\") pod \"odh-model-controller-6dc94f689f-llvwb\" (UID: \"fa97ca69-8645-4a65-a336-24044deff8dd\") " pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" Jun 07 16:35:10.305195 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.305161 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa97ca69-8645-4a65-a336-24044deff8dd-cert\") pod \"odh-model-controller-6dc94f689f-llvwb\" (UID: \"fa97ca69-8645-4a65-a336-24044deff8dd\") " pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" Jun 07 16:35:10.307619 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.307595 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa97ca69-8645-4a65-a336-24044deff8dd-cert\") pod \"odh-model-controller-6dc94f689f-llvwb\" (UID: \"fa97ca69-8645-4a65-a336-24044deff8dd\") " pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" Jun 07 16:35:10.477111 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.477060 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" Jun 07 16:35:10.601194 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.601161 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sx6b7"] Jun 07 16:35:10.604924 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.604902 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" Jun 07 16:35:10.608346 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.608321 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jun 07 16:35:10.608533 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.608521 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-2qlvj\"" Jun 07 16:35:10.621889 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.621863 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sx6b7"] Jun 07 16:35:10.629387 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.629364 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-6dc94f689f-llvwb"] Jun 07 16:35:10.632391 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:35:10.632370 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa97ca69_8645_4a65_a336_24044deff8dd.slice/crio-43e5cdb0137be0bf3b5262ed981e8e537d4b65c2cf868ab7f0542ab3cc880c12 WatchSource:0}: Error finding container 43e5cdb0137be0bf3b5262ed981e8e537d4b65c2cf868ab7f0542ab3cc880c12: Status 404 returned error can't find the container with id 43e5cdb0137be0bf3b5262ed981e8e537d4b65c2cf868ab7f0542ab3cc880c12 Jun 07 16:35:10.708313 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.708273 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b98fa15-c9fa-4a88-be86-6cc3e98dad4c-tls-certs\") pod \"model-serving-api-5dd488fc48-sx6b7\" (UID: \"9b98fa15-c9fa-4a88-be86-6cc3e98dad4c\") " pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" Jun 07 16:35:10.708473 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.708328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt2tc\" (UniqueName: \"kubernetes.io/projected/9b98fa15-c9fa-4a88-be86-6cc3e98dad4c-kube-api-access-tt2tc\") pod \"model-serving-api-5dd488fc48-sx6b7\" (UID: \"9b98fa15-c9fa-4a88-be86-6cc3e98dad4c\") " pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" Jun 07 16:35:10.809266 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.809233 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b98fa15-c9fa-4a88-be86-6cc3e98dad4c-tls-certs\") pod \"model-serving-api-5dd488fc48-sx6b7\" (UID: \"9b98fa15-c9fa-4a88-be86-6cc3e98dad4c\") " pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" Jun 07 16:35:10.809463 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.809299 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt2tc\" (UniqueName: \"kubernetes.io/projected/9b98fa15-c9fa-4a88-be86-6cc3e98dad4c-kube-api-access-tt2tc\") pod \"model-serving-api-5dd488fc48-sx6b7\" (UID: \"9b98fa15-c9fa-4a88-be86-6cc3e98dad4c\") " pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" Jun 07 16:35:10.809463 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:35:10.809389 2565 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jun 07 16:35:10.809463 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:35:10.809456 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b98fa15-c9fa-4a88-be86-6cc3e98dad4c-tls-certs podName:9b98fa15-c9fa-4a88-be86-6cc3e98dad4c nodeName:}" failed. No retries permitted until 2026-06-07 16:35:11.309433193 +0000 UTC m=+489.513306444 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9b98fa15-c9fa-4a88-be86-6cc3e98dad4c-tls-certs") pod "model-serving-api-5dd488fc48-sx6b7" (UID: "9b98fa15-c9fa-4a88-be86-6cc3e98dad4c") : secret "model-serving-api-tls" not found Jun 07 16:35:10.822113 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:10.822054 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt2tc\" (UniqueName: \"kubernetes.io/projected/9b98fa15-c9fa-4a88-be86-6cc3e98dad4c-kube-api-access-tt2tc\") pod \"model-serving-api-5dd488fc48-sx6b7\" (UID: \"9b98fa15-c9fa-4a88-be86-6cc3e98dad4c\") " pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" Jun 07 16:35:11.095077 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:11.094980 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" event={"ID":"fa97ca69-8645-4a65-a336-24044deff8dd","Type":"ContainerStarted","Data":"43e5cdb0137be0bf3b5262ed981e8e537d4b65c2cf868ab7f0542ab3cc880c12"} Jun 07 16:35:11.314056 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:11.314014 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b98fa15-c9fa-4a88-be86-6cc3e98dad4c-tls-certs\") pod \"model-serving-api-5dd488fc48-sx6b7\" (UID: \"9b98fa15-c9fa-4a88-be86-6cc3e98dad4c\") " pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" Jun 07 16:35:11.317404 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:11.317377 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9b98fa15-c9fa-4a88-be86-6cc3e98dad4c-tls-certs\") pod \"model-serving-api-5dd488fc48-sx6b7\" (UID: \"9b98fa15-c9fa-4a88-be86-6cc3e98dad4c\") " pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" Jun 07 16:35:11.514646 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:11.514614 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" Jun 07 16:35:11.688180 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:11.688103 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-5dd488fc48-sx6b7"] Jun 07 16:35:11.694311 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:35:11.694274 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b98fa15_c9fa_4a88_be86_6cc3e98dad4c.slice/crio-34ffa1f0bcdd7b8f88bfe0f45d60096e8717146007332e847223864d78dad566 WatchSource:0}: Error finding container 34ffa1f0bcdd7b8f88bfe0f45d60096e8717146007332e847223864d78dad566: Status 404 returned error can't find the container with id 34ffa1f0bcdd7b8f88bfe0f45d60096e8717146007332e847223864d78dad566 Jun 07 16:35:12.100830 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:12.100791 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" event={"ID":"9b98fa15-c9fa-4a88-be86-6cc3e98dad4c","Type":"ContainerStarted","Data":"34ffa1f0bcdd7b8f88bfe0f45d60096e8717146007332e847223864d78dad566"} Jun 07 16:35:14.938547 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:14.938515 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-786f88c98-fltjs"] Jun 07 16:35:14.942208 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:14.942192 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" Jun 07 16:35:14.945097 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:14.945075 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 07 16:35:14.945551 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:14.945471 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-fpbjp\"" Jun 07 16:35:14.946347 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:14.946326 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 07 16:35:14.946347 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:14.946340 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 07 16:35:14.946490 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:14.946413 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 07 16:35:14.953108 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:14.953087 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-786f88c98-fltjs"] Jun 07 16:35:15.045095 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:15.045059 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75463f35-91ee-4a55-95a5-aeb471fcaf07-tmp\") pod \"kube-auth-proxy-786f88c98-fltjs\" (UID: \"75463f35-91ee-4a55-95a5-aeb471fcaf07\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" Jun 07 16:35:15.045289 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:15.045127 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75463f35-91ee-4a55-95a5-aeb471fcaf07-tls-certs\") pod \"kube-auth-proxy-786f88c98-fltjs\" (UID: \"75463f35-91ee-4a55-95a5-aeb471fcaf07\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" Jun 07 16:35:15.045289 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:15.045254 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mg54x\" (UniqueName: \"kubernetes.io/projected/75463f35-91ee-4a55-95a5-aeb471fcaf07-kube-api-access-mg54x\") pod \"kube-auth-proxy-786f88c98-fltjs\" (UID: \"75463f35-91ee-4a55-95a5-aeb471fcaf07\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" Jun 07 16:35:15.146693 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:15.146656 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75463f35-91ee-4a55-95a5-aeb471fcaf07-tls-certs\") pod \"kube-auth-proxy-786f88c98-fltjs\" (UID: \"75463f35-91ee-4a55-95a5-aeb471fcaf07\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" Jun 07 16:35:15.146912 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:15.146741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mg54x\" (UniqueName: \"kubernetes.io/projected/75463f35-91ee-4a55-95a5-aeb471fcaf07-kube-api-access-mg54x\") pod \"kube-auth-proxy-786f88c98-fltjs\" (UID: \"75463f35-91ee-4a55-95a5-aeb471fcaf07\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" Jun 07 16:35:15.146912 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:15.146796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75463f35-91ee-4a55-95a5-aeb471fcaf07-tmp\") pod \"kube-auth-proxy-786f88c98-fltjs\" (UID: \"75463f35-91ee-4a55-95a5-aeb471fcaf07\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" Jun 07 16:35:15.149465 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:15.149430 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/75463f35-91ee-4a55-95a5-aeb471fcaf07-tmp\") pod \"kube-auth-proxy-786f88c98-fltjs\" (UID: \"75463f35-91ee-4a55-95a5-aeb471fcaf07\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" Jun 07 16:35:15.149740 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:15.149721 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75463f35-91ee-4a55-95a5-aeb471fcaf07-tls-certs\") pod \"kube-auth-proxy-786f88c98-fltjs\" (UID: \"75463f35-91ee-4a55-95a5-aeb471fcaf07\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" Jun 07 16:35:15.154600 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:15.154574 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mg54x\" (UniqueName: \"kubernetes.io/projected/75463f35-91ee-4a55-95a5-aeb471fcaf07-kube-api-access-mg54x\") pod \"kube-auth-proxy-786f88c98-fltjs\" (UID: \"75463f35-91ee-4a55-95a5-aeb471fcaf07\") " pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" Jun 07 16:35:15.251829 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:15.251788 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" Jun 07 16:35:15.477586 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:15.477552 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-786f88c98-fltjs"] Jun 07 16:35:15.480518 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:35:15.480489 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75463f35_91ee_4a55_95a5_aeb471fcaf07.slice/crio-199d5c655e3ef4ccc31a6452efcba20369051ea9b84a9f6a6b52323aee1d23fa WatchSource:0}: Error finding container 199d5c655e3ef4ccc31a6452efcba20369051ea9b84a9f6a6b52323aee1d23fa: Status 404 returned error can't find the container with id 199d5c655e3ef4ccc31a6452efcba20369051ea9b84a9f6a6b52323aee1d23fa Jun 07 16:35:16.118396 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:16.118349 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" event={"ID":"fa97ca69-8645-4a65-a336-24044deff8dd","Type":"ContainerStarted","Data":"0bab1bd1bb50596987a72c68292206a50093d596901741d80d6c9508f2cab9cb"} Jun 07 16:35:16.118874 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:16.118440 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" Jun 07 16:35:16.120309 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:16.120281 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" event={"ID":"9b98fa15-c9fa-4a88-be86-6cc3e98dad4c","Type":"ContainerStarted","Data":"68e488c6c6b214c8671399c748a1bab9f5e03961e86fcf5f3aa365e9fcc3ea86"} Jun 07 16:35:16.120454 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:16.120338 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" Jun 07 16:35:16.121693 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:16.121669 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" event={"ID":"75463f35-91ee-4a55-95a5-aeb471fcaf07","Type":"ContainerStarted","Data":"199d5c655e3ef4ccc31a6452efcba20369051ea9b84a9f6a6b52323aee1d23fa"} Jun 07 16:35:16.143778 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:16.143716 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" podStartSLOduration=2.434569722 podStartE2EDuration="7.143698528s" totalImagesPullingTime="4.709128806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:16.142591669 +0000 UTC m=+494.346464943" watchObservedRunningTime="2026-06-07 16:35:16.143698528 +0000 UTC m=+494.347571802" Jun 07 16:35:16.162244 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:16.162196 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" podStartSLOduration=2.477394417 podStartE2EDuration="6.162181145s" totalImagesPullingTime="3.684786728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:16.161712778 +0000 UTC m=+494.365586052" watchObservedRunningTime="2026-06-07 16:35:16.162181145 +0000 UTC m=+494.366054417" Jun 07 16:35:18.135621 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:18.135530 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" event={"ID":"75463f35-91ee-4a55-95a5-aeb471fcaf07","Type":"ContainerStarted","Data":"de901229dec893da7f4ab31916ee6c8201929776962cfaa59291bd48f4e75b7e"} Jun 07 16:35:18.162455 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:18.162398 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-786f88c98-fltjs" podStartSLOduration=1.8242399759999999 podStartE2EDuration="4.162382135s" totalImagesPullingTime="2.338142159s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:18.161183392 +0000 UTC m=+496.365056667" watchObservedRunningTime="2026-06-07 16:35:18.162382135 +0000 UTC m=+496.366255407" Jun 07 16:35:20.839678 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.839643 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bb9gs"] Jun 07 16:35:20.842743 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.842726 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" Jun 07 16:35:20.846331 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.846313 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jun 07 16:35:20.846412 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.846318 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hvsjh\"" Jun 07 16:35:20.853119 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.853097 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9"] Jun 07 16:35:20.856027 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.856012 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" Jun 07 16:35:20.859262 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.859243 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jun 07 16:35:20.859614 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.859588 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-k6hpk\"" Jun 07 16:35:20.862786 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.862739 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bb9gs"] Jun 07 16:35:20.881645 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.881616 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9"] Jun 07 16:35:20.991419 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.991388 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b57558f0-b796-4992-8679-e04973d4a2b6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hmzt9\" (UID: \"b57558f0-b796-4992-8679-e04973d4a2b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" Jun 07 16:35:20.991564 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.991423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8l5m\" (UniqueName: \"kubernetes.io/projected/fe34a8fe-dd96-4234-9a49-445043eaf607-kube-api-access-p8l5m\") pod \"kserve-controller-manager-69fc866d76-bb9gs\" (UID: \"fe34a8fe-dd96-4234-9a49-445043eaf607\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" Jun 07 16:35:20.991564 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.991463 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvhbz\" (UniqueName: \"kubernetes.io/projected/b57558f0-b796-4992-8679-e04973d4a2b6-kube-api-access-xvhbz\") pod \"llmisvc-controller-manager-864bfd7bc9-hmzt9\" (UID: \"b57558f0-b796-4992-8679-e04973d4a2b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" Jun 07 16:35:20.991564 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:20.991512 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe34a8fe-dd96-4234-9a49-445043eaf607-cert\") pod \"kserve-controller-manager-69fc866d76-bb9gs\" (UID: \"fe34a8fe-dd96-4234-9a49-445043eaf607\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" Jun 07 16:35:21.092322 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.092251 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe34a8fe-dd96-4234-9a49-445043eaf607-cert\") pod \"kserve-controller-manager-69fc866d76-bb9gs\" (UID: \"fe34a8fe-dd96-4234-9a49-445043eaf607\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" Jun 07 16:35:21.092322 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.092285 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b57558f0-b796-4992-8679-e04973d4a2b6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hmzt9\" (UID: \"b57558f0-b796-4992-8679-e04973d4a2b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" Jun 07 16:35:21.092322 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.092307 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8l5m\" (UniqueName: \"kubernetes.io/projected/fe34a8fe-dd96-4234-9a49-445043eaf607-kube-api-access-p8l5m\") pod \"kserve-controller-manager-69fc866d76-bb9gs\" (UID: \"fe34a8fe-dd96-4234-9a49-445043eaf607\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" Jun 07 16:35:21.092531 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.092342 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvhbz\" (UniqueName: \"kubernetes.io/projected/b57558f0-b796-4992-8679-e04973d4a2b6-kube-api-access-xvhbz\") pod \"llmisvc-controller-manager-864bfd7bc9-hmzt9\" (UID: \"b57558f0-b796-4992-8679-e04973d4a2b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" Jun 07 16:35:21.094832 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.094812 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe34a8fe-dd96-4234-9a49-445043eaf607-cert\") pod \"kserve-controller-manager-69fc866d76-bb9gs\" (UID: \"fe34a8fe-dd96-4234-9a49-445043eaf607\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" Jun 07 16:35:21.094964 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.094944 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b57558f0-b796-4992-8679-e04973d4a2b6-cert\") pod \"llmisvc-controller-manager-864bfd7bc9-hmzt9\" (UID: \"b57558f0-b796-4992-8679-e04973d4a2b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" Jun 07 16:35:21.112189 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.112162 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvhbz\" (UniqueName: \"kubernetes.io/projected/b57558f0-b796-4992-8679-e04973d4a2b6-kube-api-access-xvhbz\") pod \"llmisvc-controller-manager-864bfd7bc9-hmzt9\" (UID: \"b57558f0-b796-4992-8679-e04973d4a2b6\") " pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" Jun 07 16:35:21.122723 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.122703 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8l5m\" (UniqueName: \"kubernetes.io/projected/fe34a8fe-dd96-4234-9a49-445043eaf607-kube-api-access-p8l5m\") pod \"kserve-controller-manager-69fc866d76-bb9gs\" (UID: \"fe34a8fe-dd96-4234-9a49-445043eaf607\") " pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" Jun 07 16:35:21.153120 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.153095 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" Jun 07 16:35:21.166064 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.166044 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" Jun 07 16:35:21.331655 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.331617 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-69fc866d76-bb9gs"] Jun 07 16:35:21.337399 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:35:21.337372 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe34a8fe_dd96_4234_9a49_445043eaf607.slice/crio-315b2c72920f034d4f87eb3f58cbac40561d7a38f11d36bca944123b5b359d1a WatchSource:0}: Error finding container 315b2c72920f034d4f87eb3f58cbac40561d7a38f11d36bca944123b5b359d1a: Status 404 returned error can't find the container with id 315b2c72920f034d4f87eb3f58cbac40561d7a38f11d36bca944123b5b359d1a Jun 07 16:35:21.354453 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:21.354434 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9"] Jun 07 16:35:21.356506 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:35:21.356481 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb57558f0_b796_4992_8679_e04973d4a2b6.slice/crio-083a8c2da66b595ec90d9642518eab892b3414bd8982415d27ef317c234e565f WatchSource:0}: Error finding container 083a8c2da66b595ec90d9642518eab892b3414bd8982415d27ef317c234e565f: Status 404 returned error can't find the container with id 083a8c2da66b595ec90d9642518eab892b3414bd8982415d27ef317c234e565f Jun 07 16:35:22.153568 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:22.153511 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" event={"ID":"fe34a8fe-dd96-4234-9a49-445043eaf607","Type":"ContainerStarted","Data":"315b2c72920f034d4f87eb3f58cbac40561d7a38f11d36bca944123b5b359d1a"} Jun 07 16:35:22.154919 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:22.154883 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" event={"ID":"b57558f0-b796-4992-8679-e04973d4a2b6","Type":"ContainerStarted","Data":"083a8c2da66b595ec90d9642518eab892b3414bd8982415d27ef317c234e565f"} Jun 07 16:35:24.167182 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:24.167094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" event={"ID":"fe34a8fe-dd96-4234-9a49-445043eaf607","Type":"ContainerStarted","Data":"3aa3221f214b370d1ea640c049b71303067d4d5b6c1d5c9897797989513a8397"} Jun 07 16:35:24.167569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:24.167230 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" Jun 07 16:35:24.191930 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:24.191877 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" podStartSLOduration=1.643611027 podStartE2EDuration="4.1918593s" totalImagesPullingTime="2.548248273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:24.190794936 +0000 UTC m=+502.394668211" watchObservedRunningTime="2026-06-07 16:35:24.1918593 +0000 UTC m=+502.395732575" Jun 07 16:35:25.171944 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:25.171910 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" event={"ID":"b57558f0-b796-4992-8679-e04973d4a2b6","Type":"ContainerStarted","Data":"597435a1d80b89f134e9fda5bde9944ded00d6e3ceb89526c05e0c975fcca9e1"} Jun 07 16:35:25.172373 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:25.172147 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" Jun 07 16:35:25.196477 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:25.196428 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" podStartSLOduration=1.904675413 podStartE2EDuration="5.196412237s" totalImagesPullingTime="3.291736824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:25.194052674 +0000 UTC m=+503.397925947" watchObservedRunningTime="2026-06-07 16:35:25.196412237 +0000 UTC m=+503.400285510" Jun 07 16:35:27.128442 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:27.128417 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-6dc94f689f-llvwb" Jun 07 16:35:27.130412 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:27.130393 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-5dd488fc48-sx6b7" Jun 07 16:35:32.988164 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:32.988124 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-6578896ff8-bc27f"] Jun 07 16:35:32.994408 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:32.994386 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6578896ff8-bc27f" Jun 07 16:35:33.004862 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:33.004824 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-n4vc2\"" Jun 07 16:35:33.005303 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:33.005289 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 07 16:35:33.015468 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:33.015439 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6578896ff8-bc27f"] Jun 07 16:35:33.089417 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:33.089377 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7fe909cb-95cd-44c9-b0b4-1a8996295832-redirect-config\") pod \"dashboard-redirect-6578896ff8-bc27f\" (UID: \"7fe909cb-95cd-44c9-b0b4-1a8996295832\") " pod="opendatahub/dashboard-redirect-6578896ff8-bc27f" Jun 07 16:35:33.089607 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:33.089456 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ns9bl\" (UniqueName: \"kubernetes.io/projected/7fe909cb-95cd-44c9-b0b4-1a8996295832-kube-api-access-ns9bl\") pod \"dashboard-redirect-6578896ff8-bc27f\" (UID: \"7fe909cb-95cd-44c9-b0b4-1a8996295832\") " pod="opendatahub/dashboard-redirect-6578896ff8-bc27f" Jun 07 16:35:33.190298 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:33.190262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ns9bl\" (UniqueName: \"kubernetes.io/projected/7fe909cb-95cd-44c9-b0b4-1a8996295832-kube-api-access-ns9bl\") pod \"dashboard-redirect-6578896ff8-bc27f\" (UID: \"7fe909cb-95cd-44c9-b0b4-1a8996295832\") " pod="opendatahub/dashboard-redirect-6578896ff8-bc27f" Jun 07 16:35:33.190489 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:33.190319 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7fe909cb-95cd-44c9-b0b4-1a8996295832-redirect-config\") pod \"dashboard-redirect-6578896ff8-bc27f\" (UID: \"7fe909cb-95cd-44c9-b0b4-1a8996295832\") " pod="opendatahub/dashboard-redirect-6578896ff8-bc27f" Jun 07 16:35:33.191016 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:33.190995 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/7fe909cb-95cd-44c9-b0b4-1a8996295832-redirect-config\") pod \"dashboard-redirect-6578896ff8-bc27f\" (UID: \"7fe909cb-95cd-44c9-b0b4-1a8996295832\") " pod="opendatahub/dashboard-redirect-6578896ff8-bc27f" Jun 07 16:35:33.211320 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:33.211283 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ns9bl\" (UniqueName: \"kubernetes.io/projected/7fe909cb-95cd-44c9-b0b4-1a8996295832-kube-api-access-ns9bl\") pod \"dashboard-redirect-6578896ff8-bc27f\" (UID: \"7fe909cb-95cd-44c9-b0b4-1a8996295832\") " pod="opendatahub/dashboard-redirect-6578896ff8-bc27f" Jun 07 16:35:33.303794 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:33.303739 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-6578896ff8-bc27f" Jun 07 16:35:33.486260 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:33.486222 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-6578896ff8-bc27f"] Jun 07 16:35:33.489485 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:35:33.489449 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fe909cb_95cd_44c9_b0b4_1a8996295832.slice/crio-7eaa149982f46b7a2716f0a552468b2c89bbe0a664d9239480e4a1bce5f72b5d WatchSource:0}: Error finding container 7eaa149982f46b7a2716f0a552468b2c89bbe0a664d9239480e4a1bce5f72b5d: Status 404 returned error can't find the container with id 7eaa149982f46b7a2716f0a552468b2c89bbe0a664d9239480e4a1bce5f72b5d Jun 07 16:35:34.209669 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:34.209625 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6578896ff8-bc27f" event={"ID":"7fe909cb-95cd-44c9-b0b4-1a8996295832","Type":"ContainerStarted","Data":"7eaa149982f46b7a2716f0a552468b2c89bbe0a664d9239480e4a1bce5f72b5d"} Jun 07 16:35:34.821696 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:34.821665 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf"] Jun 07 16:35:34.824777 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:34.824745 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" Jun 07 16:35:34.834215 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:34.834191 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"kube-root-ca.crt\"" Jun 07 16:35:34.834349 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:34.834328 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-operators\"/\"openshift-service-ca.crt\"" Jun 07 16:35:34.834417 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:34.834389 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-operators\"/\"servicemesh-operator3-dockercfg-x6lmb\"" Jun 07 16:35:34.855969 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:34.855930 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf"] Jun 07 16:35:34.904060 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:34.904025 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5fb44611-13f3-48cf-afb6-6580dc72d3dd-operator-config\") pod \"servicemesh-operator3-57f65f65fb-n9gnf\" (UID: \"5fb44611-13f3-48cf-afb6-6580dc72d3dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" Jun 07 16:35:34.904241 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:34.904082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcvgt\" (UniqueName: \"kubernetes.io/projected/5fb44611-13f3-48cf-afb6-6580dc72d3dd-kube-api-access-mcvgt\") pod \"servicemesh-operator3-57f65f65fb-n9gnf\" (UID: \"5fb44611-13f3-48cf-afb6-6580dc72d3dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" Jun 07 16:35:35.004949 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:35.004910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5fb44611-13f3-48cf-afb6-6580dc72d3dd-operator-config\") pod \"servicemesh-operator3-57f65f65fb-n9gnf\" (UID: \"5fb44611-13f3-48cf-afb6-6580dc72d3dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" Jun 07 16:35:35.005143 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:35.004968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcvgt\" (UniqueName: \"kubernetes.io/projected/5fb44611-13f3-48cf-afb6-6580dc72d3dd-kube-api-access-mcvgt\") pod \"servicemesh-operator3-57f65f65fb-n9gnf\" (UID: \"5fb44611-13f3-48cf-afb6-6580dc72d3dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" Jun 07 16:35:35.008302 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:35.008277 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"operator-config\" (UniqueName: \"kubernetes.io/downward-api/5fb44611-13f3-48cf-afb6-6580dc72d3dd-operator-config\") pod \"servicemesh-operator3-57f65f65fb-n9gnf\" (UID: \"5fb44611-13f3-48cf-afb6-6580dc72d3dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" Jun 07 16:35:35.051735 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:35.051704 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcvgt\" (UniqueName: \"kubernetes.io/projected/5fb44611-13f3-48cf-afb6-6580dc72d3dd-kube-api-access-mcvgt\") pod \"servicemesh-operator3-57f65f65fb-n9gnf\" (UID: \"5fb44611-13f3-48cf-afb6-6580dc72d3dd\") " pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" Jun 07 16:35:35.134408 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:35.134315 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" Jun 07 16:35:35.754018 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:35.753984 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf"] Jun 07 16:35:35.756659 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:35:35.756630 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fb44611_13f3_48cf_afb6_6580dc72d3dd.slice/crio-1a367b0a51ccada68c6469e28956ab35817d14aa001787b3f3fd30fbb2969345 WatchSource:0}: Error finding container 1a367b0a51ccada68c6469e28956ab35817d14aa001787b3f3fd30fbb2969345: Status 404 returned error can't find the container with id 1a367b0a51ccada68c6469e28956ab35817d14aa001787b3f3fd30fbb2969345 Jun 07 16:35:36.219011 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:36.218967 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" event={"ID":"5fb44611-13f3-48cf-afb6-6580dc72d3dd","Type":"ContainerStarted","Data":"1a367b0a51ccada68c6469e28956ab35817d14aa001787b3f3fd30fbb2969345"} Jun 07 16:35:36.220234 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:36.220208 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-6578896ff8-bc27f" event={"ID":"7fe909cb-95cd-44c9-b0b4-1a8996295832","Type":"ContainerStarted","Data":"5009780b0498891656d14f019a1d9454624bbd2bad6887059f8da5b2fc7316f0"} Jun 07 16:35:39.235390 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:39.235351 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" event={"ID":"5fb44611-13f3-48cf-afb6-6580dc72d3dd","Type":"ContainerStarted","Data":"5b022c9994a94f77c3951c1704b4dba359e7b0a06399857929e0134faf0967f9"} Jun 07 16:35:39.235876 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:39.235424 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" Jun 07 16:35:39.286158 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:39.286108 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-6578896ff8-bc27f" podStartSLOduration=5.126057848 podStartE2EDuration="7.286093083s" totalImagesPullingTime="2.160035235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:36.239949329 +0000 UTC m=+514.443822602" watchObservedRunningTime="2026-06-07 16:35:39.286093083 +0000 UTC m=+517.489966408" Jun 07 16:35:39.286924 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:39.286898 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" podStartSLOduration=2.632603863 podStartE2EDuration="5.286889126s" totalImagesPullingTime="2.654285263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:39.285615242 +0000 UTC m=+517.489488516" watchObservedRunningTime="2026-06-07 16:35:39.286889126 +0000 UTC m=+517.490762398" Jun 07 16:35:43.935286 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:43.935250 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4"] Jun 07 16:35:43.939009 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:43.938987 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:43.941483 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:43.941458 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jun 07 16:35:43.941483 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:43.941458 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jun 07 16:35:43.941647 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:43.941492 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-nk9rm\"" Jun 07 16:35:43.941647 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:43.941461 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jun 07 16:35:43.941647 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:43.941616 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 07 16:35:43.950696 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:43.950675 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4"] Jun 07 16:35:44.079800 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.079739 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.079800 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.079797 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.080016 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.079820 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fc466af0-f631-4f07-adc1-c42d5e37732a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.080016 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.079850 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc466af0-f631-4f07-adc1-c42d5e37732a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.080016 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.079873 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxwp8\" (UniqueName: \"kubernetes.io/projected/fc466af0-f631-4f07-adc1-c42d5e37732a-kube-api-access-gxwp8\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.080016 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.079962 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.080016 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.080001 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.181333 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.181302 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxwp8\" (UniqueName: \"kubernetes.io/projected/fc466af0-f631-4f07-adc1-c42d5e37732a-kube-api-access-gxwp8\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.181527 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.181343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.181527 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.181366 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.181527 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.181388 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.181527 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.181511 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.181746 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.181560 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fc466af0-f631-4f07-adc1-c42d5e37732a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.181746 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.181607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc466af0-f631-4f07-adc1-c42d5e37732a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.182159 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.182091 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.184086 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.184057 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/fc466af0-f631-4f07-adc1-c42d5e37732a-cacerts\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.184258 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.184131 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.184258 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.184142 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc466af0-f631-4f07-adc1-c42d5e37732a-local-certs\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.184258 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.184210 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-kubeconfig\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.194140 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.194070 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxwp8\" (UniqueName: \"kubernetes.io/projected/fc466af0-f631-4f07-adc1-c42d5e37732a-kube-api-access-gxwp8\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.194235 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.194152 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc466af0-f631-4f07-adc1-c42d5e37732a-istio-token\") pod \"istiod-openshift-gateway-75c67f8887-7kxq4\" (UID: \"fc466af0-f631-4f07-adc1-c42d5e37732a\") " pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.248973 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.248936 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:44.384386 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:44.384355 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4"] Jun 07 16:35:44.386979 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:35:44.386951 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc466af0_f631_4f07_adc1_c42d5e37732a.slice/crio-6725a5d708bf76677b24bea91fc2c257c1ac8d2493b5f744b3341b5df84179d4 WatchSource:0}: Error finding container 6725a5d708bf76677b24bea91fc2c257c1ac8d2493b5f744b3341b5df84179d4: Status 404 returned error can't find the container with id 6725a5d708bf76677b24bea91fc2c257c1ac8d2493b5f744b3341b5df84179d4 Jun 07 16:35:45.261939 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:45.261901 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" event={"ID":"fc466af0-f631-4f07-adc1-c42d5e37732a","Type":"ContainerStarted","Data":"6725a5d708bf76677b24bea91fc2c257c1ac8d2493b5f744b3341b5df84179d4"} Jun 07 16:35:47.665163 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:47.665126 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:35:47.665405 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:47.665190 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:35:48.278899 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:48.278868 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" event={"ID":"fc466af0-f631-4f07-adc1-c42d5e37732a","Type":"ContainerStarted","Data":"69f03f4e0db6af5d34bed267938640297936044d317078948e203055c64f72fb"} Jun 07 16:35:48.279091 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:48.279073 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:48.280679 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:48.280653 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-75c67f8887-7kxq4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jun 07 16:35:48.280823 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:48.280700 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" podUID="fc466af0-f631-4f07-adc1-c42d5e37732a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 16:35:48.299649 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:48.299593 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" podStartSLOduration=2.023853983 podStartE2EDuration="5.299561343s" totalImagesPullingTime="3.27570736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:35:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:35:48.29893787 +0000 UTC m=+526.502811155" watchObservedRunningTime="2026-06-07 16:35:48.299561343 +0000 UTC m=+526.503434619" Jun 07 16:35:49.283895 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:49.283865 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-75c67f8887-7kxq4" Jun 07 16:35:50.241398 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:50.241368 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-operators/servicemesh-operator3-57f65f65fb-n9gnf" Jun 07 16:35:55.176633 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:55.176605 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-69fc866d76-bb9gs" Jun 07 16:35:56.177906 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:35:56.177874 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-864bfd7bc9-hmzt9" Jun 07 16:36:54.165345 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:54.165311 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc"] Jun 07 16:36:54.168429 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:54.168409 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:36:54.171388 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:54.171367 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 16:36:54.172365 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:54.172342 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-rm558\"" Jun 07 16:36:54.175779 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:54.175739 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 16:36:54.187440 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:54.187416 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc"] Jun 07 16:36:54.317861 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:54.317826 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hstg6\" (UniqueName: \"kubernetes.io/projected/10549aae-65f9-40ae-aa12-2dd81fdb3421-kube-api-access-hstg6\") pod \"limitador-operator-controller-manager-859d7b78bd-vtsbc\" (UID: \"10549aae-65f9-40ae-aa12-2dd81fdb3421\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:36:54.418691 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:54.418605 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hstg6\" (UniqueName: \"kubernetes.io/projected/10549aae-65f9-40ae-aa12-2dd81fdb3421-kube-api-access-hstg6\") pod \"limitador-operator-controller-manager-859d7b78bd-vtsbc\" (UID: \"10549aae-65f9-40ae-aa12-2dd81fdb3421\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:36:54.428019 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:54.427990 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hstg6\" (UniqueName: \"kubernetes.io/projected/10549aae-65f9-40ae-aa12-2dd81fdb3421-kube-api-access-hstg6\") pod \"limitador-operator-controller-manager-859d7b78bd-vtsbc\" (UID: \"10549aae-65f9-40ae-aa12-2dd81fdb3421\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:36:54.479308 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:54.479278 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:36:54.614097 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:54.614067 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc"] Jun 07 16:36:54.617662 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:36:54.617634 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10549aae_65f9_40ae_aa12_2dd81fdb3421.slice/crio-03bd9e0ecc68448c39b43babc2c994eb9b82af8aeef65a89fe261ce30062c2d4 WatchSource:0}: Error finding container 03bd9e0ecc68448c39b43babc2c994eb9b82af8aeef65a89fe261ce30062c2d4: Status 404 returned error can't find the container with id 03bd9e0ecc68448c39b43babc2c994eb9b82af8aeef65a89fe261ce30062c2d4 Jun 07 16:36:55.554754 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:55.554717 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" event={"ID":"10549aae-65f9-40ae-aa12-2dd81fdb3421","Type":"ContainerStarted","Data":"03bd9e0ecc68448c39b43babc2c994eb9b82af8aeef65a89fe261ce30062c2d4"} Jun 07 16:36:57.564578 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:57.564537 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" event={"ID":"10549aae-65f9-40ae-aa12-2dd81fdb3421","Type":"ContainerStarted","Data":"8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92"} Jun 07 16:36:57.565032 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:57.564680 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:36:57.582267 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:36:57.582218 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" podStartSLOduration=1.636868217 podStartE2EDuration="3.582205397s" totalImagesPullingTime="1.94533718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:36:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:36:57.58134417 +0000 UTC m=+595.785217441" watchObservedRunningTime="2026-06-07 16:36:57.582205397 +0000 UTC m=+595.786078669" Jun 07 16:37:02.259401 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:02.259370 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:37:02.262977 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:02.262956 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:37:06.207166 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.207132 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc"] Jun 07 16:37:06.207616 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.207321 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" podUID="10549aae-65f9-40ae-aa12-2dd81fdb3421" containerName="manager" containerID="cri-o://8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92" gracePeriod=2 Jun 07 16:37:06.209201 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.209176 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:37:06.228195 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.228173 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc"] Jun 07 16:37:06.235041 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:37:06.235007 2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"10549aae-65f9-40ae-aa12-2dd81fdb3421\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-vtsbc\": pods \"limitador-operator-controller-manager-859d7b78bd-vtsbc\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:37:06.237341 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:37:06.237311 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtsbc\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object" podUID="10549aae-65f9-40ae-aa12-2dd81fdb3421" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:37:06.442208 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.442180 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:37:06.506205 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.506179 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hstg6\" (UniqueName: \"kubernetes.io/projected/10549aae-65f9-40ae-aa12-2dd81fdb3421-kube-api-access-hstg6\") pod \"10549aae-65f9-40ae-aa12-2dd81fdb3421\" (UID: \"10549aae-65f9-40ae-aa12-2dd81fdb3421\") " Jun 07 16:37:06.508395 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.508364 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10549aae-65f9-40ae-aa12-2dd81fdb3421-kube-api-access-hstg6" (OuterVolumeSpecName: "kube-api-access-hstg6") pod "10549aae-65f9-40ae-aa12-2dd81fdb3421" (UID: "10549aae-65f9-40ae-aa12-2dd81fdb3421"). InnerVolumeSpecName "kube-api-access-hstg6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:37:06.600838 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.600802 2565 generic.go:356] "Generic (PLEG): container finished" podID="10549aae-65f9-40ae-aa12-2dd81fdb3421" containerID="8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92" exitCode=0 Jun 07 16:37:06.600838 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.600840 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:37:06.601023 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.600883 2565 scope.go:117] "RemoveContainer" containerID="8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92" Jun 07 16:37:06.606857 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.606836 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hstg6\" (UniqueName: \"kubernetes.io/projected/10549aae-65f9-40ae-aa12-2dd81fdb3421-kube-api-access-hstg6\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:37:06.609716 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.609700 2565 scope.go:117] "RemoveContainer" containerID="8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92" Jun 07 16:37:06.610014 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:37:06.609993 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92\": container with ID starting with 8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92 not found: ID does not exist" containerID="8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92" Jun 07 16:37:06.610086 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:06.610021 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92"} err="failed to get container status \"8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92\": rpc error: code = NotFound desc = could not find container \"8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92\": container with ID starting with 8f3f32effc3fa18bfc19b8c46017f376ea0bf557860151212e58c2dbc6d2ad92 not found: ID does not exist" Jun 07 16:37:06.611439 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:37:06.611414 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-vtsbc\" is forbidden: User \"system:node:ip-10-0-133-143.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-143.ec2.internal' and this object" podUID="10549aae-65f9-40ae-aa12-2dd81fdb3421" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-vtsbc" Jun 07 16:37:08.294226 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:08.294193 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10549aae-65f9-40ae-aa12-2dd81fdb3421" path="/var/lib/kubelet/pods/10549aae-65f9-40ae-aa12-2dd81fdb3421/volumes" Jun 07 16:37:34.922807 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:34.922749 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz"] Jun 07 16:37:34.923236 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:34.923061 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10549aae-65f9-40ae-aa12-2dd81fdb3421" containerName="manager" Jun 07 16:37:34.923236 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:34.923072 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="10549aae-65f9-40ae-aa12-2dd81fdb3421" containerName="manager" Jun 07 16:37:34.923236 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:34.923121 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="10549aae-65f9-40ae-aa12-2dd81fdb3421" containerName="manager" Jun 07 16:37:34.926199 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:34.926177 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:34.928749 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:34.928725 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-b4m7d\"" Jun 07 16:37:34.938311 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:34.938284 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz"] Jun 07 16:37:35.014155 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.014119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.014294 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.014159 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.014294 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.014206 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.014294 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.014230 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcgtz\" (UniqueName: \"kubernetes.io/projected/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-kube-api-access-wcgtz\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.014433 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.014292 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.014433 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.014326 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.014433 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.014353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.014433 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.014371 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.014433 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.014397 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.114952 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.114914 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.114952 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.114954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.115188 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.114976 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.115188 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.115154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.115188 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.115186 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.115344 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.115221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.115344 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.115240 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.115344 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.115284 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.115344 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.115314 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcgtz\" (UniqueName: \"kubernetes.io/projected/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-kube-api-access-wcgtz\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.115609 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.115344 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.115609 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.115382 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.115609 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.115469 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.115799 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.115774 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.116126 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.116103 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.117571 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.117548 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.117822 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.117800 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.123744 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.123679 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.123911 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.123886 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcgtz\" (UniqueName: \"kubernetes.io/projected/dec669b0-f2d1-479b-8e1f-bb8933ce93e3-kube-api-access-wcgtz\") pod \"maas-default-gateway-openshift-default-687ff6996-zhjwz\" (UID: \"dec669b0-f2d1-479b-8e1f-bb8933ce93e3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.238918 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.238841 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:35.376000 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.375971 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz"] Jun 07 16:37:35.379365 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:37:35.379332 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec669b0_f2d1_479b_8e1f_bb8933ce93e3.slice/crio-6046cc104d062066a51005ae48308d0e9241aaf523d18003269fc4e570ad6609 WatchSource:0}: Error finding container 6046cc104d062066a51005ae48308d0e9241aaf523d18003269fc4e570ad6609: Status 404 returned error can't find the container with id 6046cc104d062066a51005ae48308d0e9241aaf523d18003269fc4e570ad6609 Jun 07 16:37:35.723387 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:35.723350 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" event={"ID":"dec669b0-f2d1-479b-8e1f-bb8933ce93e3","Type":"ContainerStarted","Data":"6046cc104d062066a51005ae48308d0e9241aaf523d18003269fc4e570ad6609"} Jun 07 16:37:37.775711 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:37.775672 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:37:37.776017 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:37.775746 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:37:37.776017 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:37.775790 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:37:38.738669 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:38.738562 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" event={"ID":"dec669b0-f2d1-479b-8e1f-bb8933ce93e3","Type":"ContainerStarted","Data":"f04a46aa13e3b8e693161b1c59c386a45dac0543117631c19ea6b912d64d5084"} Jun 07 16:37:38.758983 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:38.758936 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" podStartSLOduration=2.364819002 podStartE2EDuration="4.758922761s" totalImagesPullingTime="2.394103759s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:37:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:37:38.757066586 +0000 UTC m=+636.960939860" watchObservedRunningTime="2026-06-07 16:37:38.758922761 +0000 UTC m=+636.962796031" Jun 07 16:37:39.239834 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.239797 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:39.242715 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.242687 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-629hg"] Jun 07 16:37:39.246411 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.246392 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:39.246567 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.246548 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:39.249100 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.249080 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 07 16:37:39.249199 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.249083 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 16:37:39.250174 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.250158 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 16:37:39.250265 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.250159 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qg4pn\"" Jun 07 16:37:39.255385 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.255365 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-629hg"] Jun 07 16:37:39.336153 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.336124 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-629hg"] Jun 07 16:37:39.355163 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.355138 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvrtg\" (UniqueName: \"kubernetes.io/projected/c27fda21-ff12-4067-a10b-783f47414d97-kube-api-access-lvrtg\") pod \"limitador-limitador-64c94fd64f-629hg\" (UID: \"c27fda21-ff12-4067-a10b-783f47414d97\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:39.355323 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.355297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c27fda21-ff12-4067-a10b-783f47414d97-config-file\") pod \"limitador-limitador-64c94fd64f-629hg\" (UID: \"c27fda21-ff12-4067-a10b-783f47414d97\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:39.456166 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.456131 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvrtg\" (UniqueName: \"kubernetes.io/projected/c27fda21-ff12-4067-a10b-783f47414d97-kube-api-access-lvrtg\") pod \"limitador-limitador-64c94fd64f-629hg\" (UID: \"c27fda21-ff12-4067-a10b-783f47414d97\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:39.456339 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.456237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c27fda21-ff12-4067-a10b-783f47414d97-config-file\") pod \"limitador-limitador-64c94fd64f-629hg\" (UID: \"c27fda21-ff12-4067-a10b-783f47414d97\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:39.456865 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.456840 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c27fda21-ff12-4067-a10b-783f47414d97-config-file\") pod \"limitador-limitador-64c94fd64f-629hg\" (UID: \"c27fda21-ff12-4067-a10b-783f47414d97\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:39.464510 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.464487 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvrtg\" (UniqueName: \"kubernetes.io/projected/c27fda21-ff12-4067-a10b-783f47414d97-kube-api-access-lvrtg\") pod \"limitador-limitador-64c94fd64f-629hg\" (UID: \"c27fda21-ff12-4067-a10b-783f47414d97\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:39.556912 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.556889 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:39.690861 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.690836 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-629hg"] Jun 07 16:37:39.693153 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:37:39.693127 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc27fda21_ff12_4067_a10b_783f47414d97.slice/crio-04611a57e6c488dd42c5069386860b1973d421802f70120ae401ac77408d4493 WatchSource:0}: Error finding container 04611a57e6c488dd42c5069386860b1973d421802f70120ae401ac77408d4493: Status 404 returned error can't find the container with id 04611a57e6c488dd42c5069386860b1973d421802f70120ae401ac77408d4493 Jun 07 16:37:39.743321 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.743295 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" event={"ID":"c27fda21-ff12-4067-a10b-783f47414d97","Type":"ContainerStarted","Data":"04611a57e6c488dd42c5069386860b1973d421802f70120ae401ac77408d4493"} Jun 07 16:37:39.743499 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.743483 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:39.744303 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:39.744283 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:37:42.760828 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:42.760792 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" event={"ID":"c27fda21-ff12-4067-a10b-783f47414d97","Type":"ContainerStarted","Data":"c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1"} Jun 07 16:37:42.761229 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:42.760910 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:42.780084 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:42.780038 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" podStartSLOduration=1.074996264 podStartE2EDuration="3.780023257s" totalImagesPullingTime="2.705026993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:37:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:37:42.779510603 +0000 UTC m=+640.983383876" watchObservedRunningTime="2026-06-07 16:37:42.780023257 +0000 UTC m=+640.983896539" Jun 07 16:37:53.765894 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:53.765865 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:55.869657 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:55.869618 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-629hg"] Jun 07 16:37:55.870099 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:55.869838 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" podUID="c27fda21-ff12-4067-a10b-783f47414d97" containerName="limitador" containerID="cri-o://c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1" gracePeriod=30 Jun 07 16:37:56.409622 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.409594 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:56.505433 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.505397 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c27fda21-ff12-4067-a10b-783f47414d97-config-file\") pod \"c27fda21-ff12-4067-a10b-783f47414d97\" (UID: \"c27fda21-ff12-4067-a10b-783f47414d97\") " Jun 07 16:37:56.505627 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.505478 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvrtg\" (UniqueName: \"kubernetes.io/projected/c27fda21-ff12-4067-a10b-783f47414d97-kube-api-access-lvrtg\") pod \"c27fda21-ff12-4067-a10b-783f47414d97\" (UID: \"c27fda21-ff12-4067-a10b-783f47414d97\") " Jun 07 16:37:56.505822 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.505794 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c27fda21-ff12-4067-a10b-783f47414d97-config-file" (OuterVolumeSpecName: "config-file") pod "c27fda21-ff12-4067-a10b-783f47414d97" (UID: "c27fda21-ff12-4067-a10b-783f47414d97"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 16:37:56.507653 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.507628 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c27fda21-ff12-4067-a10b-783f47414d97-kube-api-access-lvrtg" (OuterVolumeSpecName: "kube-api-access-lvrtg") pod "c27fda21-ff12-4067-a10b-783f47414d97" (UID: "c27fda21-ff12-4067-a10b-783f47414d97"). InnerVolumeSpecName "kube-api-access-lvrtg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:37:56.606555 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.606510 2565 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c27fda21-ff12-4067-a10b-783f47414d97-config-file\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:37:56.606555 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.606542 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvrtg\" (UniqueName: \"kubernetes.io/projected/c27fda21-ff12-4067-a10b-783f47414d97-kube-api-access-lvrtg\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:37:56.821625 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.821535 2565 generic.go:356] "Generic (PLEG): container finished" podID="c27fda21-ff12-4067-a10b-783f47414d97" containerID="c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1" exitCode=0 Jun 07 16:37:56.821625 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.821585 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" Jun 07 16:37:56.821824 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.821622 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" event={"ID":"c27fda21-ff12-4067-a10b-783f47414d97","Type":"ContainerDied","Data":"c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1"} Jun 07 16:37:56.821824 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.821681 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-629hg" event={"ID":"c27fda21-ff12-4067-a10b-783f47414d97","Type":"ContainerDied","Data":"04611a57e6c488dd42c5069386860b1973d421802f70120ae401ac77408d4493"} Jun 07 16:37:56.821824 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.821703 2565 scope.go:117] "RemoveContainer" containerID="c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1" Jun 07 16:37:56.830434 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.830413 2565 scope.go:117] "RemoveContainer" containerID="c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1" Jun 07 16:37:56.830713 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:37:56.830689 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1\": container with ID starting with c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1 not found: ID does not exist" containerID="c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1" Jun 07 16:37:56.830832 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.830725 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1"} err="failed to get container status \"c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1\": rpc error: code = NotFound desc = could not find container \"c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1\": container with ID starting with c3462a389b52f2b07fa34ae3f712b4d263388a078764fe45b470dd69f5ebfbe1 not found: ID does not exist" Jun 07 16:37:56.842820 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.842790 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-629hg"] Jun 07 16:37:56.845836 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:56.845802 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-629hg"] Jun 07 16:37:58.294939 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:37:58.294905 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c27fda21-ff12-4067-a10b-783f47414d97" path="/var/lib/kubelet/pods/c27fda21-ff12-4067-a10b-783f47414d97/volumes" Jun 07 16:38:00.834207 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.834174 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-g744v"] Jun 07 16:38:00.834555 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.834474 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c27fda21-ff12-4067-a10b-783f47414d97" containerName="limitador" Jun 07 16:38:00.834555 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.834487 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c27fda21-ff12-4067-a10b-783f47414d97" containerName="limitador" Jun 07 16:38:00.834555 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.834532 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c27fda21-ff12-4067-a10b-783f47414d97" containerName="limitador" Jun 07 16:38:00.838611 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.838590 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" Jun 07 16:38:00.841101 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.841076 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 07 16:38:00.841197 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.841103 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 07 16:38:00.841197 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.841120 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 07 16:38:00.842117 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.842101 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-gsdh8\"" Jun 07 16:38:00.846059 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.845843 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-g744v"] Jun 07 16:38:00.942144 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.942112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9kdh\" (UniqueName: \"kubernetes.io/projected/b0040818-b608-4d48-ad8b-0fd4540390c2-kube-api-access-x9kdh\") pod \"postgres-69fb4594cf-g744v\" (UID: \"b0040818-b608-4d48-ad8b-0fd4540390c2\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" Jun 07 16:38:00.942333 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:00.942204 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b0040818-b608-4d48-ad8b-0fd4540390c2-data\") pod \"postgres-69fb4594cf-g744v\" (UID: \"b0040818-b608-4d48-ad8b-0fd4540390c2\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" Jun 07 16:38:01.043466 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:01.043428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b0040818-b608-4d48-ad8b-0fd4540390c2-data\") pod \"postgres-69fb4594cf-g744v\" (UID: \"b0040818-b608-4d48-ad8b-0fd4540390c2\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" Jun 07 16:38:01.043649 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:01.043487 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9kdh\" (UniqueName: \"kubernetes.io/projected/b0040818-b608-4d48-ad8b-0fd4540390c2-kube-api-access-x9kdh\") pod \"postgres-69fb4594cf-g744v\" (UID: \"b0040818-b608-4d48-ad8b-0fd4540390c2\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" Jun 07 16:38:01.043904 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:01.043879 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/b0040818-b608-4d48-ad8b-0fd4540390c2-data\") pod \"postgres-69fb4594cf-g744v\" (UID: \"b0040818-b608-4d48-ad8b-0fd4540390c2\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" Jun 07 16:38:01.057232 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:01.057200 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9kdh\" (UniqueName: \"kubernetes.io/projected/b0040818-b608-4d48-ad8b-0fd4540390c2-kube-api-access-x9kdh\") pod \"postgres-69fb4594cf-g744v\" (UID: \"b0040818-b608-4d48-ad8b-0fd4540390c2\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" Jun 07 16:38:01.149553 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:01.149475 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" Jun 07 16:38:01.288227 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:01.284357 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-g744v"] Jun 07 16:38:01.844944 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:01.844905 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" event={"ID":"b0040818-b608-4d48-ad8b-0fd4540390c2","Type":"ContainerStarted","Data":"fbc3c83da4f4c2e7d9eefc9cbb92b2b181326363bb2a5993cb8f8f7f2e62c2aa"} Jun 07 16:38:04.288474 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:04.288452 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 07 16:38:04.863906 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:04.863872 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" event={"ID":"b0040818-b608-4d48-ad8b-0fd4540390c2","Type":"ContainerStarted","Data":"755087b3e6bbb3c84d59b7d84d2bb4690be37d68a76f6245ac82cfbba6f9f57b"} Jun 07 16:38:04.864084 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:04.864056 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" Jun 07 16:38:04.881002 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:04.880958 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" podStartSLOduration=1.884695923 podStartE2EDuration="4.880944609s" totalImagesPullingTime="2.996248686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:38:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:38:04.87979944 +0000 UTC m=+663.083672710" watchObservedRunningTime="2026-06-07 16:38:04.880944609 +0000 UTC m=+663.084817882" Jun 07 16:38:10.901200 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:10.901171 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-g744v" Jun 07 16:38:19.863163 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:19.863124 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-c47j9"] Jun 07 16:38:19.874706 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:19.874676 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-c47j9" Jun 07 16:38:19.877997 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:19.877974 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 07 16:38:19.878112 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:19.878000 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-tck9b\"" Jun 07 16:38:19.878957 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:19.878936 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 07 16:38:19.913372 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:19.913339 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-c47j9"] Jun 07 16:38:19.994001 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:19.993967 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6fg4\" (UniqueName: \"kubernetes.io/projected/95511786-8e9e-4658-a27f-1f46969d7778-kube-api-access-h6fg4\") pod \"keycloak-operator-d67dbbb48-c47j9\" (UID: \"95511786-8e9e-4658-a27f-1f46969d7778\") " pod="keycloak-system/keycloak-operator-d67dbbb48-c47j9" Jun 07 16:38:20.094860 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:20.094818 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6fg4\" (UniqueName: \"kubernetes.io/projected/95511786-8e9e-4658-a27f-1f46969d7778-kube-api-access-h6fg4\") pod \"keycloak-operator-d67dbbb48-c47j9\" (UID: \"95511786-8e9e-4658-a27f-1f46969d7778\") " pod="keycloak-system/keycloak-operator-d67dbbb48-c47j9" Jun 07 16:38:20.104282 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:20.104254 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6fg4\" (UniqueName: \"kubernetes.io/projected/95511786-8e9e-4658-a27f-1f46969d7778-kube-api-access-h6fg4\") pod \"keycloak-operator-d67dbbb48-c47j9\" (UID: \"95511786-8e9e-4658-a27f-1f46969d7778\") " pod="keycloak-system/keycloak-operator-d67dbbb48-c47j9" Jun 07 16:38:20.184932 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:20.184836 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-c47j9" Jun 07 16:38:20.313391 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:20.313368 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-c47j9"] Jun 07 16:38:20.316122 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:38:20.316085 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95511786_8e9e_4658_a27f_1f46969d7778.slice/crio-6a8a2dd748fcaed34de9c86e1ae82187f83b21a06feb4a9a07c6ba4bf9f29d17 WatchSource:0}: Error finding container 6a8a2dd748fcaed34de9c86e1ae82187f83b21a06feb4a9a07c6ba4bf9f29d17: Status 404 returned error can't find the container with id 6a8a2dd748fcaed34de9c86e1ae82187f83b21a06feb4a9a07c6ba4bf9f29d17 Jun 07 16:38:20.930776 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:20.930729 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-c47j9" event={"ID":"95511786-8e9e-4658-a27f-1f46969d7778","Type":"ContainerStarted","Data":"6a8a2dd748fcaed34de9c86e1ae82187f83b21a06feb4a9a07c6ba4bf9f29d17"} Jun 07 16:38:25.958232 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:25.958191 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-c47j9" event={"ID":"95511786-8e9e-4658-a27f-1f46969d7778","Type":"ContainerStarted","Data":"02000bdf7f04d494b3da7c26fd8014d8720f5bc07be13fb0b2e6c64aa3d6570c"} Jun 07 16:38:25.980784 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:38:25.979154 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-c47j9" podStartSLOduration=1.462510808 podStartE2EDuration="6.979133708s" totalImagesPullingTime="5.5166229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:38:25.977372708 +0000 UTC m=+684.181245983" watchObservedRunningTime="2026-06-07 16:38:25.979133708 +0000 UTC m=+684.183006982" Jun 07 16:39:44.608993 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:44.608953 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-8zknl"] Jun 07 16:39:44.611219 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:44.611200 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-8zknl" Jun 07 16:39:44.614143 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:44.614112 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 07 16:39:44.614281 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:44.614113 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-487ds\"" Jun 07 16:39:44.619334 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:44.619304 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-8zknl"] Jun 07 16:39:44.710580 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:44.710532 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pm65\" (UniqueName: \"kubernetes.io/projected/e41894fa-2a26-4b76-accc-ce06c252d541-kube-api-access-9pm65\") pod \"payload-pre-processing-67d7689b65-8zknl\" (UID: \"e41894fa-2a26-4b76-accc-ce06c252d541\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-8zknl" Jun 07 16:39:44.812036 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:44.811988 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pm65\" (UniqueName: \"kubernetes.io/projected/e41894fa-2a26-4b76-accc-ce06c252d541-kube-api-access-9pm65\") pod \"payload-pre-processing-67d7689b65-8zknl\" (UID: \"e41894fa-2a26-4b76-accc-ce06c252d541\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-8zknl" Jun 07 16:39:44.820477 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:44.820446 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pm65\" (UniqueName: \"kubernetes.io/projected/e41894fa-2a26-4b76-accc-ce06c252d541-kube-api-access-9pm65\") pod \"payload-pre-processing-67d7689b65-8zknl\" (UID: \"e41894fa-2a26-4b76-accc-ce06c252d541\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-8zknl" Jun 07 16:39:44.922873 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:44.922753 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-8zknl" Jun 07 16:39:45.058902 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:45.058875 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-8zknl"] Jun 07 16:39:45.061130 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:39:45.061099 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode41894fa_2a26_4b76_accc_ce06c252d541.slice/crio-e68acc9daebe05a18e32b231ae58a58a9b529adb8f1b155bca2c4108bb49cb2c WatchSource:0}: Error finding container e68acc9daebe05a18e32b231ae58a58a9b529adb8f1b155bca2c4108bb49cb2c: Status 404 returned error can't find the container with id e68acc9daebe05a18e32b231ae58a58a9b529adb8f1b155bca2c4108bb49cb2c Jun 07 16:39:45.063147 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:45.063127 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:39:45.309625 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:45.309583 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-8zknl" event={"ID":"e41894fa-2a26-4b76-accc-ce06c252d541","Type":"ContainerStarted","Data":"e68acc9daebe05a18e32b231ae58a58a9b529adb8f1b155bca2c4108bb49cb2c"} Jun 07 16:39:48.324734 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:48.324694 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-8zknl" event={"ID":"e41894fa-2a26-4b76-accc-ce06c252d541","Type":"ContainerStarted","Data":"c79d3a1676a63bf903cf6eb5453aa61eeab2cb4cdd78e4cd523454fb99d47ce0"} Jun 07 16:39:48.325158 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:48.324824 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-8zknl" Jun 07 16:39:48.342119 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:48.342053 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-8zknl" podStartSLOduration=1.595592628 podStartE2EDuration="4.342037296s" totalImagesPullingTime="2.746444668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:39:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:39:48.341201894 +0000 UTC m=+766.545075168" watchObservedRunningTime="2026-06-07 16:39:48.342037296 +0000 UTC m=+766.545910569" Jun 07 16:39:52.344261 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:52.344170 2565 generic.go:356] "Generic (PLEG): container finished" podID="dec669b0-f2d1-479b-8e1f-bb8933ce93e3" containerID="f04a46aa13e3b8e693161b1c59c386a45dac0543117631c19ea6b912d64d5084" exitCode=0 Jun 07 16:39:52.344261 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:52.344242 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" event={"ID":"dec669b0-f2d1-479b-8e1f-bb8933ce93e3","Type":"ContainerDied","Data":"f04a46aa13e3b8e693161b1c59c386a45dac0543117631c19ea6b912d64d5084"} Jun 07 16:39:52.344710 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:52.344647 2565 scope.go:117] "RemoveContainer" containerID="f04a46aa13e3b8e693161b1c59c386a45dac0543117631c19ea6b912d64d5084" Jun 07 16:39:52.345664 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:52.345633 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:39:52.345721 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:52.345711 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:39:52.345755 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:52.345745 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jun 07 16:39:53.352238 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:53.352190 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" event={"ID":"dec669b0-f2d1-479b-8e1f-bb8933ce93e3","Type":"ContainerStarted","Data":"e4b23632dd150b29dae32d46132f0cda3add363368e9c915370fd0d24aaefba1"} Jun 07 16:39:54.239684 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:54.239649 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:39:54.240956 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:54.240926 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-zhjwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body= Jun 07 16:39:54.241078 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:54.240989 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" podUID="dec669b0-f2d1-479b-8e1f-bb8933ce93e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" Jun 07 16:39:54.744364 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:54.744323 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:39:55.239923 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:55.239861 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-zhjwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body= Jun 07 16:39:55.240108 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:55.239951 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" podUID="dec669b0-f2d1-479b-8e1f-bb8933ce93e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" Jun 07 16:39:56.240156 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:56.240116 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-zhjwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body= Jun 07 16:39:56.240569 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:56.240179 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" podUID="dec669b0-f2d1-479b-8e1f-bb8933ce93e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" Jun 07 16:39:57.239654 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:57.239614 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-zhjwz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" start-of-body= Jun 07 16:39:57.239873 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:57.239675 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" podUID="dec669b0-f2d1-479b-8e1f-bb8933ce93e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.24:15021/healthz/ready\": dial tcp 10.132.0.24:15021: connect: connection refused" Jun 07 16:39:58.243635 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:58.243602 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:39:58.244552 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:58.244531 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-zhjwz" Jun 07 16:39:59.331597 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:39:59.331557 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-8zknl" Jun 07 16:41:01.709281 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.709242 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65"] Jun 07 16:41:01.712625 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.712601 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.715179 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.715156 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 07 16:41:01.716374 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.716351 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-bcmch\"" Jun 07 16:41:01.716517 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.716486 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 07 16:41:01.716517 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.716486 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 07 16:41:01.724541 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.724513 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65"] Jun 07 16:41:01.761560 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.761525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4639bc4b-5382-467b-aabb-07eaa86d2d1e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.761560 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.761565 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.761888 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.761640 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.761888 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.761692 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dj2m\" (UniqueName: \"kubernetes.io/projected/4639bc4b-5382-467b-aabb-07eaa86d2d1e-kube-api-access-2dj2m\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.761888 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.761731 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.761888 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.761755 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.862991 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.862950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.863171 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.863006 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dj2m\" (UniqueName: \"kubernetes.io/projected/4639bc4b-5382-467b-aabb-07eaa86d2d1e-kube-api-access-2dj2m\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.863171 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.863058 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.863282 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.863227 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.863332 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.863312 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4639bc4b-5382-467b-aabb-07eaa86d2d1e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.863385 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.863343 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.863508 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.863477 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.863748 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.863724 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.864001 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.863969 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.865663 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.865628 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4639bc4b-5382-467b-aabb-07eaa86d2d1e-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.866046 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.866027 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4639bc4b-5382-467b-aabb-07eaa86d2d1e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:01.872224 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:01.872196 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dj2m\" (UniqueName: \"kubernetes.io/projected/4639bc4b-5382-467b-aabb-07eaa86d2d1e-kube-api-access-2dj2m\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65\" (UID: \"4639bc4b-5382-467b-aabb-07eaa86d2d1e\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:02.023616 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:02.023578 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:02.162896 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:02.162861 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65"] Jun 07 16:41:02.165706 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:41:02.165679 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4639bc4b_5382_467b_aabb_07eaa86d2d1e.slice/crio-3889c07b5599f51fd39dbc2e66ecfc3f44ff15bff2bfa5c235c5031f63dda9ea WatchSource:0}: Error finding container 3889c07b5599f51fd39dbc2e66ecfc3f44ff15bff2bfa5c235c5031f63dda9ea: Status 404 returned error can't find the container with id 3889c07b5599f51fd39dbc2e66ecfc3f44ff15bff2bfa5c235c5031f63dda9ea Jun 07 16:41:02.678524 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:02.678456 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" event={"ID":"4639bc4b-5382-467b-aabb-07eaa86d2d1e","Type":"ContainerStarted","Data":"3889c07b5599f51fd39dbc2e66ecfc3f44ff15bff2bfa5c235c5031f63dda9ea"} Jun 07 16:41:05.695059 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:05.695023 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" event={"ID":"4639bc4b-5382-467b-aabb-07eaa86d2d1e","Type":"ContainerStarted","Data":"d86c3861f960e61e4977dbdedc6981873586a3721bc8497b8b59f609b217cc6a"} Jun 07 16:41:06.701837 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:06.701726 2565 generic.go:356] "Generic (PLEG): container finished" podID="4639bc4b-5382-467b-aabb-07eaa86d2d1e" containerID="d86c3861f960e61e4977dbdedc6981873586a3721bc8497b8b59f609b217cc6a" exitCode=0 Jun 07 16:41:06.701837 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:06.701817 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" event={"ID":"4639bc4b-5382-467b-aabb-07eaa86d2d1e","Type":"ContainerDied","Data":"d86c3861f960e61e4977dbdedc6981873586a3721bc8497b8b59f609b217cc6a"} Jun 07 16:41:08.712327 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:08.712287 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" event={"ID":"4639bc4b-5382-467b-aabb-07eaa86d2d1e","Type":"ContainerStarted","Data":"2642dc01c81976be26d53695ee1a2710863bfd1469f8dd5c161b096981f3c389"} Jun 07 16:41:08.731035 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:08.730973 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" podStartSLOduration=2.604263248 podStartE2EDuration="7.730956273s" totalImagesPullingTime="3.804210397s" totalInitContainerRuntime="1.322482628s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:41:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:41:08.730650976 +0000 UTC m=+846.934524249" watchObservedRunningTime="2026-06-07 16:41:08.730956273 +0000 UTC m=+846.934829547" Jun 07 16:41:12.023861 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:12.023823 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:12.024360 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:12.023888 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:12.036467 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:12.036429 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:12.741091 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:12.741054 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65" Jun 07 16:41:13.491265 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.491233 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7"] Jun 07 16:41:13.495399 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.495375 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.497791 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.497745 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 07 16:41:13.505856 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.505823 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7"] Jun 07 16:41:13.564680 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.564633 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.564680 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.564674 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.564961 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.564749 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcqh2\" (UniqueName: \"kubernetes.io/projected/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-kube-api-access-rcqh2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.564961 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.564856 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.564961 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.564906 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.564961 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.564937 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.666046 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.666001 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.666046 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.666047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.666307 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.666089 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.666307 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.666107 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.666307 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.666143 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcqh2\" (UniqueName: \"kubernetes.io/projected/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-kube-api-access-rcqh2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.666307 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.666176 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.666526 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.666467 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.666577 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.666519 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.666577 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.666529 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.668640 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.668620 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.668831 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.668813 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.675177 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.675145 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcqh2\" (UniqueName: \"kubernetes.io/projected/aae1704a-fc0f-41e4-9c0c-a14c3afdee2c-kube-api-access-rcqh2\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7\" (UID: \"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.807292 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.807249 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:13.955868 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:13.951663 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7"] Jun 07 16:41:14.739655 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:14.739616 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" event={"ID":"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c","Type":"ContainerStarted","Data":"97e7784a79419eb4d0c3bce2b46e3ccf9daeedadf359ac6b0d1796cd2a05fe75"} Jun 07 16:41:14.740135 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:14.739673 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" event={"ID":"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c","Type":"ContainerStarted","Data":"de5692a8a8275af2379de3ecb13317ba2200612d2f6fcf4ad60c47c61259c805"} Jun 07 16:41:16.750488 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:16.750453 2565 generic.go:356] "Generic (PLEG): container finished" podID="aae1704a-fc0f-41e4-9c0c-a14c3afdee2c" containerID="97e7784a79419eb4d0c3bce2b46e3ccf9daeedadf359ac6b0d1796cd2a05fe75" exitCode=0 Jun 07 16:41:16.750920 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:16.750525 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" event={"ID":"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c","Type":"ContainerDied","Data":"97e7784a79419eb4d0c3bce2b46e3ccf9daeedadf359ac6b0d1796cd2a05fe75"} Jun 07 16:41:17.759229 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:17.759188 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" event={"ID":"aae1704a-fc0f-41e4-9c0c-a14c3afdee2c","Type":"ContainerStarted","Data":"d741ebc642acd1182ebe5731e0eadd250896d84ecdf49f6bbd409df30e03d38b"} Jun 07 16:41:17.784477 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:17.784413 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" podStartSLOduration=2.5796588700000003 podStartE2EDuration="4.784388914s" totalImagesPullingTime="172.010971ms" totalInitContainerRuntime="2.032719073s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:41:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:41:17.782495007 +0000 UTC m=+855.986368280" watchObservedRunningTime="2026-06-07 16:41:17.784388914 +0000 UTC m=+855.988262190" Jun 07 16:41:23.808169 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:23.808113 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:23.808678 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:23.808221 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:23.820744 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:23.820714 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:41:24.806297 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:41:24.806261 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7" Jun 07 16:42:02.286483 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:42:02.286392 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:42:02.288818 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:42:02.288788 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:45:00.138913 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:00.138871 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn"] Jun 07 16:45:00.141946 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:00.141919 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" Jun 07 16:45:00.144386 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:00.144361 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"maas-api-dockercfg-959v7\"" Jun 07 16:45:00.150036 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:00.149382 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn"] Jun 07 16:45:00.168426 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:00.168391 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9ffk\" (UniqueName: \"kubernetes.io/projected/a97857e7-efd8-42df-b4bd-4c43d09e8cfb-kube-api-access-b9ffk\") pod \"maas-api-key-cleanup-29680845-j7fkn\" (UID: \"a97857e7-efd8-42df-b4bd-4c43d09e8cfb\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" Jun 07 16:45:00.269472 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:00.269436 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9ffk\" (UniqueName: \"kubernetes.io/projected/a97857e7-efd8-42df-b4bd-4c43d09e8cfb-kube-api-access-b9ffk\") pod \"maas-api-key-cleanup-29680845-j7fkn\" (UID: \"a97857e7-efd8-42df-b4bd-4c43d09e8cfb\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" Jun 07 16:45:00.278532 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:00.278499 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9ffk\" (UniqueName: \"kubernetes.io/projected/a97857e7-efd8-42df-b4bd-4c43d09e8cfb-kube-api-access-b9ffk\") pod \"maas-api-key-cleanup-29680845-j7fkn\" (UID: \"a97857e7-efd8-42df-b4bd-4c43d09e8cfb\") " pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" Jun 07 16:45:00.454097 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:00.454003 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" Jun 07 16:45:00.591263 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:00.591231 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn"] Jun 07 16:45:00.593560 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:45:00.593530 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97857e7_efd8_42df_b4bd_4c43d09e8cfb.slice/crio-d5b07a3651643c6a163fc46a1b5583905b30fb0651acb57560ed4e8d29dc3388 WatchSource:0}: Error finding container d5b07a3651643c6a163fc46a1b5583905b30fb0651acb57560ed4e8d29dc3388: Status 404 returned error can't find the container with id d5b07a3651643c6a163fc46a1b5583905b30fb0651acb57560ed4e8d29dc3388 Jun 07 16:45:00.595497 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:00.595481 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 16:45:00.793139 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:00.793100 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" event={"ID":"a97857e7-efd8-42df-b4bd-4c43d09e8cfb","Type":"ContainerStarted","Data":"d5b07a3651643c6a163fc46a1b5583905b30fb0651acb57560ed4e8d29dc3388"} Jun 07 16:45:04.815044 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:04.814999 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" event={"ID":"a97857e7-efd8-42df-b4bd-4c43d09e8cfb","Type":"ContainerStarted","Data":"2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d"} Jun 07 16:45:04.830198 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:45:04.830148 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" podStartSLOduration=0.969434739 podStartE2EDuration="4.830120801s" totalImagesPullingTime="3.860686062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 16:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:45:04.829104397 +0000 UTC m=+1083.032977671" watchObservedRunningTime="2026-06-07 16:45:04.830120801 +0000 UTC m=+1083.033994071" Jun 07 16:46:00.010252 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:00.010214 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn"] Jun 07 16:46:00.010804 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:00.010406 2565 kuberuntime_container.go:872] "Killing container with a grace period" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" podUID="a97857e7-efd8-42df-b4bd-4c43d09e8cfb" containerName="cleanup" containerID="cri-o://2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d" gracePeriod=30 Jun 07 16:46:30.196223 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.196193 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" Jun 07 16:46:30.221517 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.221476 2565 generic.go:356] "Generic (PLEG): container finished" podID="a97857e7-efd8-42df-b4bd-4c43d09e8cfb" containerID="2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d" exitCode=137 Jun 07 16:46:30.221517 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.221525 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" Jun 07 16:46:30.221865 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.221528 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" event={"ID":"a97857e7-efd8-42df-b4bd-4c43d09e8cfb","Type":"ContainerDied","Data":"2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d"} Jun 07 16:46:30.221865 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.221704 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn" event={"ID":"a97857e7-efd8-42df-b4bd-4c43d09e8cfb","Type":"ContainerDied","Data":"d5b07a3651643c6a163fc46a1b5583905b30fb0651acb57560ed4e8d29dc3388"} Jun 07 16:46:30.221865 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.221740 2565 scope.go:117] "RemoveContainer" containerID="2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d" Jun 07 16:46:30.230190 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.230171 2565 scope.go:117] "RemoveContainer" containerID="2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d" Jun 07 16:46:30.230497 ip-10-0-133-143 kubenswrapper[2565]: E0607 16:46:30.230473 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d\": container with ID starting with 2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d not found: ID does not exist" containerID="2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d" Jun 07 16:46:30.230547 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.230508 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d"} err="failed to get container status \"2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d\": rpc error: code = NotFound desc = could not find container \"2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d\": container with ID starting with 2a45ad1ae6aa0e503f309ee9c27547ea6d717f4d1dda24a5c452073c7422543d not found: ID does not exist" Jun 07 16:46:30.347012 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.346917 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9ffk\" (UniqueName: \"kubernetes.io/projected/a97857e7-efd8-42df-b4bd-4c43d09e8cfb-kube-api-access-b9ffk\") pod \"a97857e7-efd8-42df-b4bd-4c43d09e8cfb\" (UID: \"a97857e7-efd8-42df-b4bd-4c43d09e8cfb\") " Jun 07 16:46:30.349295 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.349270 2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a97857e7-efd8-42df-b4bd-4c43d09e8cfb-kube-api-access-b9ffk" (OuterVolumeSpecName: "kube-api-access-b9ffk") pod "a97857e7-efd8-42df-b4bd-4c43d09e8cfb" (UID: "a97857e7-efd8-42df-b4bd-4c43d09e8cfb"). InnerVolumeSpecName "kube-api-access-b9ffk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 16:46:30.447748 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.447707 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9ffk\" (UniqueName: \"kubernetes.io/projected/a97857e7-efd8-42df-b4bd-4c43d09e8cfb-kube-api-access-b9ffk\") on node \"ip-10-0-133-143.ec2.internal\" DevicePath \"\"" Jun 07 16:46:30.542332 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.542292 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn"] Jun 07 16:46:30.545985 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:30.545955 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["redhat-ai-gateway-infra/maas-api-key-cleanup-29680845-j7fkn"] Jun 07 16:46:32.294935 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:46:32.294900 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a97857e7-efd8-42df-b4bd-4c43d09e8cfb" path="/var/lib/kubelet/pods/a97857e7-efd8-42df-b4bd-4c43d09e8cfb/volumes" Jun 07 16:47:02.316241 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:02.316206 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:47:02.316843 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:02.316729 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-95fkp_bf9e7adf-2af8-4b34-b9d6-9b1d90f160ea/ovn-acl-logging/0.log" Jun 07 16:47:12.695488 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:12.695455 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6578896ff8-bc27f_7fe909cb-95cd-44c9-b0b4-1a8996295832/nginx/0.log" Jun 07 16:47:12.916376 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:12.916339 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-bb9gs_fe34a8fe-dd96-4234-9a49-445043eaf607/manager/0.log" Jun 07 16:47:13.043419 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:13.043380 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-hmzt9_b57558f0-b796-4992-8679-e04973d4a2b6/manager/0.log" Jun 07 16:47:13.276587 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:13.276558 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sx6b7_9b98fa15-c9fa-4a88-be86-6cc3e98dad4c/server/0.log" Jun 07 16:47:13.402069 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:13.401979 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-llvwb_fa97ca69-8645-4a65-a336-24044deff8dd/manager/0.log" Jun 07 16:47:13.525018 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:13.524983 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-4nv22_c3fcc5c6-b7fe-4761-90b9-c382431554a6/manager/0.log" Jun 07 16:47:13.534432 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:13.534407 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-4nv22_c3fcc5c6-b7fe-4761-90b9-c382431554a6/copy-manifests/0.log" Jun 07 16:47:16.329534 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:16.329483 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7kxq4_fc466af0-f631-4f07-adc1-c42d5e37732a/discovery/0.log" Jun 07 16:47:16.447902 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:16.447874 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786f88c98-fltjs_75463f35-91ee-4a55-95a5-aeb471fcaf07/kube-auth-proxy/0.log" Jun 07 16:47:16.680795 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:16.680682 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zhjwz_dec669b0-f2d1-479b-8e1f-bb8933ce93e3/istio-proxy/1.log" Jun 07 16:47:16.800711 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:16.800671 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-8zknl_e41894fa-2a26-4b76-accc-ce06c252d541/payload-pre-processing/0.log" Jun 07 16:47:17.617289 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:17.617250 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65_4639bc4b-5382-467b-aabb-07eaa86d2d1e/storage-initializer/0.log" Jun 07 16:47:17.625643 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:17.625616 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-mjj65_4639bc4b-5382-467b-aabb-07eaa86d2d1e/main/0.log" Jun 07 16:47:17.740414 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:17.740381 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7_aae1704a-fc0f-41e4-9c0c-a14c3afdee2c/storage-initializer/0.log" Jun 07 16:47:17.749069 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:17.749038 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cf8ht7_aae1704a-fc0f-41e4-9c0c-a14c3afdee2c/main/0.log" Jun 07 16:47:24.602394 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:24.602354 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wrsz8_d1ae50c5-29b5-41aa-af9e-082fcf808170/global-pull-secret-syncer/0.log" Jun 07 16:47:24.674937 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:24.674905 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-828b6_4babfa83-0a29-4eee-a10b-e49cae1ba10d/konnectivity-agent/0.log" Jun 07 16:47:24.747201 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:24.747159 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-143.ec2.internal_56149dfbdfcaf47e3122c7dfcc85ae60/haproxy/0.log" Jun 07 16:47:28.861283 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:28.861248 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-operators_servicemesh-operator3-57f65f65fb-n9gnf_5fb44611-13f3-48cf-afb6-6580dc72d3dd/sail-operator/0.log" Jun 07 16:47:32.222298 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:32.222269 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-58pgg_1215740a-c6c9-442e-b74b-9be1f4109551/node-exporter/0.log" Jun 07 16:47:32.249236 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:32.249207 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-58pgg_1215740a-c6c9-442e-b74b-9be1f4109551/kube-rbac-proxy/0.log" Jun 07 16:47:32.291319 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:32.291290 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-58pgg_1215740a-c6c9-442e-b74b-9be1f4109551/init-textfile/0.log" Jun 07 16:47:35.229775 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.229715 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6"] Jun 07 16:47:35.230343 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.230223 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a97857e7-efd8-42df-b4bd-4c43d09e8cfb" containerName="cleanup" Jun 07 16:47:35.230343 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.230243 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a97857e7-efd8-42df-b4bd-4c43d09e8cfb" containerName="cleanup" Jun 07 16:47:35.230343 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.230337 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="a97857e7-efd8-42df-b4bd-4c43d09e8cfb" containerName="cleanup" Jun 07 16:47:35.232960 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.232937 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.235381 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.235354 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-nhgnq\"/\"default-dockercfg-2z7nd\"" Jun 07 16:47:35.235537 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.235520 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nhgnq\"/\"openshift-service-ca.crt\"" Jun 07 16:47:35.236465 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.236445 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-nhgnq\"/\"kube-root-ca.crt\"" Jun 07 16:47:35.243575 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.243546 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6"] Jun 07 16:47:35.295841 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.295801 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-lib-modules\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.296043 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.295908 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-podres\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.296043 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.295969 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gtzt\" (UniqueName: \"kubernetes.io/projected/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-kube-api-access-4gtzt\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.296185 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.296148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-sys\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.296299 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.296203 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-proc\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.397278 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.397236 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-lib-modules\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.397458 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.397299 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-podres\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.397458 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.397330 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gtzt\" (UniqueName: \"kubernetes.io/projected/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-kube-api-access-4gtzt\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.397458 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.397362 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-sys\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.397458 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.397383 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-proc\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.397458 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.397436 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-lib-modules\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.397640 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.397452 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-sys\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.397640 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.397469 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-proc\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.397640 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.397483 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-podres\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.405437 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.405403 2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gtzt\" (UniqueName: \"kubernetes.io/projected/fcebd6b0-d9cd-4b67-842d-cf1abe2f8030-kube-api-access-4gtzt\") pod \"perf-node-gather-daemonset-txkc6\" (UID: \"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030\") " pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.544605 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.544566 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:35.689078 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:35.689045 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6"] Jun 07 16:47:35.691916 ip-10-0-133-143 kubenswrapper[2565]: W0607 16:47:35.691881 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfcebd6b0_d9cd_4b67_842d_cf1abe2f8030.slice/crio-9c53741c0b77ede4b2d103d85f23e0c067c190540a690ae3e8fe88826d505a76 WatchSource:0}: Error finding container 9c53741c0b77ede4b2d103d85f23e0c067c190540a690ae3e8fe88826d505a76: Status 404 returned error can't find the container with id 9c53741c0b77ede4b2d103d85f23e0c067c190540a690ae3e8fe88826d505a76 Jun 07 16:47:36.533941 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:36.533898 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" event={"ID":"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030","Type":"ContainerStarted","Data":"f2555cd62fc92d05b40ff9b740760cf381d36a081f769477e7464ddc6fdde420"} Jun 07 16:47:36.534438 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:36.533961 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" event={"ID":"fcebd6b0-d9cd-4b67-842d-cf1abe2f8030","Type":"ContainerStarted","Data":"9c53741c0b77ede4b2d103d85f23e0c067c190540a690ae3e8fe88826d505a76"} Jun 07 16:47:36.534438 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:36.534039 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:36.551034 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:36.550975 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" podStartSLOduration=1.550958932 podStartE2EDuration="1.550958932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 16:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 16:47:36.549525315 +0000 UTC m=+1234.753398588" watchObservedRunningTime="2026-06-07 16:47:36.550958932 +0000 UTC m=+1234.754832204" Jun 07 16:47:37.430112 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:37.430080 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d7k2w_4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec/dns/0.log" Jun 07 16:47:37.450464 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:37.450434 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-d7k2w_4cc5a9ae-9c6c-441d-bb79-34d4a9f1f3ec/kube-rbac-proxy/0.log" Jun 07 16:47:37.572023 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:37.571993 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p6kgd_d1ca383f-3d23-47a0-9d10-5203404b496a/dns-node-resolver/0.log" Jun 07 16:47:38.126227 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:38.126200 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mj69l_2d2c42f9-769c-4b4d-90ac-2f0fd9e3f69e/node-ca/0.log" Jun 07 16:47:39.143177 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:39.143129 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7kxq4_fc466af0-f631-4f07-adc1-c42d5e37732a/discovery/0.log" Jun 07 16:47:39.163413 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:39.163383 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786f88c98-fltjs_75463f35-91ee-4a55-95a5-aeb471fcaf07/kube-auth-proxy/0.log" Jun 07 16:47:39.220452 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:39.220415 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zhjwz_dec669b0-f2d1-479b-8e1f-bb8933ce93e3/istio-proxy/0.log" Jun 07 16:47:39.234976 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:39.234942 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zhjwz_dec669b0-f2d1-479b-8e1f-bb8933ce93e3/istio-proxy/1.log" Jun 07 16:47:39.271419 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:39.271387 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-8zknl_e41894fa-2a26-4b76-accc-ce06c252d541/payload-pre-processing/0.log" Jun 07 16:47:39.969170 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:39.969127 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-jc2wf_ad0e2266-63fa-4b2b-9891-1af906de0c51/serve-healthcheck-canary/0.log" Jun 07 16:47:40.509214 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:40.509180 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8v9jb_51e560dd-6bb4-4901-95db-370271187796/kube-rbac-proxy/0.log" Jun 07 16:47:40.531699 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:40.531667 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8v9jb_51e560dd-6bb4-4901-95db-370271187796/exporter/0.log" Jun 07 16:47:40.553346 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:40.553305 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-8v9jb_51e560dd-6bb4-4901-95db-370271187796/extractor/0.log" Jun 07 16:47:42.548815 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:42.548782 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-nhgnq/perf-node-gather-daemonset-txkc6" Jun 07 16:47:42.867326 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:42.867239 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-6578896ff8-bc27f_7fe909cb-95cd-44c9-b0b4-1a8996295832/nginx/0.log" Jun 07 16:47:42.916789 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:42.916742 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-69fc866d76-bb9gs_fe34a8fe-dd96-4234-9a49-445043eaf607/manager/0.log" Jun 07 16:47:42.985881 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:42.985845 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-864bfd7bc9-hmzt9_b57558f0-b796-4992-8679-e04973d4a2b6/manager/0.log" Jun 07 16:47:43.031232 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:43.031197 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-5dd488fc48-sx6b7_9b98fa15-c9fa-4a88-be86-6cc3e98dad4c/server/0.log" Jun 07 16:47:43.100250 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:43.100221 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-6dc94f689f-llvwb_fa97ca69-8645-4a65-a336-24044deff8dd/manager/0.log" Jun 07 16:47:43.182279 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:43.182190 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-4nv22_c3fcc5c6-b7fe-4761-90b9-c382431554a6/manager/0.log" Jun 07 16:47:43.198659 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:43.198628 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-768db79f96-4nv22_c3fcc5c6-b7fe-4761-90b9-c382431554a6/copy-manifests/0.log" Jun 07 16:47:49.601905 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:49.601864 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7kxq4_fc466af0-f631-4f07-adc1-c42d5e37732a/discovery/0.log" Jun 07 16:47:49.612951 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:49.612914 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786f88c98-fltjs_75463f35-91ee-4a55-95a5-aeb471fcaf07/kube-auth-proxy/0.log" Jun 07 16:47:49.650618 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:49.650578 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zhjwz_dec669b0-f2d1-479b-8e1f-bb8933ce93e3/istio-proxy/0.log" Jun 07 16:47:49.666302 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:49.666262 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zhjwz_dec669b0-f2d1-479b-8e1f-bb8933ce93e3/istio-proxy/1.log" Jun 07 16:47:49.691992 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:49.691903 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-8zknl_e41894fa-2a26-4b76-accc-ce06c252d541/payload-pre-processing/0.log" Jun 07 16:47:50.878102 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:50.878070 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-75c67f8887-7kxq4_fc466af0-f631-4f07-adc1-c42d5e37732a/discovery/0.log" Jun 07 16:47:50.889362 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:50.889318 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-786f88c98-fltjs_75463f35-91ee-4a55-95a5-aeb471fcaf07/kube-auth-proxy/0.log" Jun 07 16:47:50.925999 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:50.925964 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zhjwz_dec669b0-f2d1-479b-8e1f-bb8933ce93e3/istio-proxy/0.log" Jun 07 16:47:50.940589 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:50.940553 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-zhjwz_dec669b0-f2d1-479b-8e1f-bb8933ce93e3/istio-proxy/1.log" Jun 07 16:47:50.965652 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:50.965612 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-8zknl_e41894fa-2a26-4b76-accc-ce06c252d541/payload-pre-processing/0.log" Jun 07 16:47:51.771600 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:51.771569 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7jqtk_15582473-22c1-490c-965f-50d3ad3edb0d/kube-multus/0.log" Jun 07 16:47:52.115478 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:52.115393 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmpj6_73c30ff5-7ddf-4957-9100-db90b88afc15/kube-multus-additional-cni-plugins/0.log" Jun 07 16:47:52.138448 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:52.138415 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmpj6_73c30ff5-7ddf-4957-9100-db90b88afc15/egress-router-binary-copy/0.log" Jun 07 16:47:52.161667 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:52.161635 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmpj6_73c30ff5-7ddf-4957-9100-db90b88afc15/cni-plugins/0.log" Jun 07 16:47:52.184205 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:52.184177 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmpj6_73c30ff5-7ddf-4957-9100-db90b88afc15/bond-cni-plugin/0.log" Jun 07 16:47:52.205823 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:52.205793 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmpj6_73c30ff5-7ddf-4957-9100-db90b88afc15/routeoverride-cni/0.log" Jun 07 16:47:52.227429 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:52.227400 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmpj6_73c30ff5-7ddf-4957-9100-db90b88afc15/whereabouts-cni-bincopy/0.log" Jun 07 16:47:52.248288 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:52.248256 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-vmpj6_73c30ff5-7ddf-4957-9100-db90b88afc15/whereabouts-cni/0.log" Jun 07 16:47:52.338219 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:52.338191 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f4wl2_d12ea486-aafe-455d-9f01-565eabcf0ca0/network-metrics-daemon/0.log" Jun 07 16:47:52.357847 ip-10-0-133-143 kubenswrapper[2565]: I0607 16:47:52.357812 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-f4wl2_d12ea486-aafe-455d-9f01-565eabcf0ca0/kube-rbac-proxy/0.log"