Jul 21 16:24:04.691455 ip-10-0-130-54 systemd[1]: Starting Kubernetes Kubelet... Jul 21 16:24:05.213979 ip-10-0-130-54 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 16:24:05.213979 ip-10-0-130-54 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 21 16:24:05.213979 ip-10-0-130-54 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 16:24:05.213979 ip-10-0-130-54 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 21 16:24:05.213979 ip-10-0-130-54 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 21 16:24:05.215062 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.214898 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 21 16:24:05.220027 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220005 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 16:24:05.220027 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220025 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 16:24:05.220027 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220030 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 16:24:05.220027 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220035 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220040 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220046 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220050 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220056 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220061 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220065 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220068 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220073 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220077 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220081 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220086 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220089 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220093 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220097 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220102 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220106 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220110 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220115 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220119 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 16:24:05.220285 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220123 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220128 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220132 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220136 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220140 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220145 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220149 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220154 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220158 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220164 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220168 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220173 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220177 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220183 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220188 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220193 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220198 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220202 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220207 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220214 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 16:24:05.221172 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220218 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220223 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220227 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220232 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220237 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220241 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220245 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220250 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220255 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220260 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220269 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220275 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220280 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220285 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220289 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220294 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220300 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220305 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220310 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 16:24:05.222065 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220314 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220319 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220324 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220328 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220333 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220339 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220345 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220352 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220357 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220362 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220366 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220370 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220375 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220381 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220397 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220402 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220406 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220411 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220416 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220421 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 16:24:05.222938 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220426 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220430 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220435 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220440 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220444 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220449 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220454 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220458 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220462 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220467 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220474 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220478 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220485 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220491 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220496 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220501 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.220507 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221784 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221794 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 16:24:05.223838 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221801 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221806 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221811 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221816 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221840 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221845 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221849 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221855 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221860 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221864 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221868 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221873 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221877 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221885 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221891 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221895 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221900 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221904 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221909 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 16:24:05.224683 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221914 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221919 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221923 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221927 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221934 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221941 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221946 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221951 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221955 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221960 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221965 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221969 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221974 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221979 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221983 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221989 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221995 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.221999 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222004 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 16:24:05.225417 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222008 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222015 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222022 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222027 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222032 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222036 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222041 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222045 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222050 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222054 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222059 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222063 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222067 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222071 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222075 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222080 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222084 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222089 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222093 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 16:24:05.225952 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222098 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222102 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222107 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222111 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222115 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222121 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222126 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222131 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222135 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222139 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222144 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222148 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222153 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222157 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222162 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222167 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222172 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222179 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222184 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222188 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222192 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 16:24:05.226494 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222196 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222200 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222204 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222210 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222214 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222219 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222223 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222228 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222232 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222237 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222241 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222245 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222250 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222255 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222259 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222263 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222269 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222273 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222278 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222967 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 16:24:05.227288 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222976 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222981 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222987 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222991 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.222996 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223000 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223005 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223011 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223015 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223020 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223025 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223029 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223034 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223039 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223043 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223048 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223053 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223057 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223061 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223066 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 16:24:05.227850 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223070 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223074 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223079 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223083 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223089 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223093 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223097 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223102 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223106 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223111 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223119 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223123 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223128 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223132 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223139 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223146 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223151 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223157 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223161 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 16:24:05.228578 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223166 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223171 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223176 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223181 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223185 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223190 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223195 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223200 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223204 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223209 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223213 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223218 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223223 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223228 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223232 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223237 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223242 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223247 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223252 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223256 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 16:24:05.229105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223261 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223265 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223270 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223276 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223281 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223285 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223290 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223295 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223299 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223305 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223310 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223315 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223319 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223324 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223329 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223334 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223338 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223342 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223347 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 16:24:05.229652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223351 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223356 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223364 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223371 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223375 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223381 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223386 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223390 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223395 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223400 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223404 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223409 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223414 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223418 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223423 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223427 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223433 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223438 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223443 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.223447 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 16:24:05.230152 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223558 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223570 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223582 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223589 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223596 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223602 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223608 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223622 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223629 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223634 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223640 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223646 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223652 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223658 2564 flags.go:64] FLAG: --cgroup-root="" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223663 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223668 2564 flags.go:64] FLAG: --client-ca-file="" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223673 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223678 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223685 2564 flags.go:64] FLAG: --cluster-domain="" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223690 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223696 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223701 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223707 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223713 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 21 16:24:05.230667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223719 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223724 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223730 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223735 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223744 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223749 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223755 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223760 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223767 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223772 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223777 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223782 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223788 2564 flags.go:64] FLAG: --enable-server="true" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223793 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223801 2564 flags.go:64] FLAG: --event-burst="100" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223807 2564 flags.go:64] FLAG: --event-qps="50" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223811 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223836 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223842 2564 flags.go:64] FLAG: --eviction-hard="" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223851 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223856 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223861 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223866 2564 flags.go:64] FLAG: --eviction-soft="" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223871 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223876 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 21 16:24:05.231356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223881 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223886 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223891 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223897 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223902 2564 flags.go:64] FLAG: --feature-gates="" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223909 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223914 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223919 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223924 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223929 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223935 2564 flags.go:64] FLAG: --help="false" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223941 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223946 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223951 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223956 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223961 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223968 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223973 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223978 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223983 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223988 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223992 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.223998 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224003 2564 flags.go:64] FLAG: --kube-reserved="" Jul 21 16:24:05.232470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224007 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224016 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224025 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224030 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224035 2564 flags.go:64] FLAG: --lock-file="" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224039 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224044 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224049 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224059 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224064 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224070 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224075 2564 flags.go:64] FLAG: --logging-format="text" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224080 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224086 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224090 2564 flags.go:64] FLAG: --manifest-url="" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224095 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224102 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224107 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224114 2564 flags.go:64] FLAG: --max-pods="110" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224120 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224125 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224130 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224135 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224140 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224146 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 21 16:24:05.233578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224152 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224164 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224170 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224175 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224181 2564 flags.go:64] FLAG: --pod-cidr="" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224186 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224195 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224200 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224206 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224215 2564 flags.go:64] FLAG: --port="10250" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224221 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224225 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-02d86d923f53c36bd" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224231 2564 flags.go:64] FLAG: --qos-reserved="" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224236 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224241 2564 flags.go:64] FLAG: --register-node="true" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224246 2564 flags.go:64] FLAG: --register-with-taints="" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224252 2564 flags.go:64] FLAG: --registry-burst="10" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224258 2564 flags.go:64] FLAG: --registry-qps="5" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224263 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224268 2564 flags.go:64] FLAG: --reserved-memory="" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224274 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224280 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224286 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224290 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224295 2564 flags.go:64] FLAG: --runonce="false" Jul 21 16:24:05.234721 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224300 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224306 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224311 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224316 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224321 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224326 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224332 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224337 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224341 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224347 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224351 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224356 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224362 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224366 2564 flags.go:64] FLAG: --system-cgroups="" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224371 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224380 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224387 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224393 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224402 2564 flags.go:64] FLAG: --tls-min-version="" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224407 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224412 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224417 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224421 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224427 2564 flags.go:64] FLAG: --v="2" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224433 2564 flags.go:64] FLAG: --version="false" Jul 21 16:24:05.235780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224440 2564 flags.go:64] FLAG: --vmodule="" Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224446 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.224452 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224647 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224655 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224660 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224665 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224670 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224674 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224679 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224683 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224688 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224692 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224697 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224701 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224706 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224710 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224715 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224730 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 16:24:05.236699 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224735 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224739 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224744 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224748 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224758 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224763 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224768 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224773 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224777 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224782 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224786 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224791 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224795 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224799 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224804 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224808 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224813 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224833 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224839 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224844 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 16:24:05.237601 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224851 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224856 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224860 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224865 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224869 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224873 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224877 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224882 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224887 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224892 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224899 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224905 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224911 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224916 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224920 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224925 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224931 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224936 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224941 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 16:24:05.238464 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224946 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224951 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224958 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224964 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224969 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224974 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224980 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224984 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224989 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224994 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.224999 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225004 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225008 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225016 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225021 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225025 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225030 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225035 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225039 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225043 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 16:24:05.239158 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225048 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225052 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225057 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225061 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225066 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225070 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225075 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225079 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225083 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225091 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225096 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225101 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225105 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225115 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225120 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225125 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225129 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225134 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225138 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225143 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 16:24:05.239674 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225147 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225152 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225158 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.225165 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.225876 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.233975 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.233995 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.234023 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.234033 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234119 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234128 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234135 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234141 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234147 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 16:24:05.240207 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234152 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234157 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234162 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234166 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234171 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234175 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234179 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234185 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234190 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234194 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234200 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234204 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234208 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234213 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234218 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234223 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234229 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234235 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234241 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 16:24:05.240576 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234246 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234250 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234255 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234260 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234264 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234270 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234274 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234279 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234283 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234288 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234293 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234297 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234301 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234306 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234310 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234315 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234319 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234325 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234332 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234337 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 16:24:05.241074 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234342 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234346 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234351 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234356 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234360 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234364 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234369 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234373 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234378 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234382 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234386 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234391 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234395 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234400 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234404 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234408 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234413 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234418 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234431 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234436 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 16:24:05.241583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234440 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234445 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234449 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234454 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234458 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234462 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234466 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234471 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234476 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234480 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234484 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234489 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234494 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234498 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234503 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234507 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234511 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234516 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234520 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234525 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 16:24:05.242129 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234529 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234534 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234538 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234543 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234547 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234551 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234555 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234560 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234565 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234569 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234573 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234579 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234583 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234587 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234592 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 16:24:05.242653 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.234601 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234789 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234798 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234803 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234808 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234813 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234834 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234840 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234845 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234850 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234854 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234859 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234864 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234868 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234873 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234878 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234882 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234887 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234893 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 21 16:24:05.243105 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234899 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234904 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234908 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234912 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234917 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234922 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234926 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234930 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234935 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234940 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234945 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234950 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234954 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234958 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234963 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234967 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234971 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234976 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234980 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234984 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 21 16:24:05.243583 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234989 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234994 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.234998 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235002 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235007 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235012 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235017 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235021 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235026 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235030 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235034 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235039 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235043 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235047 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235052 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235056 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235061 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235065 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235070 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235074 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 21 16:24:05.244112 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235081 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235086 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235090 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235096 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235101 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235106 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235110 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235115 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235122 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235128 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235133 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235138 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235143 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235149 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235153 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235158 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235162 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235167 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235172 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 21 16:24:05.244627 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235176 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235181 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235185 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235190 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235194 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235199 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235204 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235208 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235213 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235217 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235221 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235226 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235230 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235239 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235245 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235250 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235255 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235260 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235265 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 21 16:24:05.245126 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235269 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 21 16:24:05.245606 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235273 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 21 16:24:05.245606 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:05.235278 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 21 16:24:05.245606 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.235287 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 21 16:24:05.245606 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.235484 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 21 16:24:05.245606 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.242172 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 21 16:24:05.245606 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.243478 2564 server.go:1019] "Starting client certificate rotation" Jul 21 16:24:05.245606 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.243586 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 16:24:05.245606 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.244320 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 21 16:24:05.245953 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.245939 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 16:24:05.247259 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.247239 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 21 16:24:05.261521 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.261497 2564 log.go:25] "Validated CRI v1 runtime API" Jul 21 16:24:05.263696 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.263677 2564 log.go:25] "Validated CRI v1 image API" Jul 21 16:24:05.264621 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.264602 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 21 16:24:05.268898 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.268877 2564 fs.go:135] Filesystem UUIDs: map[4a1b3a1d-419f-4a6b-9ae2-c7eb1eec8a56:/dev/nvme0n1p4 5eb3709d-8067-4e35-a552-bfa4f2111e2b:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 21 16:24:05.268976 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.268897 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 21 16:24:05.274996 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.274866 2564 manager.go:216] Machine: {Timestamp:2026-07-21 16:24:05.273437347 +0000 UTC m=+0.341518021 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3082062 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d27c1cff8c00034825299b10339b2 SystemUUID:ec2d27c1-cff8-c000-3482-5299b10339b2 BootID:9aab1fe6-eacc-4aca-9869-a7d9689d1d8b Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ad:85:fe:a2:63 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ad:85:fe:a2:63 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:0a:07:63:63:74:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 21 16:24:05.274996 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.274984 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 21 16:24:05.275141 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.275109 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 21 16:24:05.276538 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.276521 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 16:24:05.277768 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.277740 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 21 16:24:05.277969 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.277774 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-54.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 21 16:24:05.278495 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.278484 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 21 16:24:05.278534 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.278498 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 21 16:24:05.278534 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.278506 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 16:24:05.279317 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.279305 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 21 16:24:05.280612 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.280601 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 21 16:24:05.283700 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.283688 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 21 16:24:05.283850 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.283839 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 21 16:24:05.283894 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.283880 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 21 16:24:05.283925 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.283904 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 21 16:24:05.283925 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.283920 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 21 16:24:05.283980 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.283933 2564 kubelet.go:398] "Adding apiserver pod source" Jul 21 16:24:05.283980 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.283942 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 21 16:24:05.284333 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.284320 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 16:24:05.284378 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.284340 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 21 16:24:05.287706 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.287466 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 21 16:24:05.290822 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.290801 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 21 16:24:05.291061 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.291046 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 21 16:24:05.292173 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292159 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 21 16:24:05.292238 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292176 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 21 16:24:05.292238 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292183 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 21 16:24:05.292238 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292189 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 21 16:24:05.292238 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292198 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 21 16:24:05.292238 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292204 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 21 16:24:05.292238 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292212 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 21 16:24:05.292238 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292218 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 21 16:24:05.292238 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292225 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 21 16:24:05.292238 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292231 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 21 16:24:05.292238 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292240 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 21 16:24:05.292238 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292246 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 21 16:24:05.292936 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292925 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 21 16:24:05.292936 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.292935 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 21 16:24:05.296229 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.296214 2564 server.go:1268] "Started kubelet" Jul 21 16:24:05.296383 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.296324 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 21 16:24:05.296461 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.296407 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 21 16:24:05.296461 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.296333 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 21 16:24:05.297202 ip-10-0-130-54 systemd[1]: Started Kubernetes Kubelet. Jul 21 16:24:05.298294 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.298275 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 21 16:24:05.298678 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.298663 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 21 16:24:05.301603 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.301576 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-54.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 21 16:24:05.301701 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.301605 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 21 16:24:05.301783 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.301715 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 21 16:24:05.302379 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.302359 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 21 16:24:05.302560 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.301550 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-54.ec2.internal.18c45aab92e8a0f9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-54.ec2.internal,UID:ip-10-0-130-54.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-54.ec2.internal,},FirstTimestamp:2026-07-21 16:24:05.296185593 +0000 UTC m=+0.364266265,LastTimestamp:2026-07-21 16:24:05.296185593 +0000 UTC m=+0.364266265,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-54.ec2.internal,}" Jul 21 16:24:05.304508 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.304492 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 21 16:24:05.304508 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.304506 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 21 16:24:05.304652 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.304623 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:05.305176 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.305159 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 21 16:24:05.305176 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.305161 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 21 16:24:05.305303 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.305186 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 21 16:24:05.305303 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.305252 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 21 16:24:05.305303 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.305263 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 21 16:24:05.305434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.305365 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 21 16:24:05.305434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.305380 2564 factory.go:55] Registering systemd factory Jul 21 16:24:05.305434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.305390 2564 factory.go:223] Registration of the systemd container factory successfully Jul 21 16:24:05.306393 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.306154 2564 factory.go:153] Registering CRI-O factory Jul 21 16:24:05.306393 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.306172 2564 factory.go:223] Registration of the crio container factory successfully Jul 21 16:24:05.306393 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.306198 2564 factory.go:103] Registering Raw factory Jul 21 16:24:05.306393 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.306230 2564 manager.go:1196] Started watching for new ooms in manager Jul 21 16:24:05.306845 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.306814 2564 manager.go:349] Starting recovery of all containers Jul 21 16:24:05.307747 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.307717 2564 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-54.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 21 16:24:05.307866 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.307809 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 21 16:24:05.310099 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.310066 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x2dfx" Jul 21 16:24:05.317160 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.317147 2564 manager.go:354] Recovery completed Jul 21 16:24:05.318343 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.318304 2564 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 21 16:24:05.319971 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.319943 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-x2dfx" Jul 21 16:24:05.323287 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.323272 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 16:24:05.325554 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.325532 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory" Jul 21 16:24:05.325636 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.325569 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 16:24:05.325636 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.325581 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID" Jul 21 16:24:05.326118 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.326104 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 21 16:24:05.326118 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.326116 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 21 16:24:05.326217 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.326132 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 21 16:24:05.326217 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.326171 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 16:24:05.326930 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.326909 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory" Jul 21 16:24:05.327022 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.326944 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 16:24:05.327022 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.326959 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID" Jul 21 16:24:05.327300 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.327287 2564 policy_none.go:49] "None policy: Start" Jul 21 16:24:05.327341 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.327304 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 21 16:24:05.327341 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.327315 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 21 16:24:05.328377 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.328366 2564 policy_none.go:47] "Start" Jul 21 16:24:05.367679 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.367509 2564 manager.go:337] "Starting Device Plugin manager" Jul 21 16:24:05.367832 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.367698 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 21 16:24:05.367832 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.367713 2564 server.go:87] "Starting device plugin registration server" Jul 21 16:24:05.368056 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.368041 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 21 16:24:05.368126 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.368060 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 21 16:24:05.368214 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.368176 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 21 16:24:05.368372 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.368293 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 21 16:24:05.368372 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.368303 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 21 16:24:05.368890 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.368867 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 21 16:24:05.368992 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.368919 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:05.469842 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.469714 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 16:24:05.470894 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.470780 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory" Jul 21 16:24:05.470894 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.470811 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 16:24:05.470894 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.470829 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID" Jul 21 16:24:05.470894 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.470858 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.476295 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.476265 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.476295 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.476291 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-54.ec2.internal\": node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:05.494616 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.494585 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:05.536442 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.536408 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 21 16:24:05.537806 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.537784 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 21 16:24:05.537927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.537853 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 21 16:24:05.537927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.537881 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 21 16:24:05.537927 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.537918 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 21 16:24:05.540255 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.540234 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 16:24:05.596420 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.596390 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:05.640158 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.640109 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal"] Jul 21 16:24:05.640248 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.640201 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 16:24:05.642421 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.642402 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory" Jul 21 16:24:05.642526 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.642440 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 16:24:05.642526 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.642454 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID" Jul 21 16:24:05.643977 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.643959 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 16:24:05.644080 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.644065 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.644134 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.644095 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 16:24:05.644807 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.644790 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory" Jul 21 16:24:05.644908 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.644826 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 16:24:05.644908 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.644843 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID" Jul 21 16:24:05.644908 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.644862 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory" Jul 21 16:24:05.644908 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.644885 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 16:24:05.644908 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.644898 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID" Jul 21 16:24:05.646108 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.646094 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.646158 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.646121 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 21 16:24:05.647162 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.647145 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientMemory" Jul 21 16:24:05.647253 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.647179 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasNoDiskPressure" Jul 21 16:24:05.647253 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.647194 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeHasSufficientPID" Jul 21 16:24:05.671517 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.671491 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-54.ec2.internal\" not found" node="ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.676273 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.676255 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-54.ec2.internal\" not found" node="ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.696526 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.696498 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:05.708605 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.708577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/317f49df52d0c5c3171427f046cacf08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"317f49df52d0c5c3171427f046cacf08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.708699 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.708607 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/317f49df52d0c5c3171427f046cacf08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"317f49df52d0c5c3171427f046cacf08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.708699 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.708625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfdb6b3273ab625922b8832a1abf7ed-config\") pod \"kube-apiserver-proxy-ip-10-0-130-54.ec2.internal\" (UID: \"2cfdb6b3273ab625922b8832a1abf7ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.797042 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.796952 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:05.809328 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.809296 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfdb6b3273ab625922b8832a1abf7ed-config\") pod \"kube-apiserver-proxy-ip-10-0-130-54.ec2.internal\" (UID: \"2cfdb6b3273ab625922b8832a1abf7ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.809423 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.809332 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/317f49df52d0c5c3171427f046cacf08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"317f49df52d0c5c3171427f046cacf08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.809423 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.809350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/317f49df52d0c5c3171427f046cacf08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"317f49df52d0c5c3171427f046cacf08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.809423 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.809396 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/2cfdb6b3273ab625922b8832a1abf7ed-config\") pod \"kube-apiserver-proxy-ip-10-0-130-54.ec2.internal\" (UID: \"2cfdb6b3273ab625922b8832a1abf7ed\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.809423 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.809412 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/317f49df52d0c5c3171427f046cacf08-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"317f49df52d0c5c3171427f046cacf08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.809631 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.809464 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/317f49df52d0c5c3171427f046cacf08-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal\" (UID: \"317f49df52d0c5c3171427f046cacf08\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.903702 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:05.903645 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:05.979997 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.979947 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" Jul 21 16:24:05.980128 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:05.979946 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" Jul 21 16:24:06.004458 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:06.004435 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:06.110926 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:06.110830 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:06.211788 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:06.211737 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:06.243054 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.243009 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 21 16:24:06.243513 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.243180 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 21 16:24:06.312079 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:06.312051 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:06.324384 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.324350 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-20 16:19:06 +0000 UTC" deadline="2028-05-06 11:54:46.187489004 +0000 UTC" Jul 21 16:24:06.324384 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.324380 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15715h30m39.863112005s" Jul 21 16:24:06.412228 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:06.412115 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-54.ec2.internal\" not found" Jul 21 16:24:06.461052 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.461019 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 16:24:06.506336 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.506304 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 16:24:06.605522 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.605482 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" Jul 21 16:24:06.617532 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.617501 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 16:24:06.619320 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.619298 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" Jul 21 16:24:06.629286 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.629270 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 21 16:24:06.704032 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.703953 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 16:24:06.725137 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:06.725100 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cfdb6b3273ab625922b8832a1abf7ed.slice/crio-2db4199cf7b90bc0cb4bebe4c9c24be1910a8cf713e02df8a0fe2fc5e533b135 WatchSource:0}: Error finding container 2db4199cf7b90bc0cb4bebe4c9c24be1910a8cf713e02df8a0fe2fc5e533b135: Status 404 returned error can't find the container with id 2db4199cf7b90bc0cb4bebe4c9c24be1910a8cf713e02df8a0fe2fc5e533b135 Jul 21 16:24:06.725478 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:06.725459 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317f49df52d0c5c3171427f046cacf08.slice/crio-1185a2cec1f9985dac6fac7d7893c3dd3011136bbc3b7daba39f53653b0d0b1b WatchSource:0}: Error finding container 1185a2cec1f9985dac6fac7d7893c3dd3011136bbc3b7daba39f53653b0d0b1b: Status 404 returned error can't find the container with id 1185a2cec1f9985dac6fac7d7893c3dd3011136bbc3b7daba39f53653b0d0b1b Jul 21 16:24:06.731717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:06.731699 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 16:24:07.286927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.286897 2564 apiserver.go:52] "Watching apiserver" Jul 21 16:24:07.297215 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.295814 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 21 16:24:07.297215 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.296851 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal","openshift-multus/multus-additional-cni-plugins-glgxw","kube-system/global-pull-secret-syncer-c7pb5","kube-system/konnectivity-agent-fndhg","openshift-image-registry/node-ca-95ppj","openshift-multus/multus-mzfbt","openshift-multus/network-metrics-daemon-nvgjf","openshift-network-diagnostics/network-check-target-7pmmh","openshift-network-operator/iptables-alerter-2hnb8","openshift-ovn-kubernetes/ovnkube-node-mnx9h","kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj","openshift-cluster-node-tuning-operator/tuned-c8w72","openshift-dns/node-resolver-f6sqs"] Jul 21 16:24:07.298552 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.298523 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:07.298697 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.298618 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:07.299709 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.299676 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.301014 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.300990 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:07.301144 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.301068 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:07.301988 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.301960 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 21 16:24:07.302139 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.302093 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bwb8c\"" Jul 21 16:24:07.302139 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.302125 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 21 16:24:07.302455 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.302422 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:07.304001 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.303977 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-95ppj" Jul 21 16:24:07.304766 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.304744 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zhqk6\"" Jul 21 16:24:07.304915 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.304784 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 21 16:24:07.304915 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.304878 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 21 16:24:07.305045 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.304967 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 21 16:24:07.306271 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.305800 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.306271 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.305916 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 21 16:24:07.306271 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.306244 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t2lbc\"" Jul 21 16:24:07.306271 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.306243 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 21 16:24:07.306532 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.306271 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 21 16:24:07.307547 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.307526 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2hnb8" Jul 21 16:24:07.308124 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.308102 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 21 16:24:07.308291 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.308245 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 21 16:24:07.308399 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.308379 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 21 16:24:07.308512 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.308418 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 21 16:24:07.308512 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.308470 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8hjnw\"" Jul 21 16:24:07.309463 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.309443 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f6sqs" Jul 21 16:24:07.310194 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.310132 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 21 16:24:07.310194 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.310184 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-26twc\"" Jul 21 16:24:07.310357 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.310294 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 21 16:24:07.310433 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.310411 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 21 16:24:07.311526 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.311487 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.312019 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.311996 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 21 16:24:07.312420 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.312376 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-7tqsh\"" Jul 21 16:24:07.312420 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.312417 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 21 16:24:07.314126 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.313617 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 21 16:24:07.314126 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.313662 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.314521 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.314498 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vtq4z\"" Jul 21 16:24:07.314647 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.314563 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 21 16:24:07.315897 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.315845 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:07.315897 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.315858 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 21 16:24:07.316046 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.315918 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:07.316046 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.315952 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-n2228\"" Jul 21 16:24:07.316287 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.316267 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 21 16:24:07.316638 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.316604 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 21 16:24:07.316881 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.316862 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 21 16:24:07.316969 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.316893 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 21 16:24:07.316969 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.316922 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 21 16:24:07.316969 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.316945 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 21 16:24:07.318007 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.317982 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.319896 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.319876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:07.320010 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.319910 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-systemd\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.320010 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.319941 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-os-release\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.320010 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.319964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-sysconfig\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.320010 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.319988 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-var-lib-kubelet\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.320228 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320012 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqtdx\" (UniqueName: \"kubernetes.io/projected/5fd5788c-5004-4dac-9916-48fc618aeaa8-kube-api-access-wqtdx\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.320228 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320035 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-cnibin\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.320228 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320044 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 21 16:24:07.320228 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320059 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6274515a-8269-4b1c-b31e-2b81c12b4528-cni-binary-copy\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.320228 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-run-netns\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.320514 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320262 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 21 16:24:07.320927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320635 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pbb5w\"" Jul 21 16:24:07.320927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320128 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-var-lib-cni-multus\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.320927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320678 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-var-lib-kubelet\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.320927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-run-multus-certs\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.320927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320757 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 21 16:24:07.320927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320767 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhf4g\" (UniqueName: \"kubernetes.io/projected/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-kube-api-access-vhf4g\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:07.320927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320809 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-kubernetes\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.320927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320860 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-etc-kubernetes\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.320927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320903 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-modprobe-d\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320946 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-sysctl-d\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.320984 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-lib-modules\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321019 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96fc0b6e-da00-40de-ad28-b2b45aa6de67-konnectivity-ca\") pod \"konnectivity-agent-fndhg\" (UID: \"96fc0b6e-da00-40de-ad28-b2b45aa6de67\") " pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321051 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-run-k8s-cni-cncf-io\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-daemon-config\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321107 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-kubelet-config\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321171 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96fc0b6e-da00-40de-ad28-b2b45aa6de67-agent-certs\") pod \"konnectivity-agent-fndhg\" (UID: \"96fc0b6e-da00-40de-ad28-b2b45aa6de67\") " pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-socket-dir-parent\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321263 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-hostroot\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321288 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-sys\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321313 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd5788c-5004-4dac-9916-48fc618aeaa8-tmp\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321336 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e834d1b-3be2-4b3e-a43b-70b049ffba0a-host\") pod \"node-ca-95ppj\" (UID: \"2e834d1b-3be2-4b3e-a43b-70b049ffba0a\") " pod="openshift-image-registry/node-ca-95ppj" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-system-cni-dir\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.321434 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321419 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-conf-dir\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.322268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321462 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-sysctl-conf\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.322268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-run\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.322268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321533 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-tuned\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.322268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-dbus\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:07.322268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321602 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e834d1b-3be2-4b3e-a43b-70b049ffba0a-serviceca\") pod \"node-ca-95ppj\" (UID: \"2e834d1b-3be2-4b3e-a43b-70b049ffba0a\") " pod="openshift-image-registry/node-ca-95ppj" Jul 21 16:24:07.322268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321629 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-cni-dir\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.322268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321660 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-host\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.322268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321688 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt9jr\" (UniqueName: \"kubernetes.io/projected/2e834d1b-3be2-4b3e-a43b-70b049ffba0a-kube-api-access-lt9jr\") pod \"node-ca-95ppj\" (UID: \"2e834d1b-3be2-4b3e-a43b-70b049ffba0a\") " pod="openshift-image-registry/node-ca-95ppj" Jul 21 16:24:07.322268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321713 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-var-lib-cni-bin\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.322268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.321759 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzlpt\" (UniqueName: \"kubernetes.io/projected/6274515a-8269-4b1c-b31e-2b81c12b4528-kube-api-access-vzlpt\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.342617 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.342592 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wnpg7" Jul 21 16:24:07.351545 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.351521 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wnpg7" Jul 21 16:24:07.406674 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.406645 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 21 16:24:07.422117 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422088 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-var-lib-kubelet\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.422277 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422130 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.422277 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f52743c1-68c7-43af-84ef-20a962d73e7b-tmp-dir\") pod \"node-resolver-f6sqs\" (UID: \"f52743c1-68c7-43af-84ef-20a962d73e7b\") " pod="openshift-dns/node-resolver-f6sqs" Jul 21 16:24:07.422277 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-tuning-conf-dir\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.422277 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422229 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-run-systemd\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.422277 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422239 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-var-lib-kubelet\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.422499 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422325 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-cni-bin\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.422499 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-cnibin\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.422499 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422440 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-cnibin\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.422499 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422464 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-var-lib-cni-multus\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.422499 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422489 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-run-multus-certs\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.422717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-lib-modules\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.422717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422539 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96fc0b6e-da00-40de-ad28-b2b45aa6de67-konnectivity-ca\") pod \"konnectivity-agent-fndhg\" (UID: \"96fc0b6e-da00-40de-ad28-b2b45aa6de67\") " pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:07.422717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422548 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-var-lib-cni-multus\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.422717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f10dea7-bca8-47b8-85ef-e206f7d3f33d-host-slash\") pod \"iptables-alerter-2hnb8\" (UID: \"1f10dea7-bca8-47b8-85ef-e206f7d3f33d\") " pod="openshift-network-operator/iptables-alerter-2hnb8" Jul 21 16:24:07.422717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422590 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-sys-fs\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.422717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422591 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-run-multus-certs\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.422717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422616 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbn2x\" (UniqueName: \"kubernetes.io/projected/101dcab9-c146-43d6-9b88-ae1e95393876-kube-api-access-mbn2x\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.422717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422643 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-run-netns\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.422717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422664 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-daemon-config\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.422717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422686 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:07.422717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhdrs\" (UniqueName: \"kubernetes.io/projected/1f10dea7-bca8-47b8-85ef-e206f7d3f33d-kube-api-access-nhdrs\") pod \"iptables-alerter-2hnb8\" (UID: \"1f10dea7-bca8-47b8-85ef-e206f7d3f33d\") " pod="openshift-network-operator/iptables-alerter-2hnb8" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r9jq\" (UniqueName: \"kubernetes.io/projected/a5eeb793-26f0-459e-ab52-390e675b6a33-kube-api-access-6r9jq\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422773 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/101dcab9-c146-43d6-9b88-ae1e95393876-cni-binary-copy\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422797 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-env-overrides\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422821 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-hostroot\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-sys\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.422854 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422886 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-device-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422914 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-cnibin\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422935 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/101dcab9-c146-43d6-9b88-ae1e95393876-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422962 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-sys\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.422983 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret podName:8ac3a036-67b1-49e6-a075-7f43a9dbc6c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:07.922954159 +0000 UTC m=+2.991034838 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret") pod "global-pull-secret-syncer-c7pb5" (UID: "8ac3a036-67b1-49e6-a075-7f43a9dbc6c5") : object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422983 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-hostroot\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423015 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-run-openvswitch\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423049 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-ovnkube-config\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-system-cni-dir\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-conf-dir\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.423355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423147 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f52743c1-68c7-43af-84ef-20a962d73e7b-hosts-file\") pod \"node-resolver-f6sqs\" (UID: \"f52743c1-68c7-43af-84ef-20a962d73e7b\") " pod="openshift-dns/node-resolver-f6sqs" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423184 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-systemd-units\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.422787 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-lib-modules\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423207 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/96fc0b6e-da00-40de-ad28-b2b45aa6de67-konnectivity-ca\") pod \"konnectivity-agent-fndhg\" (UID: \"96fc0b6e-da00-40de-ad28-b2b45aa6de67\") " pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423230 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-daemon-config\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423209 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-system-cni-dir\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423242 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-ovnkube-script-lib\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423280 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-conf-dir\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423315 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e834d1b-3be2-4b3e-a43b-70b049ffba0a-serviceca\") pod \"node-ca-95ppj\" (UID: \"2e834d1b-3be2-4b3e-a43b-70b049ffba0a\") " pod="openshift-image-registry/node-ca-95ppj" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423467 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt9jr\" (UniqueName: \"kubernetes.io/projected/2e834d1b-3be2-4b3e-a43b-70b049ffba0a-kube-api-access-lt9jr\") pod \"node-ca-95ppj\" (UID: \"2e834d1b-3be2-4b3e-a43b-70b049ffba0a\") " pod="openshift-image-registry/node-ca-95ppj" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423485 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzlpt\" (UniqueName: \"kubernetes.io/projected/6274515a-8269-4b1c-b31e-2b81c12b4528-kube-api-access-vzlpt\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423511 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423538 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-systemd\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423563 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-socket-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423588 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-var-lib-openvswitch\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.424219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423600 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-systemd\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423611 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-etc-openvswitch\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck9jw\" (UniqueName: \"kubernetes.io/projected/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-kube-api-access-ck9jw\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-sysconfig\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqtdx\" (UniqueName: \"kubernetes.io/projected/5fd5788c-5004-4dac-9916-48fc618aeaa8-kube-api-access-wqtdx\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423721 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423743 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e834d1b-3be2-4b3e-a43b-70b049ffba0a-serviceca\") pod \"node-ca-95ppj\" (UID: \"2e834d1b-3be2-4b3e-a43b-70b049ffba0a\") " pod="openshift-image-registry/node-ca-95ppj" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423742 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-sysconfig\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jwpg\" (UniqueName: \"kubernetes.io/projected/f52743c1-68c7-43af-84ef-20a962d73e7b-kube-api-access-7jwpg\") pod \"node-resolver-f6sqs\" (UID: \"f52743c1-68c7-43af-84ef-20a962d73e7b\") " pod="openshift-dns/node-resolver-f6sqs" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423823 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-node-log\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423847 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6274515a-8269-4b1c-b31e-2b81c12b4528-cni-binary-copy\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423873 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-run-netns\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-var-lib-kubelet\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhf4g\" (UniqueName: \"kubernetes.io/projected/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-kube-api-access-vhf4g\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423932 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-run-netns\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423957 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-kubernetes\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.423989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-ovn-node-metrics-cert\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424004 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-kubernetes\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.424992 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.424011 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424017 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8694\" (UniqueName: \"kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694\") pod \"network-check-target-7pmmh\" (UID: \"ab0228ef-d9ea-433b-b577-78eeb501c821\") " pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424047 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-var-lib-kubelet\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.424134 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs podName:c974f0bb-6dcd-41e6-b77d-7475f2fb2665 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:07.924114762 +0000 UTC m=+2.992195439 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs") pod "network-metrics-daemon-nvgjf" (UID: "c974f0bb-6dcd-41e6-b77d-7475f2fb2665") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424180 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-etc-kubernetes\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424227 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-modprobe-d\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-sysctl-d\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424279 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-etc-kubernetes\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424282 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f10dea7-bca8-47b8-85ef-e206f7d3f33d-iptables-alerter-script\") pod \"iptables-alerter-2hnb8\" (UID: \"1f10dea7-bca8-47b8-85ef-e206f7d3f33d\") " pod="openshift-network-operator/iptables-alerter-2hnb8" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424334 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-kubelet\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424346 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-modprobe-d\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424362 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-run-ovn\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424367 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6274515a-8269-4b1c-b31e-2b81c12b4528-cni-binary-copy\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-run-k8s-cni-cncf-io\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424417 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-sysctl-d\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424442 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-kubelet-config\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:07.425726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424465 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-run-k8s-cni-cncf-io\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424485 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-kubelet-config\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424486 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96fc0b6e-da00-40de-ad28-b2b45aa6de67-agent-certs\") pod \"konnectivity-agent-fndhg\" (UID: \"96fc0b6e-da00-40de-ad28-b2b45aa6de67\") " pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424515 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-log-socket\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-cni-netd\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424552 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-socket-dir-parent\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424577 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd5788c-5004-4dac-9916-48fc618aeaa8-tmp\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-slash\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424703 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e834d1b-3be2-4b3e-a43b-70b049ffba0a-host\") pod \"node-ca-95ppj\" (UID: \"2e834d1b-3be2-4b3e-a43b-70b049ffba0a\") " pod="openshift-image-registry/node-ca-95ppj" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-sysctl-conf\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424752 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-run\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424783 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e834d1b-3be2-4b3e-a43b-70b049ffba0a-host\") pod \"node-ca-95ppj\" (UID: \"2e834d1b-3be2-4b3e-a43b-70b049ffba0a\") " pod="openshift-image-registry/node-ca-95ppj" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-tuned\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424729 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-socket-dir-parent\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424820 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-dbus\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424828 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-run\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424842 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424847 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-system-cni-dir\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.426437 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424882 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-sysctl-conf\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-os-release\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-cni-dir\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424950 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-host\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424969 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-dbus\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.424977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-var-lib-cni-bin\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.425014 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fd5788c-5004-4dac-9916-48fc618aeaa8-host\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.425022 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-host-var-lib-cni-bin\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.425018 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-multus-cni-dir\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.425076 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-registration-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.425097 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/101dcab9-c146-43d6-9b88-ae1e95393876-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.425118 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-os-release\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.427216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.425255 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6274515a-8269-4b1c-b31e-2b81c12b4528-os-release\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.428587 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.428566 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/5fd5788c-5004-4dac-9916-48fc618aeaa8-etc-tuned\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.428676 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.428610 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5fd5788c-5004-4dac-9916-48fc618aeaa8-tmp\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.428994 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.428974 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/96fc0b6e-da00-40de-ad28-b2b45aa6de67-agent-certs\") pod \"konnectivity-agent-fndhg\" (UID: \"96fc0b6e-da00-40de-ad28-b2b45aa6de67\") " pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:07.433792 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.433763 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqtdx\" (UniqueName: \"kubernetes.io/projected/5fd5788c-5004-4dac-9916-48fc618aeaa8-kube-api-access-wqtdx\") pod \"tuned-c8w72\" (UID: \"5fd5788c-5004-4dac-9916-48fc618aeaa8\") " pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.433792 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.433788 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhf4g\" (UniqueName: \"kubernetes.io/projected/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-kube-api-access-vhf4g\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:07.433995 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.433974 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt9jr\" (UniqueName: \"kubernetes.io/projected/2e834d1b-3be2-4b3e-a43b-70b049ffba0a-kube-api-access-lt9jr\") pod \"node-ca-95ppj\" (UID: \"2e834d1b-3be2-4b3e-a43b-70b049ffba0a\") " pod="openshift-image-registry/node-ca-95ppj" Jul 21 16:24:07.434057 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.433974 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzlpt\" (UniqueName: \"kubernetes.io/projected/6274515a-8269-4b1c-b31e-2b81c12b4528-kube-api-access-vzlpt\") pod \"multus-mzfbt\" (UID: \"6274515a-8269-4b1c-b31e-2b81c12b4528\") " pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.526121 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/101dcab9-c146-43d6-9b88-ae1e95393876-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.526315 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526133 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-run-openvswitch\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.526315 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526190 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-run-openvswitch\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.526449 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526320 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-ovnkube-config\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.526449 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f52743c1-68c7-43af-84ef-20a962d73e7b-hosts-file\") pod \"node-resolver-f6sqs\" (UID: \"f52743c1-68c7-43af-84ef-20a962d73e7b\") " pod="openshift-dns/node-resolver-f6sqs" Jul 21 16:24:07.526449 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526396 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-systemd-units\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.526449 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.526660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526453 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-ovnkube-script-lib\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.526660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526457 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f52743c1-68c7-43af-84ef-20a962d73e7b-hosts-file\") pod \"node-resolver-f6sqs\" (UID: \"f52743c1-68c7-43af-84ef-20a962d73e7b\") " pod="openshift-dns/node-resolver-f6sqs" Jul 21 16:24:07.526660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526483 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.526660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526524 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.526660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526527 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-socket-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.526660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-var-lib-openvswitch\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.526660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526599 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-etc-openvswitch\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.526660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526623 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck9jw\" (UniqueName: \"kubernetes.io/projected/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-kube-api-access-ck9jw\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.526660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526650 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-socket-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.526660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jwpg\" (UniqueName: \"kubernetes.io/projected/f52743c1-68c7-43af-84ef-20a962d73e7b-kube-api-access-7jwpg\") pod \"node-resolver-f6sqs\" (UID: \"f52743c1-68c7-43af-84ef-20a962d73e7b\") " pod="openshift-dns/node-resolver-f6sqs" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526721 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-node-log\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526753 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-ovn-node-metrics-cert\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526757 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-etc-selinux\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526830 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-run-ovn-kubernetes\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526840 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/101dcab9-c146-43d6-9b88-ae1e95393876-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526865 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-node-log\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526910 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-systemd-units\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526925 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-etc-openvswitch\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8694\" (UniqueName: \"kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694\") pod \"network-check-target-7pmmh\" (UID: \"ab0228ef-d9ea-433b-b577-78eeb501c821\") " pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526927 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-var-lib-openvswitch\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.526977 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f10dea7-bca8-47b8-85ef-e206f7d3f33d-iptables-alerter-script\") pod \"iptables-alerter-2hnb8\" (UID: \"1f10dea7-bca8-47b8-85ef-e206f7d3f33d\") " pod="openshift-network-operator/iptables-alerter-2hnb8" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527007 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-kubelet\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527038 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-run-ovn\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527078 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-log-socket\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527102 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-cni-netd\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527135 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-slash\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527166 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-system-cni-dir\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527191 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-os-release\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527198 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-run-ovn\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527220 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-registration-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527249 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-kubelet\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527253 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/101dcab9-c146-43d6-9b88-ae1e95393876-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527297 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-slash\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527291 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527340 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f52743c1-68c7-43af-84ef-20a962d73e7b-tmp-dir\") pod \"node-resolver-f6sqs\" (UID: \"f52743c1-68c7-43af-84ef-20a962d73e7b\") " pod="openshift-dns/node-resolver-f6sqs" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527343 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-os-release\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527357 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527369 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-tuning-conf-dir\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527400 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-run-systemd\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527419 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-log-socket\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-cni-bin\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f10dea7-bca8-47b8-85ef-e206f7d3f33d-host-slash\") pod \"iptables-alerter-2hnb8\" (UID: \"1f10dea7-bca8-47b8-85ef-e206f7d3f33d\") " pod="openshift-network-operator/iptables-alerter-2hnb8" Jul 21 16:24:07.527886 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527472 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-registration-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527504 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-sys-fs\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527511 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1f10dea7-bca8-47b8-85ef-e206f7d3f33d-host-slash\") pod \"iptables-alerter-2hnb8\" (UID: \"1f10dea7-bca8-47b8-85ef-e206f7d3f33d\") " pod="openshift-network-operator/iptables-alerter-2hnb8" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527546 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-system-cni-dir\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527565 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-sys-fs\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527588 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1f10dea7-bca8-47b8-85ef-e206f7d3f33d-iptables-alerter-script\") pod \"iptables-alerter-2hnb8\" (UID: \"1f10dea7-bca8-47b8-85ef-e206f7d3f33d\") " pod="openshift-network-operator/iptables-alerter-2hnb8" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527639 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-run-systemd\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527651 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-ovnkube-config\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527713 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-cni-bin\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527755 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-cni-netd\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527773 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-tuning-conf-dir\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527809 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbn2x\" (UniqueName: \"kubernetes.io/projected/101dcab9-c146-43d6-9b88-ae1e95393876-kube-api-access-mbn2x\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527854 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-run-netns\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527887 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f52743c1-68c7-43af-84ef-20a962d73e7b-tmp-dir\") pod \"node-resolver-f6sqs\" (UID: \"f52743c1-68c7-43af-84ef-20a962d73e7b\") " pod="openshift-dns/node-resolver-f6sqs" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527915 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-host-run-netns\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.527917 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/101dcab9-c146-43d6-9b88-ae1e95393876-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.528016 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhdrs\" (UniqueName: \"kubernetes.io/projected/1f10dea7-bca8-47b8-85ef-e206f7d3f33d-kube-api-access-nhdrs\") pod \"iptables-alerter-2hnb8\" (UID: \"1f10dea7-bca8-47b8-85ef-e206f7d3f33d\") " pod="openshift-network-operator/iptables-alerter-2hnb8" Jul 21 16:24:07.528783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.528048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r9jq\" (UniqueName: \"kubernetes.io/projected/a5eeb793-26f0-459e-ab52-390e675b6a33-kube-api-access-6r9jq\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.529713 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.528073 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/101dcab9-c146-43d6-9b88-ae1e95393876-cni-binary-copy\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.529713 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.528099 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-env-overrides\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.529713 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.528121 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-ovnkube-script-lib\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.529713 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.528126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-device-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.529713 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.528169 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a5eeb793-26f0-459e-ab52-390e675b6a33-device-dir\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.529713 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.528181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-cnibin\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.529713 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.528249 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/101dcab9-c146-43d6-9b88-ae1e95393876-cnibin\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.529713 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.528561 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-env-overrides\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.529713 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.528776 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/101dcab9-c146-43d6-9b88-ae1e95393876-cni-binary-copy\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.529713 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.529675 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-ovn-node-metrics-cert\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.534114 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.534088 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 16:24:07.534114 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.534116 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 16:24:07.534313 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.534132 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p8694 for pod openshift-network-diagnostics/network-check-target-7pmmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:07.534313 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.534202 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694 podName:ab0228ef-d9ea-433b-b577-78eeb501c821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:08.034182877 +0000 UTC m=+3.102263544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p8694" (UniqueName: "kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694") pod "network-check-target-7pmmh" (UID: "ab0228ef-d9ea-433b-b577-78eeb501c821") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:07.536638 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.536608 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jwpg\" (UniqueName: \"kubernetes.io/projected/f52743c1-68c7-43af-84ef-20a962d73e7b-kube-api-access-7jwpg\") pod \"node-resolver-f6sqs\" (UID: \"f52743c1-68c7-43af-84ef-20a962d73e7b\") " pod="openshift-dns/node-resolver-f6sqs" Jul 21 16:24:07.536757 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.536698 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck9jw\" (UniqueName: \"kubernetes.io/projected/d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2-kube-api-access-ck9jw\") pod \"ovnkube-node-mnx9h\" (UID: \"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2\") " pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.539146 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.538336 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbn2x\" (UniqueName: \"kubernetes.io/projected/101dcab9-c146-43d6-9b88-ae1e95393876-kube-api-access-mbn2x\") pod \"multus-additional-cni-plugins-glgxw\" (UID: \"101dcab9-c146-43d6-9b88-ae1e95393876\") " pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.539146 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.538689 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r9jq\" (UniqueName: \"kubernetes.io/projected/a5eeb793-26f0-459e-ab52-390e675b6a33-kube-api-access-6r9jq\") pod \"aws-ebs-csi-driver-node-mnnpj\" (UID: \"a5eeb793-26f0-459e-ab52-390e675b6a33\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.539146 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.539076 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhdrs\" (UniqueName: \"kubernetes.io/projected/1f10dea7-bca8-47b8-85ef-e206f7d3f33d-kube-api-access-nhdrs\") pod \"iptables-alerter-2hnb8\" (UID: \"1f10dea7-bca8-47b8-85ef-e206f7d3f33d\") " pod="openshift-network-operator/iptables-alerter-2hnb8" Jul 21 16:24:07.543926 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.543869 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" event={"ID":"2cfdb6b3273ab625922b8832a1abf7ed","Type":"ContainerStarted","Data":"2db4199cf7b90bc0cb4bebe4c9c24be1910a8cf713e02df8a0fe2fc5e533b135"} Jul 21 16:24:07.545494 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.545399 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" event={"ID":"317f49df52d0c5c3171427f046cacf08","Type":"ContainerStarted","Data":"1185a2cec1f9985dac6fac7d7893c3dd3011136bbc3b7daba39f53653b0d0b1b"} Jul 21 16:24:07.554054 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.554035 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 21 16:24:07.613325 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.613285 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-c8w72" Jul 21 16:24:07.621192 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.621167 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:07.624415 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:07.624381 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fd5788c_5004_4dac_9916_48fc618aeaa8.slice/crio-470592d45115aef48663ebebd65dbdbd57ea5044afe89a5e5ea67dcf0f0bbdd1 WatchSource:0}: Error finding container 470592d45115aef48663ebebd65dbdbd57ea5044afe89a5e5ea67dcf0f0bbdd1: Status 404 returned error can't find the container with id 470592d45115aef48663ebebd65dbdbd57ea5044afe89a5e5ea67dcf0f0bbdd1 Jul 21 16:24:07.631885 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.631691 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-95ppj" Jul 21 16:24:07.633884 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:07.633758 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96fc0b6e_da00_40de_ad28_b2b45aa6de67.slice/crio-a2e01a22ebd438ec9f523579f507af91abff49b9ecab5066277d8458db73183c WatchSource:0}: Error finding container a2e01a22ebd438ec9f523579f507af91abff49b9ecab5066277d8458db73183c: Status 404 returned error can't find the container with id a2e01a22ebd438ec9f523579f507af91abff49b9ecab5066277d8458db73183c Jul 21 16:24:07.636795 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.636775 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mzfbt" Jul 21 16:24:07.645914 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.645892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-2hnb8" Jul 21 16:24:07.648179 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:07.648152 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e834d1b_3be2_4b3e_a43b_70b049ffba0a.slice/crio-ef633f8857c4910d9cff20cd428af40f4771e00f1f9528216dccb73ecbf3584f WatchSource:0}: Error finding container ef633f8857c4910d9cff20cd428af40f4771e00f1f9528216dccb73ecbf3584f: Status 404 returned error can't find the container with id ef633f8857c4910d9cff20cd428af40f4771e00f1f9528216dccb73ecbf3584f Jul 21 16:24:07.651853 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:07.651817 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6274515a_8269_4b1c_b31e_2b81c12b4528.slice/crio-ba86a53a5937b30c34f9f53c906f209ef162a9db5ad4acae0262efd7f3d982b4 WatchSource:0}: Error finding container ba86a53a5937b30c34f9f53c906f209ef162a9db5ad4acae0262efd7f3d982b4: Status 404 returned error can't find the container with id ba86a53a5937b30c34f9f53c906f209ef162a9db5ad4acae0262efd7f3d982b4 Jul 21 16:24:07.653222 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.653159 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-f6sqs" Jul 21 16:24:07.661362 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.661272 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-glgxw" Jul 21 16:24:07.667081 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.667056 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:07.669216 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:07.669186 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f10dea7_bca8_47b8_85ef_e206f7d3f33d.slice/crio-1e924605efd7523314a35f42a94b8766c55bb5815b4019e4b936f201b40cca22 WatchSource:0}: Error finding container 1e924605efd7523314a35f42a94b8766c55bb5815b4019e4b936f201b40cca22: Status 404 returned error can't find the container with id 1e924605efd7523314a35f42a94b8766c55bb5815b4019e4b936f201b40cca22 Jul 21 16:24:07.671780 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.671756 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" Jul 21 16:24:07.678377 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:07.678340 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod101dcab9_c146_43d6_9b88_ae1e95393876.slice/crio-2e6bab7e657d290ff8ab009b11100ec6f639de2f3690eba1746089bc140dd1f3 WatchSource:0}: Error finding container 2e6bab7e657d290ff8ab009b11100ec6f639de2f3690eba1746089bc140dd1f3: Status 404 returned error can't find the container with id 2e6bab7e657d290ff8ab009b11100ec6f639de2f3690eba1746089bc140dd1f3 Jul 21 16:24:07.689845 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:07.689793 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5eeb793_26f0_459e_ab52_390e675b6a33.slice/crio-18e1b45bc70a45b1daf47a3a7dc029cfb1be35503e3b63459d02ef2ea5dcdda6 WatchSource:0}: Error finding container 18e1b45bc70a45b1daf47a3a7dc029cfb1be35503e3b63459d02ef2ea5dcdda6: Status 404 returned error can't find the container with id 18e1b45bc70a45b1daf47a3a7dc029cfb1be35503e3b63459d02ef2ea5dcdda6 Jul 21 16:24:07.931976 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.931889 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:07.932119 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:07.931997 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:07.932119 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.932049 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:07.932119 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.932084 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:07.932276 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.932145 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs podName:c974f0bb-6dcd-41e6-b77d-7475f2fb2665 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:08.932105238 +0000 UTC m=+4.000185902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs") pod "network-metrics-daemon-nvgjf" (UID: "c974f0bb-6dcd-41e6-b77d-7475f2fb2665") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:07.932276 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:07.932165 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret podName:8ac3a036-67b1-49e6-a075-7f43a9dbc6c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:08.932154728 +0000 UTC m=+4.000235394 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret") pod "global-pull-secret-syncer-c7pb5" (UID: "8ac3a036-67b1-49e6-a075-7f43a9dbc6c5") : object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:08.133909 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.133871 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8694\" (UniqueName: \"kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694\") pod \"network-check-target-7pmmh\" (UID: \"ab0228ef-d9ea-433b-b577-78eeb501c821\") " pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:08.134130 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:08.134016 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 16:24:08.134130 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:08.134039 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 16:24:08.134130 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:08.134054 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p8694 for pod openshift-network-diagnostics/network-check-target-7pmmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:08.134130 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:08.134125 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694 podName:ab0228ef-d9ea-433b-b577-78eeb501c821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:09.134105226 +0000 UTC m=+4.202185888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8694" (UniqueName: "kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694") pod "network-check-target-7pmmh" (UID: "ab0228ef-d9ea-433b-b577-78eeb501c821") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:08.354599 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.354497 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:19:08 +0000 UTC" deadline="2028-03-05 08:24:43.773607475 +0000 UTC" Jul 21 16:24:08.354599 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.354538 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14224h0m35.419073999s" Jul 21 16:24:08.538193 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.538152 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:08.538401 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:08.538325 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:08.538593 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.538565 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:08.538711 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:08.538662 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:08.549555 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.549510 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c8w72" event={"ID":"5fd5788c-5004-4dac-9916-48fc618aeaa8","Type":"ContainerStarted","Data":"470592d45115aef48663ebebd65dbdbd57ea5044afe89a5e5ea67dcf0f0bbdd1"} Jul 21 16:24:08.551245 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.551211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f6sqs" event={"ID":"f52743c1-68c7-43af-84ef-20a962d73e7b","Type":"ContainerStarted","Data":"7fa8510d52e4a6921d4dded902134cd4fdfec7ad9f5f58d267a4fb1e0450823f"} Jul 21 16:24:08.553312 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.553286 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mzfbt" event={"ID":"6274515a-8269-4b1c-b31e-2b81c12b4528","Type":"ContainerStarted","Data":"ba86a53a5937b30c34f9f53c906f209ef162a9db5ad4acae0262efd7f3d982b4"} Jul 21 16:24:08.554926 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.554899 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fndhg" event={"ID":"96fc0b6e-da00-40de-ad28-b2b45aa6de67","Type":"ContainerStarted","Data":"a2e01a22ebd438ec9f523579f507af91abff49b9ecab5066277d8458db73183c"} Jul 21 16:24:08.557176 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.557143 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" event={"ID":"a5eeb793-26f0-459e-ab52-390e675b6a33","Type":"ContainerStarted","Data":"18e1b45bc70a45b1daf47a3a7dc029cfb1be35503e3b63459d02ef2ea5dcdda6"} Jul 21 16:24:08.558448 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.558422 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" event={"ID":"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2","Type":"ContainerStarted","Data":"e36ec2ef8e8d842ae0b02abd3eead55800955bc08fe4a5a02f1e1660450e595e"} Jul 21 16:24:08.560083 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.560056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glgxw" event={"ID":"101dcab9-c146-43d6-9b88-ae1e95393876","Type":"ContainerStarted","Data":"2e6bab7e657d290ff8ab009b11100ec6f639de2f3690eba1746089bc140dd1f3"} Jul 21 16:24:08.562210 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.562184 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2hnb8" event={"ID":"1f10dea7-bca8-47b8-85ef-e206f7d3f33d","Type":"ContainerStarted","Data":"1e924605efd7523314a35f42a94b8766c55bb5815b4019e4b936f201b40cca22"} Jul 21 16:24:08.564110 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.564083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-95ppj" event={"ID":"2e834d1b-3be2-4b3e-a43b-70b049ffba0a","Type":"ContainerStarted","Data":"ef633f8857c4910d9cff20cd428af40f4771e00f1f9528216dccb73ecbf3584f"} Jul 21 16:24:08.940810 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.940754 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:08.941022 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:08.940839 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:08.941098 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:08.941059 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:08.941152 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:08.941127 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs podName:c974f0bb-6dcd-41e6-b77d-7475f2fb2665 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:10.941106199 +0000 UTC m=+6.009186875 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs") pod "network-metrics-daemon-nvgjf" (UID: "c974f0bb-6dcd-41e6-b77d-7475f2fb2665") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:08.941567 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:08.941544 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:08.941673 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:08.941617 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret podName:8ac3a036-67b1-49e6-a075-7f43a9dbc6c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:10.941602149 +0000 UTC m=+6.009682824 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret") pod "global-pull-secret-syncer-c7pb5" (UID: "8ac3a036-67b1-49e6-a075-7f43a9dbc6c5") : object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:09.143130 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:09.143083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8694\" (UniqueName: \"kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694\") pod \"network-check-target-7pmmh\" (UID: \"ab0228ef-d9ea-433b-b577-78eeb501c821\") " pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:09.155864 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:09.155135 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 16:24:09.155864 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:09.155178 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 16:24:09.155864 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:09.155203 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p8694 for pod openshift-network-diagnostics/network-check-target-7pmmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:09.155864 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:09.155301 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694 podName:ab0228ef-d9ea-433b-b577-78eeb501c821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:11.155268274 +0000 UTC m=+6.223348934 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8694" (UniqueName: "kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694") pod "network-check-target-7pmmh" (UID: "ab0228ef-d9ea-433b-b577-78eeb501c821") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:09.355596 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:09.355473 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-20 16:19:08 +0000 UTC" deadline="2028-01-22 01:25:25.737059179 +0000 UTC" Jul 21 16:24:09.355596 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:09.355543 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13185h1m16.381520733s" Jul 21 16:24:09.539390 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:09.539360 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:09.539556 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:09.539488 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:10.539384 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:10.539043 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:10.539384 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:10.539321 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:10.539994 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:10.539474 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:10.539994 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:10.539956 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:10.580852 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:10.580053 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" event={"ID":"2cfdb6b3273ab625922b8832a1abf7ed","Type":"ContainerStarted","Data":"e981316fe794a50b1101e0519d5a89ccab36e10f66205e1c2102b982710cd17e"} Jul 21 16:24:10.586643 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:10.586610 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" event={"ID":"317f49df52d0c5c3171427f046cacf08","Type":"ContainerStarted","Data":"64c808571dc13e7a0a83c3de1fb972ec6dd761a7cd489f3e9e029059db3c9f76"} Jul 21 16:24:10.613371 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:10.613303 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-54.ec2.internal" podStartSLOduration=3.613276657 podStartE2EDuration="3.613276657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:10.598184818 +0000 UTC m=+5.666265501" watchObservedRunningTime="2026-07-21 16:24:10.613276657 +0000 UTC m=+5.681357341" Jul 21 16:24:10.961747 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:10.961654 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:10.961964 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:10.961758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:10.961964 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:10.961925 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:10.962113 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:10.961995 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret podName:8ac3a036-67b1-49e6-a075-7f43a9dbc6c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:14.961973832 +0000 UTC m=+10.030054507 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret") pod "global-pull-secret-syncer-c7pb5" (UID: "8ac3a036-67b1-49e6-a075-7f43a9dbc6c5") : object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:10.962464 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:10.962442 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:10.962540 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:10.962511 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs podName:c974f0bb-6dcd-41e6-b77d-7475f2fb2665 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:14.962491711 +0000 UTC m=+10.030572377 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs") pod "network-metrics-daemon-nvgjf" (UID: "c974f0bb-6dcd-41e6-b77d-7475f2fb2665") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:11.164428 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:11.164388 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8694\" (UniqueName: \"kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694\") pod \"network-check-target-7pmmh\" (UID: \"ab0228ef-d9ea-433b-b577-78eeb501c821\") " pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:11.164622 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:11.164601 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 16:24:11.164692 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:11.164625 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 16:24:11.164692 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:11.164638 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p8694 for pod openshift-network-diagnostics/network-check-target-7pmmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:11.164804 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:11.164701 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694 podName:ab0228ef-d9ea-433b-b577-78eeb501c821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:15.16468102 +0000 UTC m=+10.232761700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8694" (UniqueName: "kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694") pod "network-check-target-7pmmh" (UID: "ab0228ef-d9ea-433b-b577-78eeb501c821") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:11.538361 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:11.538327 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:11.539072 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:11.538571 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:12.538256 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:12.538213 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:12.538256 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:12.538253 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:12.538728 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:12.538380 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:12.538915 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:12.538860 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:12.593818 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:12.593498 2564 generic.go:356] "Generic (PLEG): container finished" podID="317f49df52d0c5c3171427f046cacf08" containerID="64c808571dc13e7a0a83c3de1fb972ec6dd761a7cd489f3e9e029059db3c9f76" exitCode=0 Jul 21 16:24:12.593818 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:12.593549 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" event={"ID":"317f49df52d0c5c3171427f046cacf08","Type":"ContainerDied","Data":"64c808571dc13e7a0a83c3de1fb972ec6dd761a7cd489f3e9e029059db3c9f76"} Jul 21 16:24:13.538981 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:13.538892 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:13.539473 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:13.539025 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:14.538119 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:14.538082 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:14.538303 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:14.538093 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:14.538303 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:14.538233 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:14.538414 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:14.538378 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:14.999413 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:14.999317 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:14.999413 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:14.999386 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:14.999963 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:14.999580 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:14.999963 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:14.999649 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs podName:c974f0bb-6dcd-41e6-b77d-7475f2fb2665 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:22.99962791 +0000 UTC m=+18.067708590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs") pod "network-metrics-daemon-nvgjf" (UID: "c974f0bb-6dcd-41e6-b77d-7475f2fb2665") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:14.999963 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:14.999723 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:14.999963 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:14.999757 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret podName:8ac3a036-67b1-49e6-a075-7f43a9dbc6c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:22.999746329 +0000 UTC m=+18.067827002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret") pod "global-pull-secret-syncer-c7pb5" (UID: "8ac3a036-67b1-49e6-a075-7f43a9dbc6c5") : object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:15.201626 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:15.201336 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8694\" (UniqueName: \"kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694\") pod \"network-check-target-7pmmh\" (UID: \"ab0228ef-d9ea-433b-b577-78eeb501c821\") " pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:15.201626 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:15.201522 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 16:24:15.201626 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:15.201545 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 16:24:15.201626 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:15.201559 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p8694 for pod openshift-network-diagnostics/network-check-target-7pmmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:15.201626 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:15.201630 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694 podName:ab0228ef-d9ea-433b-b577-78eeb501c821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:23.201610771 +0000 UTC m=+18.269691455 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8694" (UniqueName: "kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694") pod "network-check-target-7pmmh" (UID: "ab0228ef-d9ea-433b-b577-78eeb501c821") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:15.539638 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:15.539157 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:15.539638 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:15.539273 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:16.539145 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:16.539101 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:16.539587 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:16.539249 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:16.539587 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:16.539341 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:16.539587 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:16.539477 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:17.538654 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:17.538618 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:17.538820 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:17.538769 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:18.538083 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:18.538050 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:18.538509 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:18.538064 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:18.538509 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:18.538195 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:18.538509 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:18.538261 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:19.538167 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:19.538136 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:19.538522 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:19.538245 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:20.538150 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:20.538123 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:20.538150 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:20.538150 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:20.538633 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:20.538249 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:20.538633 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:20.538448 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:21.538619 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:21.538580 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:21.539070 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:21.538707 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:22.538735 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:22.538699 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:22.539216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:22.538765 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:22.539216 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:22.538856 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:22.539216 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:22.539008 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:23.063793 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:23.063734 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:23.064074 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:23.063818 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:23.064074 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:23.063868 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:23.064074 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:23.063939 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:23.064074 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:23.063944 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret podName:8ac3a036-67b1-49e6-a075-7f43a9dbc6c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:39.063921786 +0000 UTC m=+34.132002447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret") pod "global-pull-secret-syncer-c7pb5" (UID: "8ac3a036-67b1-49e6-a075-7f43a9dbc6c5") : object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:23.064074 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:23.064011 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs podName:c974f0bb-6dcd-41e6-b77d-7475f2fb2665 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:39.063992289 +0000 UTC m=+34.132072961 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs") pod "network-metrics-daemon-nvgjf" (UID: "c974f0bb-6dcd-41e6-b77d-7475f2fb2665") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:23.265660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:23.265619 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8694\" (UniqueName: \"kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694\") pod \"network-check-target-7pmmh\" (UID: \"ab0228ef-d9ea-433b-b577-78eeb501c821\") " pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:23.265842 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:23.265770 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 16:24:23.265842 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:23.265784 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 16:24:23.265842 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:23.265793 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p8694 for pod openshift-network-diagnostics/network-check-target-7pmmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:23.265842 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:23.265841 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694 podName:ab0228ef-d9ea-433b-b577-78eeb501c821 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:39.265827749 +0000 UTC m=+34.333908409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8694" (UniqueName: "kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694") pod "network-check-target-7pmmh" (UID: "ab0228ef-d9ea-433b-b577-78eeb501c821") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:23.538520 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:23.538486 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:23.538692 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:23.538660 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:24.539169 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:24.539127 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:24.539617 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:24.539276 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:24.539617 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:24.539328 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:24.539617 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:24.539438 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:25.539336 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:25.539296 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:25.539756 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:25.539415 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:26.538530 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:26.538497 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:26.538719 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:26.538498 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:26.538719 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:26.538631 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:26.538719 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:26.538697 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:27.540646 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:27.540618 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:27.541035 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:27.540702 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:28.538219 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.538064 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:28.538304 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.538068 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:28.538348 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:28.538296 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:28.538390 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:28.538369 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:28.624812 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.624783 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" event={"ID":"317f49df52d0c5c3171427f046cacf08","Type":"ContainerStarted","Data":"6b4cf1ec538651d3094dbfa16135efe2282894778cfe2245a393ac2e14de5b28"} Jul 21 16:24:28.626019 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.626000 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-f6sqs" event={"ID":"f52743c1-68c7-43af-84ef-20a962d73e7b","Type":"ContainerStarted","Data":"7b5b3c5a693027cc5573f32c873c3e62b0f1887d3000c6a7311cb7fd05c47605"} Jul 21 16:24:28.627494 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.627467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mzfbt" event={"ID":"6274515a-8269-4b1c-b31e-2b81c12b4528","Type":"ContainerStarted","Data":"4f5bd3fde86e99190daf1840ce81e85c4e47ed3ad56ff3176b83ad363f92af7a"} Jul 21 16:24:28.628865 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.628846 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fndhg" event={"ID":"96fc0b6e-da00-40de-ad28-b2b45aa6de67","Type":"ContainerStarted","Data":"ba74577dd5873706489ebf589abfdfa9253ea1815e2ef94398444d70ce8de9bb"} Jul 21 16:24:28.630395 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.630341 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" event={"ID":"a5eeb793-26f0-459e-ab52-390e675b6a33","Type":"ContainerStarted","Data":"2e499d58521837621ab14814971af0ee73eb50cb186aafcf44b74e46e5f3b35e"} Jul 21 16:24:28.632184 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.632158 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" event={"ID":"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2","Type":"ContainerStarted","Data":"0485c61e629af753019d0a81e8022540e3c3aa04b230ccd77d7880af538ec8ed"} Jul 21 16:24:28.632276 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.632231 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" event={"ID":"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2","Type":"ContainerStarted","Data":"aaf2764ea0c8f82b2c331577bfe0f9fda257184ea018e6a4d5d7b80b21ba6be0"} Jul 21 16:24:28.633719 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.633695 2564 generic.go:356] "Generic (PLEG): container finished" podID="101dcab9-c146-43d6-9b88-ae1e95393876" containerID="90e9529be39116dbcb3297d90344a2cd6745abc5ad79d370d66da53e13cc62ec" exitCode=0 Jul 21 16:24:28.633828 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.633781 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glgxw" event={"ID":"101dcab9-c146-43d6-9b88-ae1e95393876","Type":"ContainerDied","Data":"90e9529be39116dbcb3297d90344a2cd6745abc5ad79d370d66da53e13cc62ec"} Jul 21 16:24:28.635252 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.635228 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-95ppj" event={"ID":"2e834d1b-3be2-4b3e-a43b-70b049ffba0a","Type":"ContainerStarted","Data":"c7a65b020a885afdb471a9698c44608a480ae438380a56db8b7e1fdf8df08927"} Jul 21 16:24:28.636645 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.636627 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-c8w72" event={"ID":"5fd5788c-5004-4dac-9916-48fc618aeaa8","Type":"ContainerStarted","Data":"781ca9df98a681795239ea67ff92403be31391a7d71413fadc6095ec36eb0480"} Jul 21 16:24:28.644468 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.644426 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-f6sqs" podStartSLOduration=2.432925519 podStartE2EDuration="22.644415397s" totalImagesPullingTime="20.211489878s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:28.643610918 +0000 UTC m=+23.711691597" watchObservedRunningTime="2026-07-21 16:24:28.644415397 +0000 UTC m=+23.712496075" Jul 21 16:24:28.670883 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.670841 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fndhg" podStartSLOduration=2.410555477 podStartE2EDuration="22.67082249s" totalImagesPullingTime="20.260267013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:28.657996685 +0000 UTC m=+23.726077364" watchObservedRunningTime="2026-07-21 16:24:28.67082249 +0000 UTC m=+23.738903170" Jul 21 16:24:28.684727 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.684662 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-54.ec2.internal" podStartSLOduration=21.684647277 podStartE2EDuration="21.684647277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:24:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:28.670909885 +0000 UTC m=+23.738990564" watchObservedRunningTime="2026-07-21 16:24:28.684647277 +0000 UTC m=+23.752727957" Jul 21 16:24:28.684917 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.684887 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-95ppj" podStartSLOduration=7.041901423 podStartE2EDuration="22.684876828s" totalImagesPullingTime="15.642975405s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:28.684817362 +0000 UTC m=+23.752898041" watchObservedRunningTime="2026-07-21 16:24:28.684876828 +0000 UTC m=+23.752957507" Jul 21 16:24:28.700429 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.700247 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mzfbt" podStartSLOduration=2.459920632 podStartE2EDuration="22.700229078s" totalImagesPullingTime="20.240308446s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:28.699618903 +0000 UTC m=+23.767699584" watchObservedRunningTime="2026-07-21 16:24:28.700229078 +0000 UTC m=+23.768309756" Jul 21 16:24:28.739569 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:28.739519 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-c8w72" podStartSLOduration=2.471844331 podStartE2EDuration="22.739502144s" totalImagesPullingTime="20.267657813s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:28.739026999 +0000 UTC m=+23.807107689" watchObservedRunningTime="2026-07-21 16:24:28.739502144 +0000 UTC m=+23.807582823" Jul 21 16:24:29.538346 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:29.538272 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:29.538554 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:29.538446 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:29.640862 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:29.640838 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:24:29.641406 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:29.641113 2564 generic.go:356] "Generic (PLEG): container finished" podID="d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2" containerID="0485c61e629af753019d0a81e8022540e3c3aa04b230ccd77d7880af538ec8ed" exitCode=1 Jul 21 16:24:29.641406 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:29.641176 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" event={"ID":"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2","Type":"ContainerDied","Data":"0485c61e629af753019d0a81e8022540e3c3aa04b230ccd77d7880af538ec8ed"} Jul 21 16:24:29.641406 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:29.641245 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" event={"ID":"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2","Type":"ContainerStarted","Data":"729e497a5715d48b84f1b6a797311c07468cccef9813dffc605b95f6390d240e"} Jul 21 16:24:29.641406 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:29.641293 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" event={"ID":"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2","Type":"ContainerStarted","Data":"47b3011062ac0649db57df1876878bea9db056f166b1f3839f4711e27ceb3fec"} Jul 21 16:24:29.641406 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:29.641325 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" event={"ID":"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2","Type":"ContainerStarted","Data":"6c46bcc566b6b199b6793f255d3eefc0a6ac8ad479925194deab60ead6232539"} Jul 21 16:24:29.641406 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:29.641367 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" event={"ID":"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2","Type":"ContainerStarted","Data":"a774858f6021ae9c671510bb5099b20f466bcc3faf576b8b5e51e3da5548c796"} Jul 21 16:24:29.642518 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:29.642493 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-2hnb8" event={"ID":"1f10dea7-bca8-47b8-85ef-e206f7d3f33d","Type":"ContainerStarted","Data":"b020b23f24b6d3dff2ab36abf2cb2aef4fe5f405527173ed1b17a579bbe86cf7"} Jul 21 16:24:29.662709 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:29.662669 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-2hnb8" podStartSLOduration=3.652709568 podStartE2EDuration="23.662654405s" totalImagesPullingTime="20.009944837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:29.662643505 +0000 UTC m=+24.730724188" watchObservedRunningTime="2026-07-21 16:24:29.662654405 +0000 UTC m=+24.730735078" Jul 21 16:24:29.760012 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:29.759985 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 21 16:24:30.383845 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:30.383758 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-21T16:24:29.7600057Z","UUID":"30208de5-fede-4e27-bc78-02cffc4f3378","Handler":null,"Name":"","Endpoint":""} Jul 21 16:24:30.385395 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:30.385276 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 21 16:24:30.385395 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:30.385318 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 21 16:24:30.538714 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:30.538682 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:30.538957 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:30.538803 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:30.538957 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:30.538857 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:30.539030 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:30.538959 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:30.646871 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:30.646787 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" event={"ID":"a5eeb793-26f0-459e-ab52-390e675b6a33","Type":"ContainerStarted","Data":"d20cc2991bf81439ff38d1f70be55fcb632baaa3901a29059093821aa9621a52"} Jul 21 16:24:31.538790 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:31.538762 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:31.538955 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:31.538904 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:31.650831 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:31.650618 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" event={"ID":"a5eeb793-26f0-459e-ab52-390e675b6a33","Type":"ContainerStarted","Data":"c8afaf7f1b56d846a8711c03e727960d4ba25fcef5a7a6d094e1e7110c8fc82c"} Jul 21 16:24:31.653332 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:31.653312 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:24:31.653708 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:31.653688 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" event={"ID":"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2","Type":"ContainerStarted","Data":"97edba2af2324c398ffc95f99f2dfeb14f89cc6c1367a58a21dd6d1762c50281"} Jul 21 16:24:31.697348 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:31.697305 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:31.698022 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:31.698003 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:32.538950 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:32.538914 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:32.538950 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:32.538954 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:32.539207 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:32.539031 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:32.539207 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:32.539124 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:32.656066 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:32.656030 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:32.656610 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:32.656590 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fndhg" Jul 21 16:24:32.673131 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:32.673086 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mnnpj" podStartSLOduration=3.396362291 podStartE2EDuration="26.673068574s" totalImagesPullingTime="23.276706283s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:32.672071041 +0000 UTC m=+27.740151720" watchObservedRunningTime="2026-07-21 16:24:32.673068574 +0000 UTC m=+27.741149255" Jul 21 16:24:33.538256 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:33.538225 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:33.538424 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:33.538337 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:34.539101 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:34.538906 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:34.539716 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:34.538928 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:34.539716 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:34.539210 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:34.539716 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:34.539239 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:34.662895 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:34.662865 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:24:34.663250 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:34.663217 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" event={"ID":"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2","Type":"ContainerStarted","Data":"406f96c30b54c2e516d0758b39badcb9a00fbeb66a3268406bdf9ac16caf55d6"} Jul 21 16:24:34.665854 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:34.664289 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:34.665854 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:34.664417 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:34.665854 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:34.664906 2564 scope.go:117] "RemoveContainer" containerID="0485c61e629af753019d0a81e8022540e3c3aa04b230ccd77d7880af538ec8ed" Jul 21 16:24:34.668071 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:34.668043 2564 generic.go:356] "Generic (PLEG): container finished" podID="101dcab9-c146-43d6-9b88-ae1e95393876" containerID="421f3f56536cd29db5c281c0035c25396410370d445ae7402734e8f8c564b33d" exitCode=0 Jul 21 16:24:34.668208 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:34.668139 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glgxw" event={"ID":"101dcab9-c146-43d6-9b88-ae1e95393876","Type":"ContainerDied","Data":"421f3f56536cd29db5c281c0035c25396410370d445ae7402734e8f8c564b33d"} Jul 21 16:24:34.682465 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:34.682445 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:35.539798 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.539770 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:35.540175 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:35.539856 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:35.650905 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.650643 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7pmmh"] Jul 21 16:24:35.654254 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.654227 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nvgjf"] Jul 21 16:24:35.654375 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.654354 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:35.654526 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:35.654494 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:35.654904 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.654877 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c7pb5"] Jul 21 16:24:35.654994 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.654968 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:35.655061 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:35.655039 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:35.675373 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.675350 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:24:35.675847 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.675819 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" event={"ID":"d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2","Type":"ContainerStarted","Data":"0d8a848aabddf632c8195491db7ed0612e50426293f8d9f025c79a395ddfeb2b"} Jul 21 16:24:35.676207 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.676188 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:35.678808 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.678782 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glgxw" event={"ID":"101dcab9-c146-43d6-9b88-ae1e95393876","Type":"ContainerStarted","Data":"9aa114ce1240540fa741c15c3701974d13c6e770f3585f7b5d63b92fe276bd0d"} Jul 21 16:24:35.678918 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.678808 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:35.678918 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:35.678907 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:35.697063 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.697041 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:24:35.705373 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:35.705218 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" podStartSLOduration=9.028635033 podStartE2EDuration="29.705199012s" totalImagesPullingTime="20.676563979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:35.705171998 +0000 UTC m=+30.773252687" watchObservedRunningTime="2026-07-21 16:24:35.705199012 +0000 UTC m=+30.773279693" Jul 21 16:24:36.682803 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:36.682768 2564 generic.go:356] "Generic (PLEG): container finished" podID="101dcab9-c146-43d6-9b88-ae1e95393876" containerID="9aa114ce1240540fa741c15c3701974d13c6e770f3585f7b5d63b92fe276bd0d" exitCode=0 Jul 21 16:24:36.683278 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:36.682843 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glgxw" event={"ID":"101dcab9-c146-43d6-9b88-ae1e95393876","Type":"ContainerDied","Data":"9aa114ce1240540fa741c15c3701974d13c6e770f3585f7b5d63b92fe276bd0d"} Jul 21 16:24:37.539167 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:37.539135 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:37.539301 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:37.539136 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:37.539301 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:37.539265 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:37.539428 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:37.539136 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:37.539428 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:37.539377 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:37.539536 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:37.539436 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:38.689058 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:38.689024 2564 generic.go:356] "Generic (PLEG): container finished" podID="101dcab9-c146-43d6-9b88-ae1e95393876" containerID="6880e1d071ce6d5f5974f7f567b1bc07ccd55cde0bd6904b349cedb84d383756" exitCode=0 Jul 21 16:24:38.689589 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:38.689082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glgxw" event={"ID":"101dcab9-c146-43d6-9b88-ae1e95393876","Type":"ContainerDied","Data":"6880e1d071ce6d5f5974f7f567b1bc07ccd55cde0bd6904b349cedb84d383756"} Jul 21 16:24:39.088981 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:39.088944 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:39.088981 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:39.088986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:39.089176 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:39.089083 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:39.089176 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:39.089087 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:39.089176 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:39.089135 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs podName:c974f0bb-6dcd-41e6-b77d-7475f2fb2665 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:11.089121594 +0000 UTC m=+66.157202251 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs") pod "network-metrics-daemon-nvgjf" (UID: "c974f0bb-6dcd-41e6-b77d-7475f2fb2665") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 21 16:24:39.089176 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:39.089148 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret podName:8ac3a036-67b1-49e6-a075-7f43a9dbc6c5 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:11.089142729 +0000 UTC m=+66.157223386 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret") pod "global-pull-secret-syncer-c7pb5" (UID: "8ac3a036-67b1-49e6-a075-7f43a9dbc6c5") : object "kube-system"/"original-pull-secret" not registered Jul 21 16:24:39.290732 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:39.290693 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8694\" (UniqueName: \"kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694\") pod \"network-check-target-7pmmh\" (UID: \"ab0228ef-d9ea-433b-b577-78eeb501c821\") " pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:39.290928 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:39.290843 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 21 16:24:39.290928 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:39.290870 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 21 16:24:39.290928 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:39.290883 2564 projected.go:196] Error preparing data for projected volume kube-api-access-p8694 for pod openshift-network-diagnostics/network-check-target-7pmmh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:39.291032 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:39.290947 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694 podName:ab0228ef-d9ea-433b-b577-78eeb501c821 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:11.290929317 +0000 UTC m=+66.359009996 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p8694" (UniqueName: "kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694") pod "network-check-target-7pmmh" (UID: "ab0228ef-d9ea-433b-b577-78eeb501c821") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 21 16:24:39.538394 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:39.538332 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:39.538394 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:39.538349 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:39.538617 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:39.538478 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:39.538617 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:39.538577 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:39.538724 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:39.538636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:39.538724 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:39.538714 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:41.538272 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.538230 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:41.538272 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.538264 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:41.538939 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.538267 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:41.538939 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:41.538366 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7pmmh" podUID="ab0228ef-d9ea-433b-b577-78eeb501c821" Jul 21 16:24:41.538939 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:41.538451 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:24:41.538939 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:41.538507 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-c7pb5" podUID="8ac3a036-67b1-49e6-a075-7f43a9dbc6c5" Jul 21 16:24:41.553114 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.553090 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-54.ec2.internal" event="NodeReady" Jul 21 16:24:41.553250 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.553224 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 21 16:24:41.597319 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.597280 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-92b7c"] Jul 21 16:24:41.600105 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.600076 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.600546 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.600489 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4zxbn"] Jul 21 16:24:41.602390 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.602367 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4zxbn" Jul 21 16:24:41.602695 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.602577 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kwsf5\"" Jul 21 16:24:41.603061 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.602911 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 21 16:24:41.603061 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.602940 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 21 16:24:41.604228 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.604207 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 21 16:24:41.604684 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.604495 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 21 16:24:41.604684 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.604546 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4tvjl\"" Jul 21 16:24:41.604684 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.604621 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 21 16:24:41.610969 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.610950 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-92b7c"] Jul 21 16:24:41.615967 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.615943 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4zxbn"] Jul 21 16:24:41.709464 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.709375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cca2f967-6f78-43f0-899d-e26230c2ed65-config-volume\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.709464 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.709414 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r55zx\" (UniqueName: \"kubernetes.io/projected/cca2f967-6f78-43f0-899d-e26230c2ed65-kube-api-access-r55zx\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.709684 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.709481 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.709684 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.709505 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j89wv\" (UniqueName: \"kubernetes.io/projected/ddae606c-873e-4b94-8a82-425df16e34f7-kube-api-access-j89wv\") pod \"ingress-canary-4zxbn\" (UID: \"ddae606c-873e-4b94-8a82-425df16e34f7\") " pod="openshift-ingress-canary/ingress-canary-4zxbn" Jul 21 16:24:41.709684 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.709530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca2f967-6f78-43f0-899d-e26230c2ed65-tmp-dir\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.709684 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.709552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddae606c-873e-4b94-8a82-425df16e34f7-cert\") pod \"ingress-canary-4zxbn\" (UID: \"ddae606c-873e-4b94-8a82-425df16e34f7\") " pod="openshift-ingress-canary/ingress-canary-4zxbn" Jul 21 16:24:41.809939 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.809904 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca2f967-6f78-43f0-899d-e26230c2ed65-tmp-dir\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.809939 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.809941 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddae606c-873e-4b94-8a82-425df16e34f7-cert\") pod \"ingress-canary-4zxbn\" (UID: \"ddae606c-873e-4b94-8a82-425df16e34f7\") " pod="openshift-ingress-canary/ingress-canary-4zxbn" Jul 21 16:24:41.810177 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.810017 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cca2f967-6f78-43f0-899d-e26230c2ed65-config-volume\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.810177 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.810049 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r55zx\" (UniqueName: \"kubernetes.io/projected/cca2f967-6f78-43f0-899d-e26230c2ed65-kube-api-access-r55zx\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.810177 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.810100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.810177 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.810124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j89wv\" (UniqueName: \"kubernetes.io/projected/ddae606c-873e-4b94-8a82-425df16e34f7-kube-api-access-j89wv\") pod \"ingress-canary-4zxbn\" (UID: \"ddae606c-873e-4b94-8a82-425df16e34f7\") " pod="openshift-ingress-canary/ingress-canary-4zxbn" Jul 21 16:24:41.810382 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:41.810236 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 16:24:41.810382 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:41.810302 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls podName:cca2f967-6f78-43f0-899d-e26230c2ed65 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:42.310282666 +0000 UTC m=+37.378363326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls") pod "dns-default-92b7c" (UID: "cca2f967-6f78-43f0-899d-e26230c2ed65") : secret "dns-default-metrics-tls" not found Jul 21 16:24:41.810382 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.810308 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca2f967-6f78-43f0-899d-e26230c2ed65-tmp-dir\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.810686 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.810663 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cca2f967-6f78-43f0-899d-e26230c2ed65-config-volume\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.814697 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.814674 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ddae606c-873e-4b94-8a82-425df16e34f7-cert\") pod \"ingress-canary-4zxbn\" (UID: \"ddae606c-873e-4b94-8a82-425df16e34f7\") " pod="openshift-ingress-canary/ingress-canary-4zxbn" Jul 21 16:24:41.818543 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.818499 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r55zx\" (UniqueName: \"kubernetes.io/projected/cca2f967-6f78-43f0-899d-e26230c2ed65-kube-api-access-r55zx\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:41.818723 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.818699 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j89wv\" (UniqueName: \"kubernetes.io/projected/ddae606c-873e-4b94-8a82-425df16e34f7-kube-api-access-j89wv\") pod \"ingress-canary-4zxbn\" (UID: \"ddae606c-873e-4b94-8a82-425df16e34f7\") " pod="openshift-ingress-canary/ingress-canary-4zxbn" Jul 21 16:24:41.919427 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:41.919391 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4zxbn" Jul 21 16:24:42.314056 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:42.314015 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:42.314233 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:42.314183 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 16:24:42.314280 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:42.314262 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls podName:cca2f967-6f78-43f0-899d-e26230c2ed65 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:43.314245324 +0000 UTC m=+38.382326000 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls") pod "dns-default-92b7c" (UID: "cca2f967-6f78-43f0-899d-e26230c2ed65") : secret "dns-default-metrics-tls" not found Jul 21 16:24:42.984229 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:42.984062 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4zxbn"] Jul 21 16:24:42.989448 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:42.989421 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddae606c_873e_4b94_8a82_425df16e34f7.slice/crio-765fad37d46553c81cbe9afd8e1b1a493bdf9baf99e7a960e511dae016768e04 WatchSource:0}: Error finding container 765fad37d46553c81cbe9afd8e1b1a493bdf9baf99e7a960e511dae016768e04: Status 404 returned error can't find the container with id 765fad37d46553c81cbe9afd8e1b1a493bdf9baf99e7a960e511dae016768e04 Jul 21 16:24:43.319811 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.319764 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:43.319989 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:43.319899 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 16:24:43.319989 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:43.319962 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls podName:cca2f967-6f78-43f0-899d-e26230c2ed65 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:45.319946486 +0000 UTC m=+40.388027147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls") pod "dns-default-92b7c" (UID: "cca2f967-6f78-43f0-899d-e26230c2ed65") : secret "dns-default-metrics-tls" not found Jul 21 16:24:43.538682 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.538643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:24:43.538888 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.538643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:24:43.538956 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.538890 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:24:43.541390 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.541360 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 16:24:43.541390 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.541366 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 16:24:43.542321 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.542305 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mwzzh\"" Jul 21 16:24:43.542409 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.542351 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxwcv\"" Jul 21 16:24:43.542409 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.542380 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 16:24:43.542409 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.542401 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 16:24:43.703785 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.703734 2564 generic.go:356] "Generic (PLEG): container finished" podID="101dcab9-c146-43d6-9b88-ae1e95393876" containerID="5b264cc06d116261e4778e0d65e51557c630513266b61361fe7f6ed575c2fc98" exitCode=0 Jul 21 16:24:43.703957 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.703785 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glgxw" event={"ID":"101dcab9-c146-43d6-9b88-ae1e95393876","Type":"ContainerDied","Data":"5b264cc06d116261e4778e0d65e51557c630513266b61361fe7f6ed575c2fc98"} Jul 21 16:24:43.705201 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:43.705172 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4zxbn" event={"ID":"ddae606c-873e-4b94-8a82-425df16e34f7","Type":"ContainerStarted","Data":"765fad37d46553c81cbe9afd8e1b1a493bdf9baf99e7a960e511dae016768e04"} Jul 21 16:24:44.710643 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:44.710611 2564 generic.go:356] "Generic (PLEG): container finished" podID="101dcab9-c146-43d6-9b88-ae1e95393876" containerID="124bcc178d1fa05ebb23b443d884f9e457ba420ad973f7d106fa60d9991788ff" exitCode=0 Jul 21 16:24:44.711070 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:44.710663 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glgxw" event={"ID":"101dcab9-c146-43d6-9b88-ae1e95393876","Type":"ContainerDied","Data":"124bcc178d1fa05ebb23b443d884f9e457ba420ad973f7d106fa60d9991788ff"} Jul 21 16:24:45.339051 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:45.338624 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:45.339227 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:45.339086 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 16:24:45.339227 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:45.339148 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls podName:cca2f967-6f78-43f0-899d-e26230c2ed65 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:49.339128671 +0000 UTC m=+44.407209343 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls") pod "dns-default-92b7c" (UID: "cca2f967-6f78-43f0-899d-e26230c2ed65") : secret "dns-default-metrics-tls" not found Jul 21 16:24:45.714892 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:45.714848 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4zxbn" event={"ID":"ddae606c-873e-4b94-8a82-425df16e34f7","Type":"ContainerStarted","Data":"bbaf91c1f44407cbff6c126b7d572fe9af76d05ef936f2c21bb159421b406483"} Jul 21 16:24:45.718660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:45.718632 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-glgxw" event={"ID":"101dcab9-c146-43d6-9b88-ae1e95393876","Type":"ContainerStarted","Data":"fb88d1e2b11defb0f4f5693a588ff5105834bdac276238a783e5d54ced66a7e8"} Jul 21 16:24:45.730678 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:45.730578 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4zxbn" podStartSLOduration=2.198331089 podStartE2EDuration="4.730562811s" totalImagesPullingTime="2.532231722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:45.730090463 +0000 UTC m=+40.798171143" watchObservedRunningTime="2026-07-21 16:24:45.730562811 +0000 UTC m=+40.798643490" Jul 21 16:24:45.756697 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:45.756639 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-glgxw" podStartSLOduration=8.312541731 podStartE2EDuration="39.756616939s" totalImagesPullingTime="31.444075208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:24:45.755616654 +0000 UTC m=+40.823697332" watchObservedRunningTime="2026-07-21 16:24:45.756616939 +0000 UTC m=+40.824697616" Jul 21 16:24:49.367924 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:49.367895 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:49.368321 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:49.368004 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 16:24:49.368321 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:49.368051 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls podName:cca2f967-6f78-43f0-899d-e26230c2ed65 nodeName:}" failed. No retries permitted until 2026-07-21 16:24:57.368039329 +0000 UTC m=+52.436119986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls") pod "dns-default-92b7c" (UID: "cca2f967-6f78-43f0-899d-e26230c2ed65") : secret "dns-default-metrics-tls" not found Jul 21 16:24:57.000498 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.000463 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24"] Jul 21 16:24:57.016126 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.016099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.017177 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.017150 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24"] Jul 21 16:24:57.018945 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.018917 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 21 16:24:57.019341 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.019315 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 21 16:24:57.019447 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.019370 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 21 16:24:57.019906 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.019866 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 21 16:24:57.019906 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.019868 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 21 16:24:57.020070 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.019870 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 21 16:24:57.020070 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.019892 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 21 16:24:57.118815 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.118783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.118998 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.118830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-hub\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.118998 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.118850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-ca\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.118998 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.118867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a0f4308-026d-4a3b-8d39-19a048ea6183-additional-service-ca\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.118998 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.118899 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.119132 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.119015 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv59z\" (UniqueName: \"kubernetes.io/projected/6a0f4308-026d-4a3b-8d39-19a048ea6183-kube-api-access-pv59z\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.220227 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.220195 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-hub\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.220337 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.220233 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-ca\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.220337 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.220255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a0f4308-026d-4a3b-8d39-19a048ea6183-additional-service-ca\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.220337 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.220273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.220481 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.220445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv59z\" (UniqueName: \"kubernetes.io/projected/6a0f4308-026d-4a3b-8d39-19a048ea6183-kube-api-access-pv59z\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.220535 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.220502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.221149 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.221120 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/6a0f4308-026d-4a3b-8d39-19a048ea6183-additional-service-ca\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.224221 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.224195 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.224317 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.224202 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-ca\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.224317 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.224251 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.224317 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.224303 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/6a0f4308-026d-4a3b-8d39-19a048ea6183-hub\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.227891 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.227872 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv59z\" (UniqueName: \"kubernetes.io/projected/6a0f4308-026d-4a3b-8d39-19a048ea6183-kube-api-access-pv59z\") pod \"cluster-proxy-proxy-agent-769b7849b4-ndl24\" (UID: \"6a0f4308-026d-4a3b-8d39-19a048ea6183\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.334387 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.334299 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:24:57.421876 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.421849 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:24:57.422029 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:57.421993 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 16:24:57.422070 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:24:57.422043 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls podName:cca2f967-6f78-43f0-899d-e26230c2ed65 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:13.422029627 +0000 UTC m=+68.490110285 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls") pod "dns-default-92b7c" (UID: "cca2f967-6f78-43f0-899d-e26230c2ed65") : secret "dns-default-metrics-tls" not found Jul 21 16:24:57.478187 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.478148 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24"] Jul 21 16:24:57.493548 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:24:57.493518 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a0f4308_026d_4a3b_8d39_19a048ea6183.slice/crio-6f09da2cda8d09bdc20164dfd0541cb51c86526ab8100ce8d3746cddadb606de WatchSource:0}: Error finding container 6f09da2cda8d09bdc20164dfd0541cb51c86526ab8100ce8d3746cddadb606de: Status 404 returned error can't find the container with id 6f09da2cda8d09bdc20164dfd0541cb51c86526ab8100ce8d3746cddadb606de Jul 21 16:24:57.748155 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:24:57.748124 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" event={"ID":"6a0f4308-026d-4a3b-8d39-19a048ea6183","Type":"ContainerStarted","Data":"6f09da2cda8d09bdc20164dfd0541cb51c86526ab8100ce8d3746cddadb606de"} Jul 21 16:25:02.761282 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:02.761253 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" event={"ID":"6a0f4308-026d-4a3b-8d39-19a048ea6183","Type":"ContainerStarted","Data":"31fe56cc7af465c3fa8efbccb7f5a25f70612777b8b2563200d41b2ae981186e"} Jul 21 16:25:02.761571 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:02.761296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" event={"ID":"6a0f4308-026d-4a3b-8d39-19a048ea6183","Type":"ContainerStarted","Data":"f26094a9073fc64d54ec4b037b15a952e44b5f8787141d98d549b0c27a4cdcf1"} Jul 21 16:25:03.765556 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:03.765519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" event={"ID":"6a0f4308-026d-4a3b-8d39-19a048ea6183","Type":"ContainerStarted","Data":"5c0e5525886c5d28c68ab521a334ad030ce243afd00de3486eba82f6e11f6fe1"} Jul 21 16:25:03.804936 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:03.804880 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" podStartSLOduration=2.681302985 podStartE2EDuration="7.804859615s" totalImagesPullingTime="5.12355663s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:03.804480478 +0000 UTC m=+58.872561157" watchObservedRunningTime="2026-07-21 16:25:03.804859615 +0000 UTC m=+58.872940295" Jul 21 16:25:07.703066 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:07.703038 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mnx9h" Jul 21 16:25:11.114821 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.114735 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:25:11.115294 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.114843 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:25:11.117409 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.117373 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 21 16:25:11.117526 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.117422 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 21 16:25:11.125177 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:25:11.125156 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 21 16:25:11.125233 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:25:11.125220 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs podName:c974f0bb-6dcd-41e6-b77d-7475f2fb2665 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:15.125203921 +0000 UTC m=+130.193284583 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs") pod "network-metrics-daemon-nvgjf" (UID: "c974f0bb-6dcd-41e6-b77d-7475f2fb2665") : secret "metrics-daemon-secret" not found Jul 21 16:25:11.127287 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.127265 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8ac3a036-67b1-49e6-a075-7f43a9dbc6c5-original-pull-secret\") pod \"global-pull-secret-syncer-c7pb5\" (UID: \"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5\") " pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:25:11.161724 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.161686 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-c7pb5" Jul 21 16:25:11.284381 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.284344 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-c7pb5"] Jul 21 16:25:11.288275 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:25:11.288237 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac3a036_67b1_49e6_a075_7f43a9dbc6c5.slice/crio-422e48b8dc7f9ea8c81610752d4155004b8ef7ad86d8d24d51e36eccf29c1996 WatchSource:0}: Error finding container 422e48b8dc7f9ea8c81610752d4155004b8ef7ad86d8d24d51e36eccf29c1996: Status 404 returned error can't find the container with id 422e48b8dc7f9ea8c81610752d4155004b8ef7ad86d8d24d51e36eccf29c1996 Jul 21 16:25:11.316973 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.316928 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8694\" (UniqueName: \"kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694\") pod \"network-check-target-7pmmh\" (UID: \"ab0228ef-d9ea-433b-b577-78eeb501c821\") " pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:25:11.319627 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.319607 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 21 16:25:11.330173 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.330147 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 21 16:25:11.340402 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.340363 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8694\" (UniqueName: \"kubernetes.io/projected/ab0228ef-d9ea-433b-b577-78eeb501c821-kube-api-access-p8694\") pod \"network-check-target-7pmmh\" (UID: \"ab0228ef-d9ea-433b-b577-78eeb501c821\") " pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:25:11.452043 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.451956 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nxwcv\"" Jul 21 16:25:11.459805 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.459785 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:25:11.578675 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.578642 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7pmmh"] Jul 21 16:25:11.581922 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:25:11.581897 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab0228ef_d9ea_433b_b577_78eeb501c821.slice/crio-28867a574f31b3c45e08d4cabed9fafcecd5dfce33df8bc879ba2047ebbee2c9 WatchSource:0}: Error finding container 28867a574f31b3c45e08d4cabed9fafcecd5dfce33df8bc879ba2047ebbee2c9: Status 404 returned error can't find the container with id 28867a574f31b3c45e08d4cabed9fafcecd5dfce33df8bc879ba2047ebbee2c9 Jul 21 16:25:11.786248 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.786211 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7pmmh" event={"ID":"ab0228ef-d9ea-433b-b577-78eeb501c821","Type":"ContainerStarted","Data":"28867a574f31b3c45e08d4cabed9fafcecd5dfce33df8bc879ba2047ebbee2c9"} Jul 21 16:25:11.787277 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:11.787250 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c7pb5" event={"ID":"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5","Type":"ContainerStarted","Data":"422e48b8dc7f9ea8c81610752d4155004b8ef7ad86d8d24d51e36eccf29c1996"} Jul 21 16:25:13.433392 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:13.433339 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:25:13.433901 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:25:13.433502 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 16:25:13.433901 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:25:13.433572 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls podName:cca2f967-6f78-43f0-899d-e26230c2ed65 nodeName:}" failed. No retries permitted until 2026-07-21 16:25:45.433551514 +0000 UTC m=+100.501632193 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls") pod "dns-default-92b7c" (UID: "cca2f967-6f78-43f0-899d-e26230c2ed65") : secret "dns-default-metrics-tls" not found Jul 21 16:25:16.802765 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:16.802708 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7pmmh" event={"ID":"ab0228ef-d9ea-433b-b577-78eeb501c821","Type":"ContainerStarted","Data":"4f5a000443638df0a0c2e21dae0b8a555285ece11489029628a55508b10ecca2"} Jul 21 16:25:16.803212 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:16.802832 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:25:16.804139 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:16.804118 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-c7pb5" event={"ID":"8ac3a036-67b1-49e6-a075-7f43a9dbc6c5","Type":"ContainerStarted","Data":"b94e5b0923f6a2f5232c43afb4f0a1a8cfedbb61868778d9a5f2887602d770f4"} Jul 21 16:25:16.831583 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:16.831536 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-c7pb5" podStartSLOduration=65.919365422 podStartE2EDuration="1m10.831522629s" totalImagesPullingTime="4.912157207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:16.831268655 +0000 UTC m=+71.899349345" watchObservedRunningTime="2026-07-21 16:25:16.831522629 +0000 UTC m=+71.899603308" Jul 21 16:25:16.831794 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:16.831611 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7pmmh" podStartSLOduration=66.216573434 podStartE2EDuration="1m10.83160532s" totalImagesPullingTime="4.615031886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:25:16.817555957 +0000 UTC m=+71.885636638" watchObservedRunningTime="2026-07-21 16:25:16.83160532 +0000 UTC m=+71.899686002" Jul 21 16:25:45.457598 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:45.457508 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:25:45.458007 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:25:45.457642 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 16:25:45.458007 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:25:45.457698 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls podName:cca2f967-6f78-43f0-899d-e26230c2ed65 nodeName:}" failed. No retries permitted until 2026-07-21 16:26:49.45768323 +0000 UTC m=+164.525763904 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls") pod "dns-default-92b7c" (UID: "cca2f967-6f78-43f0-899d-e26230c2ed65") : secret "dns-default-metrics-tls" not found Jul 21 16:25:47.810562 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:25:47.810530 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7pmmh" Jul 21 16:26:15.166529 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:26:15.166477 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:26:15.167024 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:26:15.166646 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 21 16:26:15.167024 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:26:15.166719 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs podName:c974f0bb-6dcd-41e6-b77d-7475f2fb2665 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:17.166703944 +0000 UTC m=+252.234784601 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs") pod "network-metrics-daemon-nvgjf" (UID: "c974f0bb-6dcd-41e6-b77d-7475f2fb2665") : secret "metrics-daemon-secret" not found Jul 21 16:26:44.612797 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:26:44.612717 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-92b7c" podUID="cca2f967-6f78-43f0-899d-e26230c2ed65" Jul 21 16:26:45.050995 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:26:45.050969 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-92b7c" Jul 21 16:26:46.554976 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:26:46.554926 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-nvgjf" podUID="c974f0bb-6dcd-41e6-b77d-7475f2fb2665" Jul 21 16:26:49.516075 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:26:49.516026 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:26:49.516494 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:26:49.516161 2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 21 16:26:49.516494 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:26:49.516212 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls podName:cca2f967-6f78-43f0-899d-e26230c2ed65 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:51.516199034 +0000 UTC m=+286.584279691 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls") pod "dns-default-92b7c" (UID: "cca2f967-6f78-43f0-899d-e26230c2ed65") : secret "dns-default-metrics-tls" not found Jul 21 16:27:01.538703 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:01.538614 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:27:56.666084 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.666047 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kjpxj"] Jul 21 16:27:56.667901 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.667882 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.671031 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.671002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7pk7c\"" Jul 21 16:27:56.671701 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.671684 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 21 16:27:56.671804 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.671723 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 21 16:27:56.671804 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.671766 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 21 16:27:56.672007 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.671993 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 21 16:27:56.681318 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.681298 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kjpxj"] Jul 21 16:27:56.775358 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.775320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9nx8\" (UniqueName: \"kubernetes.io/projected/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-api-access-w9nx8\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.775530 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.775369 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-crio-socket\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.775530 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.775424 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.775530 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.775479 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.775530 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.775501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-data-volume\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.876475 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.876427 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9nx8\" (UniqueName: \"kubernetes.io/projected/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-api-access-w9nx8\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.876582 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.876491 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-crio-socket\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.876582 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.876531 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.876582 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.876567 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-crio-socket\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.876678 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:56.876590 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 16:27:56.876678 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:56.876634 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 16:27:56.876678 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.876575 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.876678 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:56.876672 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm podName:bc9a2e27-85f0-4c37-ad6a-692cb316cae3 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:57.3766518 +0000 UTC m=+232.444732460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjpxj" (UID: "bc9a2e27-85f0-4c37-ad6a-692cb316cae3") : configmap "kube-rbac-proxy" not found Jul 21 16:27:56.876828 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:56.876759 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls podName:bc9a2e27-85f0-4c37-ad6a-692cb316cae3 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:57.376728622 +0000 UTC m=+232.444809283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjpxj" (UID: "bc9a2e27-85f0-4c37-ad6a-692cb316cae3") : secret "insights-runtime-extractor-tls" not found Jul 21 16:27:56.876828 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.876791 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-data-volume\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.877047 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.877034 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-data-volume\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:56.884529 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:56.884502 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9nx8\" (UniqueName: \"kubernetes.io/projected/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-api-access-w9nx8\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:57.129613 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.129576 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv"] Jul 21 16:27:57.131468 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.131454 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv" Jul 21 16:27:57.133895 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.133872 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 21 16:27:57.133895 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.133872 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 21 16:27:57.134139 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.134124 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-j8czt\"" Jul 21 16:27:57.140680 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.140658 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv"] Jul 21 16:27:57.280334 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.280298 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqsz2\" (UniqueName: \"kubernetes.io/projected/b3ee627e-1366-4c27-a01b-97b31572c9c0-kube-api-access-hqsz2\") pod \"migrator-7cc9c7ffd7-xzkwv\" (UID: \"b3ee627e-1366-4c27-a01b-97b31572c9c0\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv" Jul 21 16:27:57.381544 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.381444 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:57.381544 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.381509 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:57.381544 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.381537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqsz2\" (UniqueName: \"kubernetes.io/projected/b3ee627e-1366-4c27-a01b-97b31572c9c0-kube-api-access-hqsz2\") pod \"migrator-7cc9c7ffd7-xzkwv\" (UID: \"b3ee627e-1366-4c27-a01b-97b31572c9c0\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv" Jul 21 16:27:57.381794 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:57.381573 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 16:27:57.381794 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:57.381650 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm podName:bc9a2e27-85f0-4c37-ad6a-692cb316cae3 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:58.381632477 +0000 UTC m=+233.449713135 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjpxj" (UID: "bc9a2e27-85f0-4c37-ad6a-692cb316cae3") : configmap "kube-rbac-proxy" not found Jul 21 16:27:57.381794 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:57.381655 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 16:27:57.381794 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:57.381707 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls podName:bc9a2e27-85f0-4c37-ad6a-692cb316cae3 nodeName:}" failed. No retries permitted until 2026-07-21 16:27:58.381691881 +0000 UTC m=+233.449772554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjpxj" (UID: "bc9a2e27-85f0-4c37-ad6a-692cb316cae3") : secret "insights-runtime-extractor-tls" not found Jul 21 16:27:57.389570 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.389540 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqsz2\" (UniqueName: \"kubernetes.io/projected/b3ee627e-1366-4c27-a01b-97b31572c9c0-kube-api-access-hqsz2\") pod \"migrator-7cc9c7ffd7-xzkwv\" (UID: \"b3ee627e-1366-4c27-a01b-97b31572c9c0\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv" Jul 21 16:27:57.440379 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.440346 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv" Jul 21 16:27:57.566911 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:57.566881 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv"] Jul 21 16:27:57.570490 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:27:57.570465 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ee627e_1366_4c27_a01b_97b31572c9c0.slice/crio-3a6c72f461a3b06d2ec0b99bf3a718e8effb3586c3c957f8c0c00e42e94abea3 WatchSource:0}: Error finding container 3a6c72f461a3b06d2ec0b99bf3a718e8effb3586c3c957f8c0c00e42e94abea3: Status 404 returned error can't find the container with id 3a6c72f461a3b06d2ec0b99bf3a718e8effb3586c3c957f8c0c00e42e94abea3 Jul 21 16:27:58.252650 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:58.252606 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv" event={"ID":"b3ee627e-1366-4c27-a01b-97b31572c9c0","Type":"ContainerStarted","Data":"3a6c72f461a3b06d2ec0b99bf3a718e8effb3586c3c957f8c0c00e42e94abea3"} Jul 21 16:27:58.388077 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:58.388033 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:58.388255 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:58.388090 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:27:58.388255 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:58.388178 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 16:27:58.388255 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:58.388194 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 16:27:58.388255 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:58.388245 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls podName:bc9a2e27-85f0-4c37-ad6a-692cb316cae3 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:00.38823071 +0000 UTC m=+235.456311367 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjpxj" (UID: "bc9a2e27-85f0-4c37-ad6a-692cb316cae3") : secret "insights-runtime-extractor-tls" not found Jul 21 16:27:58.388255 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:27:58.388258 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm podName:bc9a2e27-85f0-4c37-ad6a-692cb316cae3 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:00.388251443 +0000 UTC m=+235.456332100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjpxj" (UID: "bc9a2e27-85f0-4c37-ad6a-692cb316cae3") : configmap "kube-rbac-proxy" not found Jul 21 16:27:58.417310 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:58.417284 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f6sqs_f52743c1-68c7-43af-84ef-20a962d73e7b/dns-node-resolver/0.log" Jul 21 16:27:59.256931 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:59.256892 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv" event={"ID":"b3ee627e-1366-4c27-a01b-97b31572c9c0","Type":"ContainerStarted","Data":"261f6198e91d4edc0c5d7a6f68f4d61d9430dff11e0fc527907b9bd4179f8056"} Jul 21 16:27:59.257315 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:59.256950 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv" event={"ID":"b3ee627e-1366-4c27-a01b-97b31572c9c0","Type":"ContainerStarted","Data":"20459967ddd68e6a4495edf180551150938cddedd43f3873168c3693435ef5d0"} Jul 21 16:27:59.274274 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:59.274229 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-xzkwv" podStartSLOduration=1.031806958 podStartE2EDuration="2.274213397s" totalImagesPullingTime="1.242406439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:27:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:27:59.273204985 +0000 UTC m=+234.341285664" watchObservedRunningTime="2026-07-21 16:27:59.274213397 +0000 UTC m=+234.342294075" Jul 21 16:27:59.417426 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:27:59.417400 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-95ppj_2e834d1b-3be2-4b3e-a43b-70b049ffba0a/node-ca/0.log" Jul 21 16:28:00.216973 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:00.216944 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4zxbn_ddae606c-873e-4b94-8a82-425df16e34f7/serve-healthcheck-canary/0.log" Jul 21 16:28:00.403949 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:00.403913 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:28:00.404395 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:00.403985 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:28:00.404395 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:28:00.404046 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 16:28:00.404395 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:28:00.404078 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 16:28:00.404395 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:28:00.404093 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm podName:bc9a2e27-85f0-4c37-ad6a-692cb316cae3 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:04.404081116 +0000 UTC m=+239.472161773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjpxj" (UID: "bc9a2e27-85f0-4c37-ad6a-692cb316cae3") : configmap "kube-rbac-proxy" not found Jul 21 16:28:00.404395 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:28:00.404129 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls podName:bc9a2e27-85f0-4c37-ad6a-692cb316cae3 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:04.404115531 +0000 UTC m=+239.472196194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjpxj" (UID: "bc9a2e27-85f0-4c37-ad6a-692cb316cae3") : secret "insights-runtime-extractor-tls" not found Jul 21 16:28:04.433002 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:04.432971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:28:04.433355 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:04.433023 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:28:04.433355 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:28:04.433105 2564 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 21 16:28:04.433355 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:28:04.433139 2564 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 21 16:28:04.433355 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:28:04.433176 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm podName:bc9a2e27-85f0-4c37-ad6a-692cb316cae3 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:12.433161088 +0000 UTC m=+247.501241766 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kjpxj" (UID: "bc9a2e27-85f0-4c37-ad6a-692cb316cae3") : configmap "kube-rbac-proxy" not found Jul 21 16:28:04.433355 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:28:04.433194 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls podName:bc9a2e27-85f0-4c37-ad6a-692cb316cae3 nodeName:}" failed. No retries permitted until 2026-07-21 16:28:12.433186329 +0000 UTC m=+247.501266986 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kjpxj" (UID: "bc9a2e27-85f0-4c37-ad6a-692cb316cae3") : secret "insights-runtime-extractor-tls" not found Jul 21 16:28:12.492400 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:12.492365 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:28:12.492828 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:12.492419 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:28:12.492929 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:12.492910 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:28:12.494702 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:12.494679 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bc9a2e27-85f0-4c37-ad6a-692cb316cae3-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kjpxj\" (UID: \"bc9a2e27-85f0-4c37-ad6a-692cb316cae3\") " pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:28:12.579390 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:12.579359 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-7pk7c\"" Jul 21 16:28:12.588096 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:12.588070 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kjpxj" Jul 21 16:28:12.715490 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:12.715454 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kjpxj"] Jul 21 16:28:12.719903 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:28:12.719873 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc9a2e27_85f0_4c37_ad6a_692cb316cae3.slice/crio-591f52c4bdf55201a4ddbabcd30a2f4ef36e5802c116e4ac2e2d13f623e01740 WatchSource:0}: Error finding container 591f52c4bdf55201a4ddbabcd30a2f4ef36e5802c116e4ac2e2d13f623e01740: Status 404 returned error can't find the container with id 591f52c4bdf55201a4ddbabcd30a2f4ef36e5802c116e4ac2e2d13f623e01740 Jul 21 16:28:13.296937 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:13.296891 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjpxj" event={"ID":"bc9a2e27-85f0-4c37-ad6a-692cb316cae3","Type":"ContainerStarted","Data":"591f52c4bdf55201a4ddbabcd30a2f4ef36e5802c116e4ac2e2d13f623e01740"} Jul 21 16:28:17.223451 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:17.223415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:28:17.225861 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:17.225837 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c974f0bb-6dcd-41e6-b77d-7475f2fb2665-metrics-certs\") pod \"network-metrics-daemon-nvgjf\" (UID: \"c974f0bb-6dcd-41e6-b77d-7475f2fb2665\") " pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:28:17.441762 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:17.441727 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mwzzh\"" Jul 21 16:28:17.449321 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:17.449286 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nvgjf" Jul 21 16:28:17.715797 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:17.715773 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nvgjf"] Jul 21 16:28:17.719148 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:28:17.719121 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc974f0bb_6dcd_41e6_b77d_7475f2fb2665.slice/crio-392d66f3be380826379428916e6195a4d7e45601aae59b1f178713144fa65d7f WatchSource:0}: Error finding container 392d66f3be380826379428916e6195a4d7e45601aae59b1f178713144fa65d7f: Status 404 returned error can't find the container with id 392d66f3be380826379428916e6195a4d7e45601aae59b1f178713144fa65d7f Jul 21 16:28:18.317443 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.317402 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjpxj" event={"ID":"bc9a2e27-85f0-4c37-ad6a-692cb316cae3","Type":"ContainerStarted","Data":"572e005ee19864189990072bd77dd31778bc7c265b04160732ee7d635ea3df1f"} Jul 21 16:28:18.318905 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.318876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvgjf" event={"ID":"c974f0bb-6dcd-41e6-b77d-7475f2fb2665","Type":"ContainerStarted","Data":"392d66f3be380826379428916e6195a4d7e45601aae59b1f178713144fa65d7f"} Jul 21 16:28:18.465976 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.465941 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d7c7547-d4s5c"] Jul 21 16:28:18.468210 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.468003 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.470323 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.470296 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 21 16:28:18.470785 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.470767 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 21 16:28:18.470995 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.470978 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 21 16:28:18.471650 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.471628 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kt5q5\"" Jul 21 16:28:18.476926 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.476906 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 21 16:28:18.481926 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.481895 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d7c7547-d4s5c"] Jul 21 16:28:18.532135 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.532100 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/815bc1ca-8539-42af-9e3f-c9211dff5f10-image-registry-private-configuration\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.532319 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.532152 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/815bc1ca-8539-42af-9e3f-c9211dff5f10-registry-tls\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.532319 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.532182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/815bc1ca-8539-42af-9e3f-c9211dff5f10-ca-trust-extracted\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.532319 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.532207 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/815bc1ca-8539-42af-9e3f-c9211dff5f10-installation-pull-secrets\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.532319 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.532241 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/815bc1ca-8539-42af-9e3f-c9211dff5f10-bound-sa-token\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.532319 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.532262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/815bc1ca-8539-42af-9e3f-c9211dff5f10-trusted-ca\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.532319 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.532291 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6zht\" (UniqueName: \"kubernetes.io/projected/815bc1ca-8539-42af-9e3f-c9211dff5f10-kube-api-access-q6zht\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.532319 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.532314 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/815bc1ca-8539-42af-9e3f-c9211dff5f10-registry-certificates\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.634033 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.633158 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/815bc1ca-8539-42af-9e3f-c9211dff5f10-trusted-ca\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.634033 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.633212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6zht\" (UniqueName: \"kubernetes.io/projected/815bc1ca-8539-42af-9e3f-c9211dff5f10-kube-api-access-q6zht\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.634033 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.633394 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/815bc1ca-8539-42af-9e3f-c9211dff5f10-registry-certificates\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.634033 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.633470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/815bc1ca-8539-42af-9e3f-c9211dff5f10-image-registry-private-configuration\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.634033 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.633512 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/815bc1ca-8539-42af-9e3f-c9211dff5f10-registry-tls\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.634033 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.633542 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/815bc1ca-8539-42af-9e3f-c9211dff5f10-ca-trust-extracted\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.634479 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.634040 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/815bc1ca-8539-42af-9e3f-c9211dff5f10-installation-pull-secrets\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.634479 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.634100 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/815bc1ca-8539-42af-9e3f-c9211dff5f10-bound-sa-token\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.634479 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.634357 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/815bc1ca-8539-42af-9e3f-c9211dff5f10-trusted-ca\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.634479 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.634388 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/815bc1ca-8539-42af-9e3f-c9211dff5f10-ca-trust-extracted\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.634679 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.634662 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/815bc1ca-8539-42af-9e3f-c9211dff5f10-registry-certificates\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.638599 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.637897 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/815bc1ca-8539-42af-9e3f-c9211dff5f10-installation-pull-secrets\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.638599 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.638448 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/815bc1ca-8539-42af-9e3f-c9211dff5f10-registry-tls\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.639916 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.639396 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/815bc1ca-8539-42af-9e3f-c9211dff5f10-image-registry-private-configuration\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.644667 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.644616 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/815bc1ca-8539-42af-9e3f-c9211dff5f10-bound-sa-token\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.645783 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.645726 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6zht\" (UniqueName: \"kubernetes.io/projected/815bc1ca-8539-42af-9e3f-c9211dff5f10-kube-api-access-q6zht\") pod \"image-registry-7d7c7547-d4s5c\" (UID: \"815bc1ca-8539-42af-9e3f-c9211dff5f10\") " pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.782212 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.782171 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:18.937804 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:18.937759 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d7c7547-d4s5c"] Jul 21 16:28:18.941525 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:28:18.941492 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815bc1ca_8539_42af_9e3f_c9211dff5f10.slice/crio-d54b7a3f8cf115f09fd3f679839763971f0ad5256433fff901dab1f17696fbb6 WatchSource:0}: Error finding container d54b7a3f8cf115f09fd3f679839763971f0ad5256433fff901dab1f17696fbb6: Status 404 returned error can't find the container with id d54b7a3f8cf115f09fd3f679839763971f0ad5256433fff901dab1f17696fbb6 Jul 21 16:28:19.324266 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:19.324219 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvgjf" event={"ID":"c974f0bb-6dcd-41e6-b77d-7475f2fb2665","Type":"ContainerStarted","Data":"21bd20ade2d1ca0afbe47677e0934e1a936bd1c08338b0d9c145b078f27781b8"} Jul 21 16:28:19.324735 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:19.324284 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nvgjf" event={"ID":"c974f0bb-6dcd-41e6-b77d-7475f2fb2665","Type":"ContainerStarted","Data":"a1941a7fcfceeb6591d7d23cd96062a0b61d74def38c8c3fbb808d4f03b749eb"} Jul 21 16:28:19.325794 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:19.325768 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" event={"ID":"815bc1ca-8539-42af-9e3f-c9211dff5f10","Type":"ContainerStarted","Data":"219d9747005d924d0ddfcc6040af1fac096473289e2785ea87a83c87f7361c94"} Jul 21 16:28:19.325883 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:19.325817 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" event={"ID":"815bc1ca-8539-42af-9e3f-c9211dff5f10","Type":"ContainerStarted","Data":"d54b7a3f8cf115f09fd3f679839763971f0ad5256433fff901dab1f17696fbb6"} Jul 21 16:28:19.325883 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:19.325845 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:19.340877 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:19.340526 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nvgjf" podStartSLOduration=252.242568962 podStartE2EDuration="4m13.34050574s" totalImagesPullingTime="1.097936778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:19.339383281 +0000 UTC m=+254.407463993" watchObservedRunningTime="2026-07-21 16:28:19.34050574 +0000 UTC m=+254.408586420" Jul 21 16:28:19.361808 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:19.361722 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" podStartSLOduration=1.361694299 podStartE2EDuration="1.361694299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:19.360155492 +0000 UTC m=+254.428236172" watchObservedRunningTime="2026-07-21 16:28:19.361694299 +0000 UTC m=+254.429775039" Jul 21 16:28:21.333415 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:21.333381 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjpxj" event={"ID":"bc9a2e27-85f0-4c37-ad6a-692cb316cae3","Type":"ContainerStarted","Data":"b765d09ef0264ee3a777c60ee1a0ca9dbd35f3e6fdd3c37475bdcda17e10cf77"} Jul 21 16:28:25.349435 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:25.349395 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kjpxj" event={"ID":"bc9a2e27-85f0-4c37-ad6a-692cb316cae3","Type":"ContainerStarted","Data":"c3de4b737a0747be1b08d6d4b839a73de4a808ca9b5248d72551a305e578718d"} Jul 21 16:28:25.366587 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:25.366531 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kjpxj" podStartSLOduration=17.061377783 podStartE2EDuration="29.36651409s" totalImagesPullingTime="12.305136307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 16:27:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:25.366063071 +0000 UTC m=+260.434143753" watchObservedRunningTime="2026-07-21 16:28:25.36651409 +0000 UTC m=+260.434594774" Jul 21 16:28:38.786872 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:38.786792 2564 patch_prober.go:28] interesting pod/image-registry-7d7c7547-d4s5c container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 21 16:28:38.786872 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:38.786845 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" podUID="815bc1ca-8539-42af-9e3f-c9211dff5f10" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 21 16:28:40.046069 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.046037 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj"] Jul 21 16:28:40.048208 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.048188 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.051160 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.051138 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 21 16:28:40.051273 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.051213 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 21 16:28:40.051273 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.051228 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 21 16:28:40.051381 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.051288 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 21 16:28:40.051438 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.051380 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-6jmzp\"" Jul 21 16:28:40.051438 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.051391 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 21 16:28:40.059100 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.059071 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj"] Jul 21 16:28:40.098469 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.098430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.098666 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.098467 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.098666 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.098567 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jcjr\" (UniqueName: \"kubernetes.io/projected/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-kube-api-access-2jcjr\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.098666 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.098619 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.199470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.199434 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.199470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.199470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.199637 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.199492 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jcjr\" (UniqueName: \"kubernetes.io/projected/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-kube-api-access-2jcjr\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.199706 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.199685 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.200251 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.200213 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-metrics-client-ca\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.202046 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.202022 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.202149 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.202060 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-prometheus-operator-tls\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.206877 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.206856 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jcjr\" (UniqueName: \"kubernetes.io/projected/e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f-kube-api-access-2jcjr\") pod \"prometheus-operator-5945b5cfd-fl6bj\" (UID: \"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f\") " pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.334937 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.334856 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d7c7547-d4s5c" Jul 21 16:28:40.357589 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.357563 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" Jul 21 16:28:40.490781 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:40.490731 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj"] Jul 21 16:28:40.494729 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:28:40.494697 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57fe286_9cfa_4f4a_a4b2_3df6bdfe2f0f.slice/crio-0b936a26d983956bb709b1f76947b45a6dae7584a9f08a8ac01fe74cda082a9f WatchSource:0}: Error finding container 0b936a26d983956bb709b1f76947b45a6dae7584a9f08a8ac01fe74cda082a9f: Status 404 returned error can't find the container with id 0b936a26d983956bb709b1f76947b45a6dae7584a9f08a8ac01fe74cda082a9f Jul 21 16:28:41.398789 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:41.398719 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" event={"ID":"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f","Type":"ContainerStarted","Data":"0b936a26d983956bb709b1f76947b45a6dae7584a9f08a8ac01fe74cda082a9f"} Jul 21 16:28:42.407130 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:42.407088 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" event={"ID":"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f","Type":"ContainerStarted","Data":"a3f98e48f00f371fbc545b2e4dc85a46bdd5e668430eff926e1ca2ef9730d41c"} Jul 21 16:28:42.407474 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:42.407166 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" event={"ID":"e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f","Type":"ContainerStarted","Data":"93ff0a50121c1c0dad461958237ced0d5a72c7054e0313dcd3c8dcbba90a765f"} Jul 21 16:28:42.424710 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:42.424659 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-5945b5cfd-fl6bj" podStartSLOduration=1.255696329 podStartE2EDuration="2.424644541s" totalImagesPullingTime="1.168948212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:28:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:42.423556002 +0000 UTC m=+277.491636681" watchObservedRunningTime="2026-07-21 16:28:42.424644541 +0000 UTC m=+277.492725219" Jul 21 16:28:44.475172 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.475139 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-lgp86"] Jul 21 16:28:44.477851 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.477818 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.480084 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.480065 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 21 16:28:44.480205 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.480189 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 21 16:28:44.480307 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.480289 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7zcbj\"" Jul 21 16:28:44.480558 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.480542 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 21 16:28:44.527373 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.527340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.527373 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.527375 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-tls\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.527559 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.527391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-wtmp\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.527559 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.527417 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-root\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.527559 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.527439 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-textfile\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.527559 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.527518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfjc9\" (UniqueName: \"kubernetes.io/projected/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-kube-api-access-jfjc9\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.527559 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.527540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-accelerators-collector-config\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.527559 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.527561 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-metrics-client-ca\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.527777 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.527613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-sys\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.628501 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628468 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-accelerators-collector-config\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.628501 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628505 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-metrics-client-ca\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.628696 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628544 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-sys\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.628696 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628595 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-sys\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.628696 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628622 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.628696 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628642 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-tls\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.628696 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628656 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-wtmp\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.628696 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-root\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.628696 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-textfile\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.629002 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628725 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfjc9\" (UniqueName: \"kubernetes.io/projected/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-kube-api-access-jfjc9\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.629002 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628831 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-root\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.629002 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.628850 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-wtmp\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.629141 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.629097 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-textfile\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.629190 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.629142 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-accelerators-collector-config\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.629244 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.629188 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-metrics-client-ca\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.630927 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.630907 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.631028 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.630978 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-node-exporter-tls\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.637105 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.637086 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfjc9\" (UniqueName: \"kubernetes.io/projected/891e66e2-85d1-4ac2-91d0-f9f98a4fd662-kube-api-access-jfjc9\") pod \"node-exporter-lgp86\" (UID: \"891e66e2-85d1-4ac2-91d0-f9f98a4fd662\") " pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.786409 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:44.786372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-lgp86" Jul 21 16:28:44.795571 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:28:44.795543 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891e66e2_85d1_4ac2_91d0_f9f98a4fd662.slice/crio-5db00a0323c26c1a991b707db8792b5ce819ff21bb6cd87af35fcf42483d84b2 WatchSource:0}: Error finding container 5db00a0323c26c1a991b707db8792b5ce819ff21bb6cd87af35fcf42483d84b2: Status 404 returned error can't find the container with id 5db00a0323c26c1a991b707db8792b5ce819ff21bb6cd87af35fcf42483d84b2 Jul 21 16:28:45.419035 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:45.419003 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgp86" event={"ID":"891e66e2-85d1-4ac2-91d0-f9f98a4fd662","Type":"ContainerStarted","Data":"5db00a0323c26c1a991b707db8792b5ce819ff21bb6cd87af35fcf42483d84b2"} Jul 21 16:28:46.423940 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:46.423904 2564 generic.go:356] "Generic (PLEG): container finished" podID="891e66e2-85d1-4ac2-91d0-f9f98a4fd662" containerID="bf6ce231241583d2a68faa020ad8d50f4ac1f659b1f5817105f1013399594c3f" exitCode=0 Jul 21 16:28:46.424413 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:46.423953 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgp86" event={"ID":"891e66e2-85d1-4ac2-91d0-f9f98a4fd662","Type":"ContainerDied","Data":"bf6ce231241583d2a68faa020ad8d50f4ac1f659b1f5817105f1013399594c3f"} Jul 21 16:28:47.429397 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:47.429364 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgp86" event={"ID":"891e66e2-85d1-4ac2-91d0-f9f98a4fd662","Type":"ContainerStarted","Data":"0324ae0d3f525e1ec42c478090ce8540815b0d662a39bd8986bcc5674df67366"} Jul 21 16:28:47.429813 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:47.429456 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-lgp86" event={"ID":"891e66e2-85d1-4ac2-91d0-f9f98a4fd662","Type":"ContainerStarted","Data":"03e5856e692fe0127b519a24df3e91b0c39d0949b87b34eb64299d242285f850"} Jul 21 16:28:47.453227 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:47.453184 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-lgp86" podStartSLOduration=2.482661985 podStartE2EDuration="3.453170367s" totalImagesPullingTime="905.526945ms" totalInitContainerRuntime="64.981437ms" isStatefulPod=true podCreationTimestamp="2026-07-21 16:28:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:47.45211403 +0000 UTC m=+282.520194704" watchObservedRunningTime="2026-07-21 16:28:47.453170367 +0000 UTC m=+282.521251045" Jul 21 16:28:48.052423 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:28:48.052366 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-92b7c" podUID="cca2f967-6f78-43f0-899d-e26230c2ed65" Jul 21 16:28:48.432786 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:48.432682 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-92b7c" Jul 21 16:28:51.583722 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:51.583691 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:28:51.585914 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:51.585893 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cca2f967-6f78-43f0-899d-e26230c2ed65-metrics-tls\") pod \"dns-default-92b7c\" (UID: \"cca2f967-6f78-43f0-899d-e26230c2ed65\") " pod="openshift-dns/dns-default-92b7c" Jul 21 16:28:51.736670 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:51.736639 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kwsf5\"" Jul 21 16:28:51.744583 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:51.744559 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-92b7c" Jul 21 16:28:51.948494 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:51.948467 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-92b7c"] Jul 21 16:28:51.952222 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:28:51.952188 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca2f967_6f78_43f0_899d_e26230c2ed65.slice/crio-abf8b35040a711701e750a723108820a80d78e4a25e9844030b2dc98a16946cb WatchSource:0}: Error finding container abf8b35040a711701e750a723108820a80d78e4a25e9844030b2dc98a16946cb: Status 404 returned error can't find the container with id abf8b35040a711701e750a723108820a80d78e4a25e9844030b2dc98a16946cb Jul 21 16:28:52.446940 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:52.446903 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-92b7c" event={"ID":"cca2f967-6f78-43f0-899d-e26230c2ed65","Type":"ContainerStarted","Data":"abf8b35040a711701e750a723108820a80d78e4a25e9844030b2dc98a16946cb"} Jul 21 16:28:54.455250 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:54.455161 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-92b7c" event={"ID":"cca2f967-6f78-43f0-899d-e26230c2ed65","Type":"ContainerStarted","Data":"57ed693e474fd69b80c90a296e91a2e5c0d543175c483dd02921bba13afd885b"} Jul 21 16:28:54.455250 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:54.455213 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-92b7c" event={"ID":"cca2f967-6f78-43f0-899d-e26230c2ed65","Type":"ContainerStarted","Data":"b892372bf8a5c255c5d093d41dcb8423c82a0728d0dd68e9508518ce488c64dc"} Jul 21 16:28:54.455250 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:54.455252 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-92b7c" Jul 21 16:28:54.473852 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:28:54.473613 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-92b7c" podStartSLOduration=251.42102698 podStartE2EDuration="4m13.47359671s" totalImagesPullingTime="2.05256973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:24:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:28:54.473119943 +0000 UTC m=+289.541200622" watchObservedRunningTime="2026-07-21 16:28:54.47359671 +0000 UTC m=+289.541677391" Jul 21 16:29:04.460924 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:04.460897 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-92b7c" Jul 21 16:29:05.319349 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:05.319319 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:29:05.321268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:05.321245 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:29:05.325615 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:05.325591 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 21 16:29:07.335874 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:07.335836 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" podUID="6a0f4308-026d-4a3b-8d39-19a048ea6183" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 21 16:29:17.336131 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:17.336092 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" podUID="6a0f4308-026d-4a3b-8d39-19a048ea6183" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 21 16:29:27.335699 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:27.335655 2564 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" podUID="6a0f4308-026d-4a3b-8d39-19a048ea6183" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jul 21 16:29:27.336243 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:27.335734 2564 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" Jul 21 16:29:27.336243 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:27.336178 2564 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5c0e5525886c5d28c68ab521a334ad030ce243afd00de3486eba82f6e11f6fe1"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jul 21 16:29:27.336243 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:27.336224 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" podUID="6a0f4308-026d-4a3b-8d39-19a048ea6183" containerName="service-proxy" containerID="cri-o://5c0e5525886c5d28c68ab521a334ad030ce243afd00de3486eba82f6e11f6fe1" gracePeriod=30 Jul 21 16:29:27.572495 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:27.572458 2564 generic.go:356] "Generic (PLEG): container finished" podID="6a0f4308-026d-4a3b-8d39-19a048ea6183" containerID="5c0e5525886c5d28c68ab521a334ad030ce243afd00de3486eba82f6e11f6fe1" exitCode=2 Jul 21 16:29:27.572661 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:27.572532 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" event={"ID":"6a0f4308-026d-4a3b-8d39-19a048ea6183","Type":"ContainerDied","Data":"5c0e5525886c5d28c68ab521a334ad030ce243afd00de3486eba82f6e11f6fe1"} Jul 21 16:29:27.572661 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:29:27.572579 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-769b7849b4-ndl24" event={"ID":"6a0f4308-026d-4a3b-8d39-19a048ea6183","Type":"ContainerStarted","Data":"cc8efc290b0866c336fa624678995bab140c3c4e32f601bbc607be8b4ecfd8fa"} Jul 21 16:31:37.729162 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.729085 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr"] Jul 21 16:31:37.731510 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.731492 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:37.734234 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.734215 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 21 16:31:37.734358 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.734328 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 21 16:31:37.734921 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.734903 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-j78t2\"" Jul 21 16:31:37.757284 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.757253 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr"] Jul 21 16:31:37.832928 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.832892 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:37.832928 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.832928 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-264vt\" (UniqueName: \"kubernetes.io/projected/e0406912-8256-4c7b-a50c-399f0fdf9158-kube-api-access-264vt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:37.833135 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.833020 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:37.934081 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.934048 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:37.934081 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.934083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-264vt\" (UniqueName: \"kubernetes.io/projected/e0406912-8256-4c7b-a50c-399f0fdf9158-kube-api-access-264vt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:37.934277 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.934265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:37.934439 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.934418 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:37.934603 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.934587 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:37.943138 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:37.943104 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-264vt\" (UniqueName: \"kubernetes.io/projected/e0406912-8256-4c7b-a50c-399f0fdf9158-kube-api-access-264vt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:38.040662 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:38.040623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:38.168269 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:38.168233 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr"] Jul 21 16:31:38.171503 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:31:38.171481 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0406912_8256_4c7b_a50c_399f0fdf9158.slice/crio-d2384ceb85860ce5371776640cec7b30f4d50c58cbfd0a8407625570539ec463 WatchSource:0}: Error finding container d2384ceb85860ce5371776640cec7b30f4d50c58cbfd0a8407625570539ec463: Status 404 returned error can't find the container with id d2384ceb85860ce5371776640cec7b30f4d50c58cbfd0a8407625570539ec463 Jul 21 16:31:38.173320 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:38.173304 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 16:31:39.006034 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.005996 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" event={"ID":"e0406912-8256-4c7b-a50c-399f0fdf9158","Type":"ContainerStarted","Data":"d2384ceb85860ce5371776640cec7b30f4d50c58cbfd0a8407625570539ec463"} Jul 21 16:31:39.052040 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.052006 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-477sw"] Jul 21 16:31:39.055207 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.054719 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-477sw" Jul 21 16:31:39.056614 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.056583 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-477sw"] Jul 21 16:31:39.057024 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.057004 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 21 16:31:39.057578 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.057556 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-s9xnc\"" Jul 21 16:31:39.057678 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.057619 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 21 16:31:39.146458 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.146420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpw6m\" (UniqueName: \"kubernetes.io/projected/89d53bdd-47e7-444a-98fe-8a94c87433b6-kube-api-access-xpw6m\") pod \"cert-manager-cainjector-559cdd8c87-477sw\" (UID: \"89d53bdd-47e7-444a-98fe-8a94c87433b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-477sw" Jul 21 16:31:39.146632 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.146470 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89d53bdd-47e7-444a-98fe-8a94c87433b6-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-477sw\" (UID: \"89d53bdd-47e7-444a-98fe-8a94c87433b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-477sw" Jul 21 16:31:39.246952 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.246915 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpw6m\" (UniqueName: \"kubernetes.io/projected/89d53bdd-47e7-444a-98fe-8a94c87433b6-kube-api-access-xpw6m\") pod \"cert-manager-cainjector-559cdd8c87-477sw\" (UID: \"89d53bdd-47e7-444a-98fe-8a94c87433b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-477sw" Jul 21 16:31:39.247142 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.246967 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89d53bdd-47e7-444a-98fe-8a94c87433b6-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-477sw\" (UID: \"89d53bdd-47e7-444a-98fe-8a94c87433b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-477sw" Jul 21 16:31:39.255554 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.255518 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/89d53bdd-47e7-444a-98fe-8a94c87433b6-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-477sw\" (UID: \"89d53bdd-47e7-444a-98fe-8a94c87433b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-477sw" Jul 21 16:31:39.255710 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.255662 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpw6m\" (UniqueName: \"kubernetes.io/projected/89d53bdd-47e7-444a-98fe-8a94c87433b6-kube-api-access-xpw6m\") pod \"cert-manager-cainjector-559cdd8c87-477sw\" (UID: \"89d53bdd-47e7-444a-98fe-8a94c87433b6\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-477sw" Jul 21 16:31:39.367635 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.367542 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-477sw" Jul 21 16:31:39.513580 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:39.513536 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-477sw"] Jul 21 16:31:39.520410 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:31:39.520384 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89d53bdd_47e7_444a_98fe_8a94c87433b6.slice/crio-227ab0c7db23370ec23f5ba2eec3422323421faae332da76af032c1650acd8c9 WatchSource:0}: Error finding container 227ab0c7db23370ec23f5ba2eec3422323421faae332da76af032c1650acd8c9: Status 404 returned error can't find the container with id 227ab0c7db23370ec23f5ba2eec3422323421faae332da76af032c1650acd8c9 Jul 21 16:31:40.010682 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:40.010647 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-477sw" event={"ID":"89d53bdd-47e7-444a-98fe-8a94c87433b6","Type":"ContainerStarted","Data":"227ab0c7db23370ec23f5ba2eec3422323421faae332da76af032c1650acd8c9"} Jul 21 16:31:46.037120 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:46.037083 2564 generic.go:356] "Generic (PLEG): container finished" podID="e0406912-8256-4c7b-a50c-399f0fdf9158" containerID="ddebe5043154f891f7dfc4232b4fbdeaa08501ed3bd5ffd3db187437f2a398b7" exitCode=0 Jul 21 16:31:46.037567 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:46.037169 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" event={"ID":"e0406912-8256-4c7b-a50c-399f0fdf9158","Type":"ContainerDied","Data":"ddebe5043154f891f7dfc4232b4fbdeaa08501ed3bd5ffd3db187437f2a398b7"} Jul 21 16:31:46.038679 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:46.038659 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-477sw" event={"ID":"89d53bdd-47e7-444a-98fe-8a94c87433b6","Type":"ContainerStarted","Data":"abd613a2a8a0af6c49d27e84f80da086f34c4a5ea496b005d0df2deb4eef82d5"} Jul 21 16:31:46.070442 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:46.070390 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-477sw" podStartSLOduration=1.583600999 podStartE2EDuration="7.070371762s" totalImagesPullingTime="5.486770763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:31:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:31:46.069137717 +0000 UTC m=+461.137218395" watchObservedRunningTime="2026-07-21 16:31:46.070371762 +0000 UTC m=+461.138452441" Jul 21 16:31:49.052397 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:49.052365 2564 generic.go:356] "Generic (PLEG): container finished" podID="e0406912-8256-4c7b-a50c-399f0fdf9158" containerID="e4d35f0dffac8d59d131adcdb8c4da44a4430349b81ff19fa0b4039a7a403054" exitCode=0 Jul 21 16:31:49.052814 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:49.052411 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" event={"ID":"e0406912-8256-4c7b-a50c-399f0fdf9158","Type":"ContainerDied","Data":"e4d35f0dffac8d59d131adcdb8c4da44a4430349b81ff19fa0b4039a7a403054"} Jul 21 16:31:57.087652 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:57.087620 2564 generic.go:356] "Generic (PLEG): container finished" podID="e0406912-8256-4c7b-a50c-399f0fdf9158" containerID="5e4025da22f81a6de79b619f7bc8bb2d1d7ae04f94baec991b70e8db216cf960" exitCode=0 Jul 21 16:31:57.088053 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:57.087702 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" event={"ID":"e0406912-8256-4c7b-a50c-399f0fdf9158","Type":"ContainerDied","Data":"5e4025da22f81a6de79b619f7bc8bb2d1d7ae04f94baec991b70e8db216cf960"} Jul 21 16:31:58.211716 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:58.211691 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:58.293934 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:58.293898 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-util\") pod \"e0406912-8256-4c7b-a50c-399f0fdf9158\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " Jul 21 16:31:58.297879 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:58.297856 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-util" (OuterVolumeSpecName: "util") pod "e0406912-8256-4c7b-a50c-399f0fdf9158" (UID: "e0406912-8256-4c7b-a50c-399f0fdf9158"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 16:31:58.394819 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:58.394719 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-bundle\") pod \"e0406912-8256-4c7b-a50c-399f0fdf9158\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " Jul 21 16:31:58.394819 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:58.394784 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-264vt\" (UniqueName: \"kubernetes.io/projected/e0406912-8256-4c7b-a50c-399f0fdf9158-kube-api-access-264vt\") pod \"e0406912-8256-4c7b-a50c-399f0fdf9158\" (UID: \"e0406912-8256-4c7b-a50c-399f0fdf9158\") " Jul 21 16:31:58.395031 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:58.394882 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-util\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:31:58.395108 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:58.395083 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-bundle" (OuterVolumeSpecName: "bundle") pod "e0406912-8256-4c7b-a50c-399f0fdf9158" (UID: "e0406912-8256-4c7b-a50c-399f0fdf9158"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 16:31:58.397021 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:58.397002 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0406912-8256-4c7b-a50c-399f0fdf9158-kube-api-access-264vt" (OuterVolumeSpecName: "kube-api-access-264vt") pod "e0406912-8256-4c7b-a50c-399f0fdf9158" (UID: "e0406912-8256-4c7b-a50c-399f0fdf9158"). InnerVolumeSpecName "kube-api-access-264vt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 16:31:58.495216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:58.495179 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0406912-8256-4c7b-a50c-399f0fdf9158-bundle\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:31:58.495216 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:58.495208 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-264vt\" (UniqueName: \"kubernetes.io/projected/e0406912-8256-4c7b-a50c-399f0fdf9158-kube-api-access-264vt\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:31:59.095986 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:59.095948 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" event={"ID":"e0406912-8256-4c7b-a50c-399f0fdf9158","Type":"ContainerDied","Data":"d2384ceb85860ce5371776640cec7b30f4d50c58cbfd0a8407625570539ec463"} Jul 21 16:31:59.096152 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:59.095994 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fx65rr" Jul 21 16:31:59.096152 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:31:59.096005 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2384ceb85860ce5371776640cec7b30f4d50c58cbfd0a8407625570539ec463" Jul 21 16:32:26.954274 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:26.954238 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk"] Jul 21 16:32:26.954715 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:26.954487 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0406912-8256-4c7b-a50c-399f0fdf9158" containerName="extract" Jul 21 16:32:26.954715 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:26.954497 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0406912-8256-4c7b-a50c-399f0fdf9158" containerName="extract" Jul 21 16:32:26.954715 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:26.954511 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0406912-8256-4c7b-a50c-399f0fdf9158" containerName="util" Jul 21 16:32:26.954715 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:26.954517 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0406912-8256-4c7b-a50c-399f0fdf9158" containerName="util" Jul 21 16:32:26.954715 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:26.954528 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0406912-8256-4c7b-a50c-399f0fdf9158" containerName="pull" Jul 21 16:32:26.954715 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:26.954533 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0406912-8256-4c7b-a50c-399f0fdf9158" containerName="pull" Jul 21 16:32:26.954715 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:26.954581 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0406912-8256-4c7b-a50c-399f0fdf9158" containerName="extract" Jul 21 16:32:27.019401 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.019376 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.023805 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.023783 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 21 16:32:27.023958 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.023880 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 21 16:32:27.024393 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.024373 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 21 16:32:27.024508 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.024399 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-jfczg\"" Jul 21 16:32:27.024508 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.024433 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 21 16:32:27.026598 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.026580 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk"] Jul 21 16:32:27.081826 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.081789 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c4a3664-844a-46e5-8311-ed2c1760c5c6-manifests\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.081994 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.081830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7gjdx\" (UniqueName: \"kubernetes.io/projected/9c4a3664-844a-46e5-8311-ed2c1760c5c6-kube-api-access-7gjdx\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.081994 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.081860 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c4a3664-844a-46e5-8311-ed2c1760c5c6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.081994 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.081932 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4a3664-844a-46e5-8311-ed2c1760c5c6-tmp\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.081994 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.081972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c4a3664-844a-46e5-8311-ed2c1760c5c6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.183246 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.183210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c4a3664-844a-46e5-8311-ed2c1760c5c6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.183246 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.183252 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c4a3664-844a-46e5-8311-ed2c1760c5c6-manifests\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.183491 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.183272 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7gjdx\" (UniqueName: \"kubernetes.io/projected/9c4a3664-844a-46e5-8311-ed2c1760c5c6-kube-api-access-7gjdx\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.183491 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.183302 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c4a3664-844a-46e5-8311-ed2c1760c5c6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.183491 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.183342 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4a3664-844a-46e5-8311-ed2c1760c5c6-tmp\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.183693 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.183670 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9c4a3664-844a-46e5-8311-ed2c1760c5c6-manifests\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.185649 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.185624 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c4a3664-844a-46e5-8311-ed2c1760c5c6-tmp\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.185822 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.185807 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9c4a3664-844a-46e5-8311-ed2c1760c5c6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.185871 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.185850 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9c4a3664-844a-46e5-8311-ed2c1760c5c6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.191087 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.191063 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7gjdx\" (UniqueName: \"kubernetes.io/projected/9c4a3664-844a-46e5-8311-ed2c1760c5c6-kube-api-access-7gjdx\") pod \"opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk\" (UID: \"9c4a3664-844a-46e5-8311-ed2c1760c5c6\") " pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.329249 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.329208 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:27.478394 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:27.478355 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk"] Jul 21 16:32:27.484145 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:32:27.484111 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c4a3664_844a_46e5_8311_ed2c1760c5c6.slice/crio-1d78661cd7ec5a3ac39e1271ec3717e6b26f42254918280a61d4a7a04fb7c584 WatchSource:0}: Error finding container 1d78661cd7ec5a3ac39e1271ec3717e6b26f42254918280a61d4a7a04fb7c584: Status 404 returned error can't find the container with id 1d78661cd7ec5a3ac39e1271ec3717e6b26f42254918280a61d4a7a04fb7c584 Jul 21 16:32:28.199098 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:28.199056 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" event={"ID":"9c4a3664-844a-46e5-8311-ed2c1760c5c6","Type":"ContainerStarted","Data":"1d78661cd7ec5a3ac39e1271ec3717e6b26f42254918280a61d4a7a04fb7c584"} Jul 21 16:32:31.212249 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:31.212216 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" event={"ID":"9c4a3664-844a-46e5-8311-ed2c1760c5c6","Type":"ContainerStarted","Data":"861bb5825380302bd36be62aef741766ccf2f0a6dbdd5e25619e54361d828e81"} Jul 21 16:32:32.217303 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:32.217264 2564 generic.go:356] "Generic (PLEG): container finished" podID="9c4a3664-844a-46e5-8311-ed2c1760c5c6" containerID="861bb5825380302bd36be62aef741766ccf2f0a6dbdd5e25619e54361d828e81" exitCode=0 Jul 21 16:32:32.217701 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:32.217344 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" event={"ID":"9c4a3664-844a-46e5-8311-ed2c1760c5c6","Type":"ContainerDied","Data":"861bb5825380302bd36be62aef741766ccf2f0a6dbdd5e25619e54361d828e81"} Jul 21 16:32:33.223018 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:33.222981 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" event={"ID":"9c4a3664-844a-46e5-8311-ed2c1760c5c6","Type":"ContainerStarted","Data":"b60fc583711f053d12b8d3c93ba01b7fd32c01b5e90168933e4118ece36b9a00"} Jul 21 16:32:33.223441 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:33.223101 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:33.244911 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:33.244856 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" podStartSLOduration=2.718589698 podStartE2EDuration="7.244837203s" totalImagesPullingTime="3.456624647s" totalInitContainerRuntime="1.069622858s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:33.243534716 +0000 UTC m=+508.311615394" watchObservedRunningTime="2026-07-21 16:32:33.244837203 +0000 UTC m=+508.312917883" Jul 21 16:32:44.228939 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:44.228906 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk" Jul 21 16:32:46.905389 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:46.905356 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mw4fj"] Jul 21 16:32:46.910829 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:46.910808 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" Jul 21 16:32:46.913231 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:46.913212 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 21 16:32:46.913299 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:46.913217 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tpvsx\"" Jul 21 16:32:46.920397 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:46.920374 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mw4fj"] Jul 21 16:32:47.040485 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.040448 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzx8p\" (UniqueName: \"kubernetes.io/projected/836db5cd-88e8-42d9-97a9-75eaa8910d1c-kube-api-access-kzx8p\") pod \"odh-model-controller-7998c67dc4-mw4fj\" (UID: \"836db5cd-88e8-42d9-97a9-75eaa8910d1c\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" Jul 21 16:32:47.040649 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.040512 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/836db5cd-88e8-42d9-97a9-75eaa8910d1c-cert\") pod \"odh-model-controller-7998c67dc4-mw4fj\" (UID: \"836db5cd-88e8-42d9-97a9-75eaa8910d1c\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" Jul 21 16:32:47.141568 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.141517 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/836db5cd-88e8-42d9-97a9-75eaa8910d1c-cert\") pod \"odh-model-controller-7998c67dc4-mw4fj\" (UID: \"836db5cd-88e8-42d9-97a9-75eaa8910d1c\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" Jul 21 16:32:47.141803 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.141583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzx8p\" (UniqueName: \"kubernetes.io/projected/836db5cd-88e8-42d9-97a9-75eaa8910d1c-kube-api-access-kzx8p\") pod \"odh-model-controller-7998c67dc4-mw4fj\" (UID: \"836db5cd-88e8-42d9-97a9-75eaa8910d1c\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" Jul 21 16:32:47.141803 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:32:47.141674 2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 21 16:32:47.141803 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:32:47.141738 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/836db5cd-88e8-42d9-97a9-75eaa8910d1c-cert podName:836db5cd-88e8-42d9-97a9-75eaa8910d1c nodeName:}" failed. No retries permitted until 2026-07-21 16:32:47.641721583 +0000 UTC m=+522.709802243 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/836db5cd-88e8-42d9-97a9-75eaa8910d1c-cert") pod "odh-model-controller-7998c67dc4-mw4fj" (UID: "836db5cd-88e8-42d9-97a9-75eaa8910d1c") : secret "odh-model-controller-webhook-cert" not found Jul 21 16:32:47.162418 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.162349 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzx8p\" (UniqueName: \"kubernetes.io/projected/836db5cd-88e8-42d9-97a9-75eaa8910d1c-kube-api-access-kzx8p\") pod \"odh-model-controller-7998c67dc4-mw4fj\" (UID: \"836db5cd-88e8-42d9-97a9-75eaa8910d1c\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" Jul 21 16:32:47.644962 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.644926 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/836db5cd-88e8-42d9-97a9-75eaa8910d1c-cert\") pod \"odh-model-controller-7998c67dc4-mw4fj\" (UID: \"836db5cd-88e8-42d9-97a9-75eaa8910d1c\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" Jul 21 16:32:47.647212 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.647193 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/836db5cd-88e8-42d9-97a9-75eaa8910d1c-cert\") pod \"odh-model-controller-7998c67dc4-mw4fj\" (UID: \"836db5cd-88e8-42d9-97a9-75eaa8910d1c\") " pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" Jul 21 16:32:47.679533 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.679501 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fk7xj"] Jul 21 16:32:47.681724 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.681709 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" Jul 21 16:32:47.684395 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.684375 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 21 16:32:47.699061 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.699035 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fk7xj"] Jul 21 16:32:47.746059 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.746023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5523cd2-a7a5-4a9b-95c5-55b503efd5de-tls-certs\") pod \"model-serving-api-54d89bd5fc-fk7xj\" (UID: \"c5523cd2-a7a5-4a9b-95c5-55b503efd5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" Jul 21 16:32:47.746236 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.746067 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdz5s\" (UniqueName: \"kubernetes.io/projected/c5523cd2-a7a5-4a9b-95c5-55b503efd5de-kube-api-access-gdz5s\") pod \"model-serving-api-54d89bd5fc-fk7xj\" (UID: \"c5523cd2-a7a5-4a9b-95c5-55b503efd5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" Jul 21 16:32:47.821295 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.821254 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" Jul 21 16:32:47.847518 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.847487 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5523cd2-a7a5-4a9b-95c5-55b503efd5de-tls-certs\") pod \"model-serving-api-54d89bd5fc-fk7xj\" (UID: \"c5523cd2-a7a5-4a9b-95c5-55b503efd5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" Jul 21 16:32:47.847654 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.847534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdz5s\" (UniqueName: \"kubernetes.io/projected/c5523cd2-a7a5-4a9b-95c5-55b503efd5de-kube-api-access-gdz5s\") pod \"model-serving-api-54d89bd5fc-fk7xj\" (UID: \"c5523cd2-a7a5-4a9b-95c5-55b503efd5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" Jul 21 16:32:47.847696 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:32:47.847670 2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 21 16:32:47.847784 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:32:47.847771 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5523cd2-a7a5-4a9b-95c5-55b503efd5de-tls-certs podName:c5523cd2-a7a5-4a9b-95c5-55b503efd5de nodeName:}" failed. No retries permitted until 2026-07-21 16:32:48.34772852 +0000 UTC m=+523.415809197 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c5523cd2-a7a5-4a9b-95c5-55b503efd5de-tls-certs") pod "model-serving-api-54d89bd5fc-fk7xj" (UID: "c5523cd2-a7a5-4a9b-95c5-55b503efd5de") : secret "model-serving-api-tls" not found Jul 21 16:32:47.855863 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.855841 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdz5s\" (UniqueName: \"kubernetes.io/projected/c5523cd2-a7a5-4a9b-95c5-55b503efd5de-kube-api-access-gdz5s\") pod \"model-serving-api-54d89bd5fc-fk7xj\" (UID: \"c5523cd2-a7a5-4a9b-95c5-55b503efd5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" Jul 21 16:32:47.958712 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:47.958679 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-mw4fj"] Jul 21 16:32:47.963159 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:32:47.963127 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836db5cd_88e8_42d9_97a9_75eaa8910d1c.slice/crio-f8d8f1b41a50d4409ee3c234f7cccad24dc37ef75126b71c19dc71f3058fb56f WatchSource:0}: Error finding container f8d8f1b41a50d4409ee3c234f7cccad24dc37ef75126b71c19dc71f3058fb56f: Status 404 returned error can't find the container with id f8d8f1b41a50d4409ee3c234f7cccad24dc37ef75126b71c19dc71f3058fb56f Jul 21 16:32:48.277694 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:48.277660 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" event={"ID":"836db5cd-88e8-42d9-97a9-75eaa8910d1c","Type":"ContainerStarted","Data":"f8d8f1b41a50d4409ee3c234f7cccad24dc37ef75126b71c19dc71f3058fb56f"} Jul 21 16:32:48.352085 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:48.352044 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5523cd2-a7a5-4a9b-95c5-55b503efd5de-tls-certs\") pod \"model-serving-api-54d89bd5fc-fk7xj\" (UID: \"c5523cd2-a7a5-4a9b-95c5-55b503efd5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" Jul 21 16:32:48.354376 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:48.354358 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5523cd2-a7a5-4a9b-95c5-55b503efd5de-tls-certs\") pod \"model-serving-api-54d89bd5fc-fk7xj\" (UID: \"c5523cd2-a7a5-4a9b-95c5-55b503efd5de\") " pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" Jul 21 16:32:48.591936 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:48.591850 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" Jul 21 16:32:48.746836 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:48.746801 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-fk7xj"] Jul 21 16:32:48.751759 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:32:48.751709 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5523cd2_a7a5_4a9b_95c5_55b503efd5de.slice/crio-b40252237fc47cafefa3bf8711c9b92a4bb27f19eec5aab4f0f02cb2bd7e1c03 WatchSource:0}: Error finding container b40252237fc47cafefa3bf8711c9b92a4bb27f19eec5aab4f0f02cb2bd7e1c03: Status 404 returned error can't find the container with id b40252237fc47cafefa3bf8711c9b92a4bb27f19eec5aab4f0f02cb2bd7e1c03 Jul 21 16:32:49.283147 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:49.283105 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" event={"ID":"c5523cd2-a7a5-4a9b-95c5-55b503efd5de","Type":"ContainerStarted","Data":"b40252237fc47cafefa3bf8711c9b92a4bb27f19eec5aab4f0f02cb2bd7e1c03"} Jul 21 16:32:51.293544 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:51.293508 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" event={"ID":"c5523cd2-a7a5-4a9b-95c5-55b503efd5de","Type":"ContainerStarted","Data":"0bc4a40b101ddbb106e1949ccc5480ee5f91318a26adfbaa22930b991983120b"} Jul 21 16:32:51.294033 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:51.293691 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" Jul 21 16:32:51.295019 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:51.294998 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" event={"ID":"836db5cd-88e8-42d9-97a9-75eaa8910d1c","Type":"ContainerStarted","Data":"992a4a0435e63b8c7a73397cc50af3f67087fe98a1d2f18b0b78aac146afc3c1"} Jul 21 16:32:51.295135 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:51.295120 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" Jul 21 16:32:51.310758 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:51.310701 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" podStartSLOduration=2.099101901 podStartE2EDuration="4.310685924s" totalImagesPullingTime="2.211584023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:51.309113008 +0000 UTC m=+526.377193687" watchObservedRunningTime="2026-07-21 16:32:51.310685924 +0000 UTC m=+526.378766603" Jul 21 16:32:51.324059 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:51.324017 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" podStartSLOduration=2.318388118 podStartE2EDuration="5.324002119s" totalImagesPullingTime="3.005614001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:51.322893728 +0000 UTC m=+526.390974503" watchObservedRunningTime="2026-07-21 16:32:51.324002119 +0000 UTC m=+526.392082815" Jul 21 16:32:56.137950 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.137912 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4"] Jul 21 16:32:56.140271 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.140239 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" Jul 21 16:32:56.142681 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.142662 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 21 16:32:56.142890 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.142865 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-spzp9\"" Jul 21 16:32:56.155108 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.155075 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887"] Jul 21 16:32:56.157663 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.157629 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4"] Jul 21 16:32:56.157830 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.157772 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" Jul 21 16:32:56.159963 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.159941 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 21 16:32:56.160095 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.159978 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w8v7n\"" Jul 21 16:32:56.168707 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.168679 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887"] Jul 21 16:32:56.217554 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.217517 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2dlz\" (UniqueName: \"kubernetes.io/projected/b96669e3-c154-42ef-aabd-4e69e52a21d5-kube-api-access-z2dlz\") pod \"llmisvc-controller-manager-777c6bd7d5-ts887\" (UID: \"b96669e3-c154-42ef-aabd-4e69e52a21d5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" Jul 21 16:32:56.217789 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.217569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b96669e3-c154-42ef-aabd-4e69e52a21d5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ts887\" (UID: \"b96669e3-c154-42ef-aabd-4e69e52a21d5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" Jul 21 16:32:56.217789 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.217626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d-cert\") pod \"kserve-controller-manager-d6f4b65b8-cp5x4\" (UID: \"f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" Jul 21 16:32:56.217789 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.217665 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqvzh\" (UniqueName: \"kubernetes.io/projected/f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d-kube-api-access-zqvzh\") pod \"kserve-controller-manager-d6f4b65b8-cp5x4\" (UID: \"f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" Jul 21 16:32:56.318954 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.318916 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqvzh\" (UniqueName: \"kubernetes.io/projected/f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d-kube-api-access-zqvzh\") pod \"kserve-controller-manager-d6f4b65b8-cp5x4\" (UID: \"f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" Jul 21 16:32:56.319166 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.318987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2dlz\" (UniqueName: \"kubernetes.io/projected/b96669e3-c154-42ef-aabd-4e69e52a21d5-kube-api-access-z2dlz\") pod \"llmisvc-controller-manager-777c6bd7d5-ts887\" (UID: \"b96669e3-c154-42ef-aabd-4e69e52a21d5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" Jul 21 16:32:56.319166 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.319013 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b96669e3-c154-42ef-aabd-4e69e52a21d5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ts887\" (UID: \"b96669e3-c154-42ef-aabd-4e69e52a21d5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" Jul 21 16:32:56.319166 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.319027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d-cert\") pod \"kserve-controller-manager-d6f4b65b8-cp5x4\" (UID: \"f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" Jul 21 16:32:56.319166 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:32:56.319146 2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 21 16:32:56.319371 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:32:56.319198 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b96669e3-c154-42ef-aabd-4e69e52a21d5-cert podName:b96669e3-c154-42ef-aabd-4e69e52a21d5 nodeName:}" failed. No retries permitted until 2026-07-21 16:32:56.8191824 +0000 UTC m=+531.887263062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b96669e3-c154-42ef-aabd-4e69e52a21d5-cert") pod "llmisvc-controller-manager-777c6bd7d5-ts887" (UID: "b96669e3-c154-42ef-aabd-4e69e52a21d5") : secret "llmisvc-webhook-server-cert" not found Jul 21 16:32:56.321450 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.321431 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d-cert\") pod \"kserve-controller-manager-d6f4b65b8-cp5x4\" (UID: \"f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" Jul 21 16:32:56.337795 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.337769 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqvzh\" (UniqueName: \"kubernetes.io/projected/f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d-kube-api-access-zqvzh\") pod \"kserve-controller-manager-d6f4b65b8-cp5x4\" (UID: \"f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" Jul 21 16:32:56.340793 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.340774 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2dlz\" (UniqueName: \"kubernetes.io/projected/b96669e3-c154-42ef-aabd-4e69e52a21d5-kube-api-access-z2dlz\") pod \"llmisvc-controller-manager-777c6bd7d5-ts887\" (UID: \"b96669e3-c154-42ef-aabd-4e69e52a21d5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" Jul 21 16:32:56.450685 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.450604 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" Jul 21 16:32:56.581960 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.581930 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4"] Jul 21 16:32:56.585328 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:32:56.585297 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a0d7fb_64a8_47a6_a4f8_e4d061b7a70d.slice/crio-35d78cc4f7e382c6660b37859662a094481479324b755058e6f90075893b21aa WatchSource:0}: Error finding container 35d78cc4f7e382c6660b37859662a094481479324b755058e6f90075893b21aa: Status 404 returned error can't find the container with id 35d78cc4f7e382c6660b37859662a094481479324b755058e6f90075893b21aa Jul 21 16:32:56.823405 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.823373 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b96669e3-c154-42ef-aabd-4e69e52a21d5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ts887\" (UID: \"b96669e3-c154-42ef-aabd-4e69e52a21d5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" Jul 21 16:32:56.825708 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:56.825684 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b96669e3-c154-42ef-aabd-4e69e52a21d5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-ts887\" (UID: \"b96669e3-c154-42ef-aabd-4e69e52a21d5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" Jul 21 16:32:57.070543 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.070515 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" Jul 21 16:32:57.142387 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.142358 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54864c54db-5gb6x"] Jul 21 16:32:57.144666 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.144648 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" Jul 21 16:32:57.147972 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.147614 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 21 16:32:57.147972 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.147699 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 21 16:32:57.147972 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.147614 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 21 16:32:57.148197 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.148165 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 21 16:32:57.163466 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.163401 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54864c54db-5gb6x"] Jul 21 16:32:57.226797 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.226755 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89a4f61-3341-489b-9f42-d19e1189f210-tls-certs\") pod \"kube-auth-proxy-54864c54db-5gb6x\" (UID: \"b89a4f61-3341-489b-9f42-d19e1189f210\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" Jul 21 16:32:57.226969 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.226850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhmr8\" (UniqueName: \"kubernetes.io/projected/b89a4f61-3341-489b-9f42-d19e1189f210-kube-api-access-bhmr8\") pod \"kube-auth-proxy-54864c54db-5gb6x\" (UID: \"b89a4f61-3341-489b-9f42-d19e1189f210\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" Jul 21 16:32:57.226969 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.226906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b89a4f61-3341-489b-9f42-d19e1189f210-tmp\") pod \"kube-auth-proxy-54864c54db-5gb6x\" (UID: \"b89a4f61-3341-489b-9f42-d19e1189f210\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" Jul 21 16:32:57.240067 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.240030 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887"] Jul 21 16:32:57.242652 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:32:57.242611 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb96669e3_c154_42ef_aabd_4e69e52a21d5.slice/crio-576d52abb534446ec8e2d04256c01dc49d6db8de867d56f01c6bc51ea38dc230 WatchSource:0}: Error finding container 576d52abb534446ec8e2d04256c01dc49d6db8de867d56f01c6bc51ea38dc230: Status 404 returned error can't find the container with id 576d52abb534446ec8e2d04256c01dc49d6db8de867d56f01c6bc51ea38dc230 Jul 21 16:32:57.319001 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.318968 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" event={"ID":"b96669e3-c154-42ef-aabd-4e69e52a21d5","Type":"ContainerStarted","Data":"576d52abb534446ec8e2d04256c01dc49d6db8de867d56f01c6bc51ea38dc230"} Jul 21 16:32:57.319993 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.319969 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" event={"ID":"f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d","Type":"ContainerStarted","Data":"35d78cc4f7e382c6660b37859662a094481479324b755058e6f90075893b21aa"} Jul 21 16:32:57.327324 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.327306 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89a4f61-3341-489b-9f42-d19e1189f210-tls-certs\") pod \"kube-auth-proxy-54864c54db-5gb6x\" (UID: \"b89a4f61-3341-489b-9f42-d19e1189f210\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" Jul 21 16:32:57.327406 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.327348 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhmr8\" (UniqueName: \"kubernetes.io/projected/b89a4f61-3341-489b-9f42-d19e1189f210-kube-api-access-bhmr8\") pod \"kube-auth-proxy-54864c54db-5gb6x\" (UID: \"b89a4f61-3341-489b-9f42-d19e1189f210\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" Jul 21 16:32:57.327406 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.327374 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b89a4f61-3341-489b-9f42-d19e1189f210-tmp\") pod \"kube-auth-proxy-54864c54db-5gb6x\" (UID: \"b89a4f61-3341-489b-9f42-d19e1189f210\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" Jul 21 16:32:57.329853 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.329804 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b89a4f61-3341-489b-9f42-d19e1189f210-tmp\") pod \"kube-auth-proxy-54864c54db-5gb6x\" (UID: \"b89a4f61-3341-489b-9f42-d19e1189f210\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" Jul 21 16:32:57.332230 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.332197 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b89a4f61-3341-489b-9f42-d19e1189f210-tls-certs\") pod \"kube-auth-proxy-54864c54db-5gb6x\" (UID: \"b89a4f61-3341-489b-9f42-d19e1189f210\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" Jul 21 16:32:57.338202 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.338183 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhmr8\" (UniqueName: \"kubernetes.io/projected/b89a4f61-3341-489b-9f42-d19e1189f210-kube-api-access-bhmr8\") pod \"kube-auth-proxy-54864c54db-5gb6x\" (UID: \"b89a4f61-3341-489b-9f42-d19e1189f210\") " pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" Jul 21 16:32:57.457760 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.457710 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" Jul 21 16:32:57.599225 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:57.599187 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54864c54db-5gb6x"] Jul 21 16:32:57.601692 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:32:57.601662 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb89a4f61_3341_489b_9f42_d19e1189f210.slice/crio-b75e0136b585c9f7971967056fe4dd51e4b093ab49436c85fd54b0686617a824 WatchSource:0}: Error finding container b75e0136b585c9f7971967056fe4dd51e4b093ab49436c85fd54b0686617a824: Status 404 returned error can't find the container with id b75e0136b585c9f7971967056fe4dd51e4b093ab49436c85fd54b0686617a824 Jul 21 16:32:58.328598 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:58.328529 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" event={"ID":"b89a4f61-3341-489b-9f42-d19e1189f210","Type":"ContainerStarted","Data":"b75e0136b585c9f7971967056fe4dd51e4b093ab49436c85fd54b0686617a824"} Jul 21 16:32:59.188250 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.188219 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj"] Jul 21 16:32:59.190811 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.190785 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.193298 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.193276 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 21 16:32:59.193986 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.193964 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 21 16:32:59.194083 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.193989 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 21 16:32:59.194273 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.194255 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 21 16:32:59.194273 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.194267 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-6kf9q\"" Jul 21 16:32:59.204342 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.204318 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj"] Jul 21 16:32:59.334918 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.334876 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" event={"ID":"f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d","Type":"ContainerStarted","Data":"4f23e02b33994db5d403ac4e068f5868e4ea289a9fe822eee9301ab832c37217"} Jul 21 16:32:59.335316 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.335020 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" Jul 21 16:32:59.349135 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.349106 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.349135 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.349136 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.349329 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.349160 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5m6p\" (UniqueName: \"kubernetes.io/projected/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-kube-api-access-s5m6p\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.349329 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.349279 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.349329 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.349315 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.349446 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.349340 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.349446 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.349392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.373699 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.373641 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" podStartSLOduration=0.754941995 podStartE2EDuration="3.373624993s" totalImagesPullingTime="2.618682998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:32:59.372218967 +0000 UTC m=+534.440299646" watchObservedRunningTime="2026-07-21 16:32:59.373624993 +0000 UTC m=+534.441705672" Jul 21 16:32:59.450495 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.450402 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.450495 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.450446 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.450495 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.450490 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5m6p\" (UniqueName: \"kubernetes.io/projected/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-kube-api-access-s5m6p\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.450794 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.450638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.450794 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.450680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.450794 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.450709 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.450794 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.450789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.451356 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.451328 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.452728 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.452700 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.452916 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.452895 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.453119 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.453100 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.453207 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.453187 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.459347 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.459319 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5m6p\" (UniqueName: \"kubernetes.io/projected/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-kube-api-access-s5m6p\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.459647 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.459626 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4e3d9a21-b743-4fab-bec4-d34a2b17bfc5-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-ldznj\" (UID: \"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.502690 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.502638 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:32:59.657127 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:32:59.657046 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj"] Jul 21 16:32:59.659812 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:32:59.659783 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e3d9a21_b743_4fab_bec4_d34a2b17bfc5.slice/crio-31e275f3f37b7912de58ca49e454a9a1ba154214c618add90d38ab1fe12b673b WatchSource:0}: Error finding container 31e275f3f37b7912de58ca49e454a9a1ba154214c618add90d38ab1fe12b673b: Status 404 returned error can't find the container with id 31e275f3f37b7912de58ca49e454a9a1ba154214c618add90d38ab1fe12b673b Jul 21 16:33:00.340701 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:00.340667 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" event={"ID":"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5","Type":"ContainerStarted","Data":"31e275f3f37b7912de58ca49e454a9a1ba154214c618add90d38ab1fe12b673b"} Jul 21 16:33:02.301346 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:02.301319 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-mw4fj" Jul 21 16:33:02.303703 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:02.303683 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-fk7xj" Jul 21 16:33:02.353925 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:02.353882 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" event={"ID":"b96669e3-c154-42ef-aabd-4e69e52a21d5","Type":"ContainerStarted","Data":"680ca74dc5dd6dd0bf2f185ae796f6b33f39b0bd79c80ef1c982a8e978a5ceee"} Jul 21 16:33:02.354102 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:02.354034 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" Jul 21 16:33:02.356973 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:02.356681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" event={"ID":"b89a4f61-3341-489b-9f42-d19e1189f210","Type":"ContainerStarted","Data":"f5d9c4cd1f6db5a10be05ee9b1cf0d64d46de778c9a0fef375518e273a9c8a33"} Jul 21 16:33:02.373112 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:02.373054 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" podStartSLOduration=2.095039931 podStartE2EDuration="6.373031787s" totalImagesPullingTime="4.277991856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:02.37094819 +0000 UTC m=+537.439028893" watchObservedRunningTime="2026-07-21 16:33:02.373031787 +0000 UTC m=+537.441112467" Jul 21 16:33:02.387404 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:02.387162 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54864c54db-5gb6x" podStartSLOduration=1.507913572 podStartE2EDuration="5.387140476s" totalImagesPullingTime="3.879226904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:02.386795989 +0000 UTC m=+537.454876669" watchObservedRunningTime="2026-07-21 16:33:02.387140476 +0000 UTC m=+537.455221164" Jul 21 16:33:03.365343 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:03.365300 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 21 16:33:03.365717 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:03.365378 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236220Ki","pods":"250"} Jul 21 16:33:04.368906 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:04.368864 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" event={"ID":"4e3d9a21-b743-4fab-bec4-d34a2b17bfc5","Type":"ContainerStarted","Data":"508648605ab7bd8c6be2bf65f4eef3f22d23764eb615c999105d405dfeaa3f49"} Jul 21 16:33:04.369388 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:04.369075 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:33:04.371036 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:04.371015 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" Jul 21 16:33:04.391117 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:04.391065 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-ldznj" podStartSLOduration=1.688116478 podStartE2EDuration="5.391048973s" totalImagesPullingTime="3.702932495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:32:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:33:04.389667134 +0000 UTC m=+539.457747814" watchObservedRunningTime="2026-07-21 16:33:04.391048973 +0000 UTC m=+539.459129651" Jul 21 16:33:30.346034 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:30.346002 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-cp5x4" Jul 21 16:33:33.365635 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:33:33.365601 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-ts887" Jul 21 16:34:05.350541 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:05.350511 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:34:05.351179 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:05.351154 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:34:26.876467 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:26.876384 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9"] Jul 21 16:34:26.878410 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:26.878393 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:26.882019 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:26.881998 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mvkfh\"" Jul 21 16:34:26.882180 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:26.882096 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 21 16:34:26.882180 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:26.882144 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 21 16:34:26.898171 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:26.898138 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9"] Jul 21 16:34:26.948491 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:26.948451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb311fb-6126-49fc-ae5b-a4e788d32cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" (UID: \"beb311fb-6126-49fc-ae5b-a4e788d32cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:26.948491 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:26.948498 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcdwp\" (UniqueName: \"kubernetes.io/projected/beb311fb-6126-49fc-ae5b-a4e788d32cca-kube-api-access-rcdwp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" (UID: \"beb311fb-6126-49fc-ae5b-a4e788d32cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:27.049320 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:27.049286 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb311fb-6126-49fc-ae5b-a4e788d32cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" (UID: \"beb311fb-6126-49fc-ae5b-a4e788d32cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:27.049484 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:27.049328 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcdwp\" (UniqueName: \"kubernetes.io/projected/beb311fb-6126-49fc-ae5b-a4e788d32cca-kube-api-access-rcdwp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" (UID: \"beb311fb-6126-49fc-ae5b-a4e788d32cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:27.049656 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:27.049639 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb311fb-6126-49fc-ae5b-a4e788d32cca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" (UID: \"beb311fb-6126-49fc-ae5b-a4e788d32cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:27.057399 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:27.057366 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcdwp\" (UniqueName: \"kubernetes.io/projected/beb311fb-6126-49fc-ae5b-a4e788d32cca-kube-api-access-rcdwp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" (UID: \"beb311fb-6126-49fc-ae5b-a4e788d32cca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:27.189036 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:27.188951 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:27.320037 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:27.319997 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9"] Jul 21 16:34:27.324131 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:34:27.324104 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeb311fb_6126_49fc_ae5b_a4e788d32cca.slice/crio-c300e58aac38b3757ec6c05ae6afbfcef97e4e217a65c196c516d9b27bac9ecb WatchSource:0}: Error finding container c300e58aac38b3757ec6c05ae6afbfcef97e4e217a65c196c516d9b27bac9ecb: Status 404 returned error can't find the container with id c300e58aac38b3757ec6c05ae6afbfcef97e4e217a65c196c516d9b27bac9ecb Jul 21 16:34:27.701923 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:27.701885 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" event={"ID":"beb311fb-6126-49fc-ae5b-a4e788d32cca","Type":"ContainerStarted","Data":"c300e58aac38b3757ec6c05ae6afbfcef97e4e217a65c196c516d9b27bac9ecb"} Jul 21 16:34:33.736005 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:33.735955 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" event={"ID":"beb311fb-6126-49fc-ae5b-a4e788d32cca","Type":"ContainerStarted","Data":"976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443"} Jul 21 16:34:33.736468 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:33.736052 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:33.759336 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:33.759281 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" podStartSLOduration=2.366481889 podStartE2EDuration="7.759262598s" totalImagesPullingTime="5.392780709s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:33.758044682 +0000 UTC m=+628.826125362" watchObservedRunningTime="2026-07-21 16:34:33.759262598 +0000 UTC m=+628.827343278" Jul 21 16:34:44.742893 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:44.742861 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:45.653265 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:45.653233 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2"] Jul 21 16:34:45.655613 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:45.655597 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:45.668346 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:45.668319 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2"] Jul 21 16:34:45.696887 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:45.696858 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zx2d9\" (UniqueName: \"kubernetes.io/projected/7e483420-8e82-4267-8984-b39642a5152f-kube-api-access-zx2d9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5bbm2\" (UID: \"7e483420-8e82-4267-8984-b39642a5152f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:45.697057 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:45.696909 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e483420-8e82-4267-8984-b39642a5152f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5bbm2\" (UID: \"7e483420-8e82-4267-8984-b39642a5152f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:45.797531 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:45.797499 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e483420-8e82-4267-8984-b39642a5152f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5bbm2\" (UID: \"7e483420-8e82-4267-8984-b39642a5152f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:45.797919 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:45.797564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zx2d9\" (UniqueName: \"kubernetes.io/projected/7e483420-8e82-4267-8984-b39642a5152f-kube-api-access-zx2d9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5bbm2\" (UID: \"7e483420-8e82-4267-8984-b39642a5152f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:45.797919 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:45.797881 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e483420-8e82-4267-8984-b39642a5152f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5bbm2\" (UID: \"7e483420-8e82-4267-8984-b39642a5152f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:45.807063 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:45.807037 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zx2d9\" (UniqueName: \"kubernetes.io/projected/7e483420-8e82-4267-8984-b39642a5152f-kube-api-access-zx2d9\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-5bbm2\" (UID: \"7e483420-8e82-4267-8984-b39642a5152f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:45.966348 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:45.966259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:46.095769 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.095552 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2"] Jul 21 16:34:46.098731 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:34:46.098699 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e483420_8e82_4267_8984_b39642a5152f.slice/crio-4868ba728b3b039c0d75f5e3ed35620415ca14a7062f721370143cb4e49c460d WatchSource:0}: Error finding container 4868ba728b3b039c0d75f5e3ed35620415ca14a7062f721370143cb4e49c460d: Status 404 returned error can't find the container with id 4868ba728b3b039c0d75f5e3ed35620415ca14a7062f721370143cb4e49c460d Jul 21 16:34:46.418311 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.418274 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2"] Jul 21 16:34:46.421957 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.421930 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2"] Jul 21 16:34:46.437246 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.437218 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9"] Jul 21 16:34:46.437433 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.437399 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" podUID="beb311fb-6126-49fc-ae5b-a4e788d32cca" containerName="manager" containerID="cri-o://976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443" gracePeriod=2 Jul 21 16:34:46.442392 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.442366 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp"] Jul 21 16:34:46.442802 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.442779 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e483420-8e82-4267-8984-b39642a5152f" containerName="manager" Jul 21 16:34:46.442802 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.442803 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e483420-8e82-4267-8984-b39642a5152f" containerName="manager" Jul 21 16:34:46.442971 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.442917 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e483420-8e82-4267-8984-b39642a5152f" containerName="manager" Jul 21 16:34:46.445204 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.445186 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:34:46.450173 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.450152 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9"] Jul 21 16:34:46.468078 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.468051 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj"] Jul 21 16:34:46.468332 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:46.468298 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"beb311fb-6126-49fc-ae5b-a4e788d32cca\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-99wb9\": pods \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:46.468611 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.468590 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="beb311fb-6126-49fc-ae5b-a4e788d32cca" containerName="manager" Jul 21 16:34:46.468611 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.468609 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="beb311fb-6126-49fc-ae5b-a4e788d32cca" containerName="manager" Jul 21 16:34:46.468774 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.468686 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="beb311fb-6126-49fc-ae5b-a4e788d32cca" containerName="manager" Jul 21 16:34:46.472042 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.472023 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp"] Jul 21 16:34:46.472146 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.472125 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:46.484459 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.484437 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj"] Jul 21 16:34:46.502787 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:46.502733 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object" podUID="beb311fb-6126-49fc-ae5b-a4e788d32cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:46.503313 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.503220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmhwv\" (UniqueName: \"kubernetes.io/projected/cfe7edd5-2058-4d4c-9c68-9791364fc27d-kube-api-access-fmhwv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-t52wp\" (UID: \"cfe7edd5-2058-4d4c-9c68-9791364fc27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:34:46.503313 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.503264 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfe7edd5-2058-4d4c-9c68-9791364fc27d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-t52wp\" (UID: \"cfe7edd5-2058-4d4c-9c68-9791364fc27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:34:46.503486 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.503362 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4vjp\" (UniqueName: \"kubernetes.io/projected/0820288b-8af6-4110-9f95-629440889887-kube-api-access-z4vjp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vpkj\" (UID: \"0820288b-8af6-4110-9f95-629440889887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:46.503486 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.503422 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0820288b-8af6-4110-9f95-629440889887-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vpkj\" (UID: \"0820288b-8af6-4110-9f95-629440889887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:46.526731 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:46.526698 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object" podUID="beb311fb-6126-49fc-ae5b-a4e788d32cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:46.604527 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.604493 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0820288b-8af6-4110-9f95-629440889887-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vpkj\" (UID: \"0820288b-8af6-4110-9f95-629440889887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:46.604710 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.604543 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmhwv\" (UniqueName: \"kubernetes.io/projected/cfe7edd5-2058-4d4c-9c68-9791364fc27d-kube-api-access-fmhwv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-t52wp\" (UID: \"cfe7edd5-2058-4d4c-9c68-9791364fc27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:34:46.604710 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.604564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfe7edd5-2058-4d4c-9c68-9791364fc27d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-t52wp\" (UID: \"cfe7edd5-2058-4d4c-9c68-9791364fc27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:34:46.604710 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.604609 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4vjp\" (UniqueName: \"kubernetes.io/projected/0820288b-8af6-4110-9f95-629440889887-kube-api-access-z4vjp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vpkj\" (UID: \"0820288b-8af6-4110-9f95-629440889887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:46.605023 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.604996 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0820288b-8af6-4110-9f95-629440889887-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vpkj\" (UID: \"0820288b-8af6-4110-9f95-629440889887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:46.605087 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.605026 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfe7edd5-2058-4d4c-9c68-9791364fc27d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-t52wp\" (UID: \"cfe7edd5-2058-4d4c-9c68-9791364fc27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:34:46.628186 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.628160 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmhwv\" (UniqueName: \"kubernetes.io/projected/cfe7edd5-2058-4d4c-9c68-9791364fc27d-kube-api-access-fmhwv\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-t52wp\" (UID: \"cfe7edd5-2058-4d4c-9c68-9791364fc27d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:34:46.628319 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.628228 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4vjp\" (UniqueName: \"kubernetes.io/projected/0820288b-8af6-4110-9f95-629440889887-kube-api-access-z4vjp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4vpkj\" (UID: \"0820288b-8af6-4110-9f95-629440889887\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:46.667296 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.667268 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:46.669601 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:46.669523 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object" podUID="beb311fb-6126-49fc-ae5b-a4e788d32cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:46.705864 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.705835 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb311fb-6126-49fc-ae5b-a4e788d32cca-extensions-socket-volume\") pod \"beb311fb-6126-49fc-ae5b-a4e788d32cca\" (UID: \"beb311fb-6126-49fc-ae5b-a4e788d32cca\") " Jul 21 16:34:46.706023 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.705891 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcdwp\" (UniqueName: \"kubernetes.io/projected/beb311fb-6126-49fc-ae5b-a4e788d32cca-kube-api-access-rcdwp\") pod \"beb311fb-6126-49fc-ae5b-a4e788d32cca\" (UID: \"beb311fb-6126-49fc-ae5b-a4e788d32cca\") " Jul 21 16:34:46.706321 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.706296 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/beb311fb-6126-49fc-ae5b-a4e788d32cca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "beb311fb-6126-49fc-ae5b-a4e788d32cca" (UID: "beb311fb-6126-49fc-ae5b-a4e788d32cca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 16:34:46.707985 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.707964 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/beb311fb-6126-49fc-ae5b-a4e788d32cca-kube-api-access-rcdwp" (OuterVolumeSpecName: "kube-api-access-rcdwp") pod "beb311fb-6126-49fc-ae5b-a4e788d32cca" (UID: "beb311fb-6126-49fc-ae5b-a4e788d32cca"). InnerVolumeSpecName "kube-api-access-rcdwp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 16:34:46.791208 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.791171 2564 generic.go:356] "Generic (PLEG): container finished" podID="beb311fb-6126-49fc-ae5b-a4e788d32cca" containerID="976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443" exitCode=0 Jul 21 16:34:46.791396 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.791236 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:46.791396 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.791278 2564 scope.go:117] "RemoveContainer" containerID="976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443" Jul 21 16:34:46.793019 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:46.793002 2564 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" container="manager" Jul 21 16:34:46.793554 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:46.793511 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object" podUID="beb311fb-6126-49fc-ae5b-a4e788d32cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:46.796831 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:46.796802 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object" podUID="beb311fb-6126-49fc-ae5b-a4e788d32cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:46.798800 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:46.798772 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-5bbm2\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object" podUID="7e483420-8e82-4267-8984-b39642a5152f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:46.802862 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:46.802829 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-99wb9\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object" podUID="beb311fb-6126-49fc-ae5b-a4e788d32cca" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-99wb9" Jul 21 16:34:46.802969 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.802904 2564 scope.go:117] "RemoveContainer" containerID="976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443" Jul 21 16:34:46.803167 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:46.803149 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443\": container with ID starting with 976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443 not found: ID does not exist" containerID="976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443" Jul 21 16:34:46.803210 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.803173 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443"} err="failed to get container status \"976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443\": rpc error: code = NotFound desc = could not find container \"976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443\": container with ID starting with 976a7d83540991e631ea2560cc888421c36aa370600ed0c0f792d46819e08443 not found: ID does not exist" Jul 21 16:34:46.804606 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:46.804584 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-5bbm2\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object" podUID="7e483420-8e82-4267-8984-b39642a5152f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:46.806537 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.806521 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcdwp\" (UniqueName: \"kubernetes.io/projected/beb311fb-6126-49fc-ae5b-a4e788d32cca-kube-api-access-rcdwp\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:34:46.806611 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.806538 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/beb311fb-6126-49fc-ae5b-a4e788d32cca-extensions-socket-volume\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:34:46.809340 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.809318 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:34:46.815277 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.815259 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:46.972086 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.972007 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp"] Jul 21 16:34:46.974698 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:34:46.974664 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe7edd5_2058_4d4c_9c68_9791364fc27d.slice/crio-7b30601ec1cd852cbf09288d55de2971997e6a4056e46a7fe1c7f98bdfb1f9ee WatchSource:0}: Error finding container 7b30601ec1cd852cbf09288d55de2971997e6a4056e46a7fe1c7f98bdfb1f9ee: Status 404 returned error can't find the container with id 7b30601ec1cd852cbf09288d55de2971997e6a4056e46a7fe1c7f98bdfb1f9ee Jul 21 16:34:46.981734 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:46.981712 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj"] Jul 21 16:34:46.986255 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:34:46.986234 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0820288b_8af6_4110_9f95_629440889887.slice/crio-d9fbc829e488ff8224aabfcfb7adc96ed7bfe11d535e890006a7f3a58d0daaab WatchSource:0}: Error finding container d9fbc829e488ff8224aabfcfb7adc96ed7bfe11d535e890006a7f3a58d0daaab: Status 404 returned error can't find the container with id d9fbc829e488ff8224aabfcfb7adc96ed7bfe11d535e890006a7f3a58d0daaab Jul 21 16:34:47.544875 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:47.544844 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="beb311fb-6126-49fc-ae5b-a4e788d32cca" path="/var/lib/kubelet/pods/beb311fb-6126-49fc-ae5b-a4e788d32cca/volumes" Jul 21 16:34:47.799829 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:47.799729 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" event={"ID":"cfe7edd5-2058-4d4c-9c68-9791364fc27d","Type":"ContainerStarted","Data":"efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29"} Jul 21 16:34:47.799829 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:47.799799 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" event={"ID":"cfe7edd5-2058-4d4c-9c68-9791364fc27d","Type":"ContainerStarted","Data":"7b30601ec1cd852cbf09288d55de2971997e6a4056e46a7fe1c7f98bdfb1f9ee"} Jul 21 16:34:47.799829 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:47.799824 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:34:47.801412 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:47.801389 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" podUID="7e483420-8e82-4267-8984-b39642a5152f" containerName="manager" containerID="cri-o://c50cb739e4b5f335f2d30a3b2660362c7d0642724fa205db5fc9903ae561ade3" gracePeriod=2 Jul 21 16:34:47.802906 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:47.802886 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" event={"ID":"0820288b-8af6-4110-9f95-629440889887","Type":"ContainerStarted","Data":"357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473"} Jul 21 16:34:47.802983 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:47.802927 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" event={"ID":"0820288b-8af6-4110-9f95-629440889887","Type":"ContainerStarted","Data":"d9fbc829e488ff8224aabfcfb7adc96ed7bfe11d535e890006a7f3a58d0daaab"} Jul 21 16:34:47.803024 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:47.803016 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:47.886078 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:47.886009 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" podStartSLOduration=1.885970392 podStartE2EDuration="1.885970392s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:47.885204217 +0000 UTC m=+642.953284896" watchObservedRunningTime="2026-07-21 16:34:47.885970392 +0000 UTC m=+642.954051054" Jul 21 16:34:47.886852 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:47.886797 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" podStartSLOduration=1.886782875 podStartE2EDuration="1.886782875s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:47.862635748 +0000 UTC m=+642.930716427" watchObservedRunningTime="2026-07-21 16:34:47.886782875 +0000 UTC m=+642.954863552" Jul 21 16:34:48.033538 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.033498 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:48.035494 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:48.035457 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-5bbm2\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object" podUID="7e483420-8e82-4267-8984-b39642a5152f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:48.116983 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.116900 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e483420-8e82-4267-8984-b39642a5152f-extensions-socket-volume\") pod \"7e483420-8e82-4267-8984-b39642a5152f\" (UID: \"7e483420-8e82-4267-8984-b39642a5152f\") " Jul 21 16:34:48.116983 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.116958 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zx2d9\" (UniqueName: \"kubernetes.io/projected/7e483420-8e82-4267-8984-b39642a5152f-kube-api-access-zx2d9\") pod \"7e483420-8e82-4267-8984-b39642a5152f\" (UID: \"7e483420-8e82-4267-8984-b39642a5152f\") " Jul 21 16:34:48.117318 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.117287 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e483420-8e82-4267-8984-b39642a5152f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7e483420-8e82-4267-8984-b39642a5152f" (UID: "7e483420-8e82-4267-8984-b39642a5152f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 16:34:48.119002 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.118976 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e483420-8e82-4267-8984-b39642a5152f-kube-api-access-zx2d9" (OuterVolumeSpecName: "kube-api-access-zx2d9") pod "7e483420-8e82-4267-8984-b39642a5152f" (UID: "7e483420-8e82-4267-8984-b39642a5152f"). InnerVolumeSpecName "kube-api-access-zx2d9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 16:34:48.217511 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.217475 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e483420-8e82-4267-8984-b39642a5152f-extensions-socket-volume\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:34:48.217511 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.217505 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zx2d9\" (UniqueName: \"kubernetes.io/projected/7e483420-8e82-4267-8984-b39642a5152f-kube-api-access-zx2d9\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:34:48.809401 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.809366 2564 generic.go:356] "Generic (PLEG): container finished" podID="7e483420-8e82-4267-8984-b39642a5152f" containerID="c50cb739e4b5f335f2d30a3b2660362c7d0642724fa205db5fc9903ae561ade3" exitCode=0 Jul 21 16:34:48.809401 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.809406 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:48.809965 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.809479 2564 scope.go:117] "RemoveContainer" containerID="c50cb739e4b5f335f2d30a3b2660362c7d0642724fa205db5fc9903ae561ade3" Jul 21 16:34:48.811672 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:48.811649 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-5bbm2\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object" podUID="7e483420-8e82-4267-8984-b39642a5152f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:48.818011 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.817997 2564 scope.go:117] "RemoveContainer" containerID="c50cb739e4b5f335f2d30a3b2660362c7d0642724fa205db5fc9903ae561ade3" Jul 21 16:34:48.818247 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:48.818230 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c50cb739e4b5f335f2d30a3b2660362c7d0642724fa205db5fc9903ae561ade3\": container with ID starting with c50cb739e4b5f335f2d30a3b2660362c7d0642724fa205db5fc9903ae561ade3 not found: ID does not exist" containerID="c50cb739e4b5f335f2d30a3b2660362c7d0642724fa205db5fc9903ae561ade3" Jul 21 16:34:48.818287 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:48.818254 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c50cb739e4b5f335f2d30a3b2660362c7d0642724fa205db5fc9903ae561ade3"} err="failed to get container status \"c50cb739e4b5f335f2d30a3b2660362c7d0642724fa205db5fc9903ae561ade3\": rpc error: code = NotFound desc = could not find container \"c50cb739e4b5f335f2d30a3b2660362c7d0642724fa205db5fc9903ae561ade3\": container with ID starting with c50cb739e4b5f335f2d30a3b2660362c7d0642724fa205db5fc9903ae561ade3 not found: ID does not exist" Jul 21 16:34:48.818941 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:48.818916 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-5bbm2\" is forbidden: User \"system:node:ip-10-0-130-54.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-54.ec2.internal' and this object" podUID="7e483420-8e82-4267-8984-b39642a5152f" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-5bbm2" Jul 21 16:34:49.543851 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:49.543813 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e483420-8e82-4267-8984-b39642a5152f" path="/var/lib/kubelet/pods/7e483420-8e82-4267-8984-b39642a5152f/volumes" Jul 21 16:34:58.812328 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:58.812299 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:34:58.812734 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:58.812375 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:58.887333 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:58.887299 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj"] Jul 21 16:34:58.887485 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:58.887465 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" podUID="0820288b-8af6-4110-9f95-629440889887" containerName="manager" containerID="cri-o://357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473" gracePeriod=10 Jul 21 16:34:59.170700 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.170673 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:59.305663 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.305630 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4vjp\" (UniqueName: \"kubernetes.io/projected/0820288b-8af6-4110-9f95-629440889887-kube-api-access-z4vjp\") pod \"0820288b-8af6-4110-9f95-629440889887\" (UID: \"0820288b-8af6-4110-9f95-629440889887\") " Jul 21 16:34:59.305859 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.305724 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0820288b-8af6-4110-9f95-629440889887-extensions-socket-volume\") pod \"0820288b-8af6-4110-9f95-629440889887\" (UID: \"0820288b-8af6-4110-9f95-629440889887\") " Jul 21 16:34:59.306141 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.306116 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0820288b-8af6-4110-9f95-629440889887-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0820288b-8af6-4110-9f95-629440889887" (UID: "0820288b-8af6-4110-9f95-629440889887"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 16:34:59.307773 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.307715 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0820288b-8af6-4110-9f95-629440889887-kube-api-access-z4vjp" (OuterVolumeSpecName: "kube-api-access-z4vjp") pod "0820288b-8af6-4110-9f95-629440889887" (UID: "0820288b-8af6-4110-9f95-629440889887"). InnerVolumeSpecName "kube-api-access-z4vjp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 16:34:59.332528 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.332462 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h"] Jul 21 16:34:59.332784 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.332771 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0820288b-8af6-4110-9f95-629440889887" containerName="manager" Jul 21 16:34:59.332830 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.332786 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0820288b-8af6-4110-9f95-629440889887" containerName="manager" Jul 21 16:34:59.332867 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.332844 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0820288b-8af6-4110-9f95-629440889887" containerName="manager" Jul 21 16:34:59.334678 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.334663 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:34:59.346314 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.346289 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h"] Jul 21 16:34:59.406232 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.406203 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4474d0f-613f-448e-a3ad-c9f6099a43e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zlz5h\" (UID: \"d4474d0f-613f-448e-a3ad-c9f6099a43e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:34:59.406402 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.406258 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msrbs\" (UniqueName: \"kubernetes.io/projected/d4474d0f-613f-448e-a3ad-c9f6099a43e3-kube-api-access-msrbs\") pod \"kuadrant-operator-controller-manager-86878c769f-zlz5h\" (UID: \"d4474d0f-613f-448e-a3ad-c9f6099a43e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:34:59.406402 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.406304 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0820288b-8af6-4110-9f95-629440889887-extensions-socket-volume\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:34:59.406402 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.406316 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4vjp\" (UniqueName: \"kubernetes.io/projected/0820288b-8af6-4110-9f95-629440889887-kube-api-access-z4vjp\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:34:59.507395 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.507357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4474d0f-613f-448e-a3ad-c9f6099a43e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zlz5h\" (UID: \"d4474d0f-613f-448e-a3ad-c9f6099a43e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:34:59.507563 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.507425 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msrbs\" (UniqueName: \"kubernetes.io/projected/d4474d0f-613f-448e-a3ad-c9f6099a43e3-kube-api-access-msrbs\") pod \"kuadrant-operator-controller-manager-86878c769f-zlz5h\" (UID: \"d4474d0f-613f-448e-a3ad-c9f6099a43e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:34:59.507841 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.507821 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4474d0f-613f-448e-a3ad-c9f6099a43e3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zlz5h\" (UID: \"d4474d0f-613f-448e-a3ad-c9f6099a43e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:34:59.524151 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.524121 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msrbs\" (UniqueName: \"kubernetes.io/projected/d4474d0f-613f-448e-a3ad-c9f6099a43e3-kube-api-access-msrbs\") pod \"kuadrant-operator-controller-manager-86878c769f-zlz5h\" (UID: \"d4474d0f-613f-448e-a3ad-c9f6099a43e3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:34:59.644571 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.644486 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:34:59.775324 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.775292 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h"] Jul 21 16:34:59.779139 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:34:59.779111 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4474d0f_613f_448e_a3ad_c9f6099a43e3.slice/crio-a2f085608584a093038913e9ac9531436da9d31668a7062a29df4c9231e462bb WatchSource:0}: Error finding container a2f085608584a093038913e9ac9531436da9d31668a7062a29df4c9231e462bb: Status 404 returned error can't find the container with id a2f085608584a093038913e9ac9531436da9d31668a7062a29df4c9231e462bb Jul 21 16:34:59.863822 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.863786 2564 generic.go:356] "Generic (PLEG): container finished" podID="0820288b-8af6-4110-9f95-629440889887" containerID="357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473" exitCode=0 Jul 21 16:34:59.864282 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.863836 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" Jul 21 16:34:59.864282 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.863855 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" event={"ID":"0820288b-8af6-4110-9f95-629440889887","Type":"ContainerDied","Data":"357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473"} Jul 21 16:34:59.864282 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.863909 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj" event={"ID":"0820288b-8af6-4110-9f95-629440889887","Type":"ContainerDied","Data":"d9fbc829e488ff8224aabfcfb7adc96ed7bfe11d535e890006a7f3a58d0daaab"} Jul 21 16:34:59.864282 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.863940 2564 scope.go:117] "RemoveContainer" containerID="357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473" Jul 21 16:34:59.865628 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.865608 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" event={"ID":"d4474d0f-613f-448e-a3ad-c9f6099a43e3","Type":"ContainerStarted","Data":"9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354"} Jul 21 16:34:59.865724 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.865650 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" event={"ID":"d4474d0f-613f-448e-a3ad-c9f6099a43e3","Type":"ContainerStarted","Data":"a2f085608584a093038913e9ac9531436da9d31668a7062a29df4c9231e462bb"} Jul 21 16:34:59.865724 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.865699 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:34:59.872464 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.872441 2564 scope.go:117] "RemoveContainer" containerID="357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473" Jul 21 16:34:59.872730 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:34:59.872714 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473\": container with ID starting with 357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473 not found: ID does not exist" containerID="357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473" Jul 21 16:34:59.872815 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.872756 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473"} err="failed to get container status \"357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473\": rpc error: code = NotFound desc = could not find container \"357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473\": container with ID starting with 357fac85deda337afba4ef06f8487b382c31ef561c85f82cd8300465e1cbb473 not found: ID does not exist" Jul 21 16:34:59.901064 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.900965 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" podStartSLOduration=0.900949698 podStartE2EDuration="900.949698ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:34:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:34:59.89894195 +0000 UTC m=+654.967022645" watchObservedRunningTime="2026-07-21 16:34:59.900949698 +0000 UTC m=+654.969030426" Jul 21 16:34:59.919416 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.919365 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj"] Jul 21 16:34:59.927468 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:34:59.927441 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4vpkj"] Jul 21 16:35:01.543954 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:01.543920 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0820288b-8af6-4110-9f95-629440889887" path="/var/lib/kubelet/pods/0820288b-8af6-4110-9f95-629440889887/volumes" Jul 21 16:35:10.874208 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:10.874178 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:35:10.922268 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:10.922240 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp"] Jul 21 16:35:10.922459 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:10.922436 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" podUID="cfe7edd5-2058-4d4c-9c68-9791364fc27d" containerName="manager" containerID="cri-o://efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29" gracePeriod=10 Jul 21 16:35:11.174972 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.174942 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:35:11.312492 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.312457 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmhwv\" (UniqueName: \"kubernetes.io/projected/cfe7edd5-2058-4d4c-9c68-9791364fc27d-kube-api-access-fmhwv\") pod \"cfe7edd5-2058-4d4c-9c68-9791364fc27d\" (UID: \"cfe7edd5-2058-4d4c-9c68-9791364fc27d\") " Jul 21 16:35:11.312492 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.312500 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfe7edd5-2058-4d4c-9c68-9791364fc27d-extensions-socket-volume\") pod \"cfe7edd5-2058-4d4c-9c68-9791364fc27d\" (UID: \"cfe7edd5-2058-4d4c-9c68-9791364fc27d\") " Jul 21 16:35:11.312923 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.312904 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfe7edd5-2058-4d4c-9c68-9791364fc27d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cfe7edd5-2058-4d4c-9c68-9791364fc27d" (UID: "cfe7edd5-2058-4d4c-9c68-9791364fc27d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 16:35:11.314513 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.314488 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe7edd5-2058-4d4c-9c68-9791364fc27d-kube-api-access-fmhwv" (OuterVolumeSpecName: "kube-api-access-fmhwv") pod "cfe7edd5-2058-4d4c-9c68-9791364fc27d" (UID: "cfe7edd5-2058-4d4c-9c68-9791364fc27d"). InnerVolumeSpecName "kube-api-access-fmhwv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 16:35:11.414188 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.414099 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmhwv\" (UniqueName: \"kubernetes.io/projected/cfe7edd5-2058-4d4c-9c68-9791364fc27d-kube-api-access-fmhwv\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:35:11.414188 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.414130 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cfe7edd5-2058-4d4c-9c68-9791364fc27d-extensions-socket-volume\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:35:11.925088 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.925055 2564 generic.go:356] "Generic (PLEG): container finished" podID="cfe7edd5-2058-4d4c-9c68-9791364fc27d" containerID="efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29" exitCode=0 Jul 21 16:35:11.925511 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.925103 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" Jul 21 16:35:11.925511 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.925145 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" event={"ID":"cfe7edd5-2058-4d4c-9c68-9791364fc27d","Type":"ContainerDied","Data":"efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29"} Jul 21 16:35:11.925511 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.925203 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp" event={"ID":"cfe7edd5-2058-4d4c-9c68-9791364fc27d","Type":"ContainerDied","Data":"7b30601ec1cd852cbf09288d55de2971997e6a4056e46a7fe1c7f98bdfb1f9ee"} Jul 21 16:35:11.925511 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.925232 2564 scope.go:117] "RemoveContainer" containerID="efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29" Jul 21 16:35:11.933283 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.933267 2564 scope.go:117] "RemoveContainer" containerID="efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29" Jul 21 16:35:11.933546 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:35:11.933525 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29\": container with ID starting with efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29 not found: ID does not exist" containerID="efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29" Jul 21 16:35:11.933644 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.933553 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29"} err="failed to get container status \"efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29\": rpc error: code = NotFound desc = could not find container \"efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29\": container with ID starting with efc1016932fcdb79dee7cf1fff4f24630a64ad8abbce098c822c04729dad5f29 not found: ID does not exist" Jul 21 16:35:11.956868 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.956841 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp"] Jul 21 16:35:11.964185 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:11.964163 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-t52wp"] Jul 21 16:35:13.543535 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:13.543505 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfe7edd5-2058-4d4c-9c68-9791364fc27d" path="/var/lib/kubelet/pods/cfe7edd5-2058-4d4c-9c68-9791364fc27d/volumes" Jul 21 16:35:29.883540 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:29.883506 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:35:29.883958 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:29.883833 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe7edd5-2058-4d4c-9c68-9791364fc27d" containerName="manager" Jul 21 16:35:29.883958 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:29.883846 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe7edd5-2058-4d4c-9c68-9791364fc27d" containerName="manager" Jul 21 16:35:29.883958 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:29.883900 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfe7edd5-2058-4d4c-9c68-9791364fc27d" containerName="manager" Jul 21 16:35:29.885660 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:29.885643 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" Jul 21 16:35:29.888299 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:29.888271 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 21 16:35:29.888450 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:29.888301 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9q6hx\"" Jul 21 16:35:29.902077 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:29.902052 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:35:29.951368 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:29.951337 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:35:29.953872 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:29.953848 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89gdx\" (UniqueName: \"kubernetes.io/projected/d19c1499-7da2-4303-80e7-dc290373d836-kube-api-access-89gdx\") pod \"limitador-limitador-54d6d988d5-nfgn2\" (UID: \"d19c1499-7da2-4303-80e7-dc290373d836\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" Jul 21 16:35:29.953982 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:29.953887 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d19c1499-7da2-4303-80e7-dc290373d836-config-file\") pod \"limitador-limitador-54d6d988d5-nfgn2\" (UID: \"d19c1499-7da2-4303-80e7-dc290373d836\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" Jul 21 16:35:30.054568 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:30.054539 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89gdx\" (UniqueName: \"kubernetes.io/projected/d19c1499-7da2-4303-80e7-dc290373d836-kube-api-access-89gdx\") pod \"limitador-limitador-54d6d988d5-nfgn2\" (UID: \"d19c1499-7da2-4303-80e7-dc290373d836\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" Jul 21 16:35:30.054738 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:30.054578 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d19c1499-7da2-4303-80e7-dc290373d836-config-file\") pod \"limitador-limitador-54d6d988d5-nfgn2\" (UID: \"d19c1499-7da2-4303-80e7-dc290373d836\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" Jul 21 16:35:30.055250 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:30.055232 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/d19c1499-7da2-4303-80e7-dc290373d836-config-file\") pod \"limitador-limitador-54d6d988d5-nfgn2\" (UID: \"d19c1499-7da2-4303-80e7-dc290373d836\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" Jul 21 16:35:30.062591 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:30.062567 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89gdx\" (UniqueName: \"kubernetes.io/projected/d19c1499-7da2-4303-80e7-dc290373d836-kube-api-access-89gdx\") pod \"limitador-limitador-54d6d988d5-nfgn2\" (UID: \"d19c1499-7da2-4303-80e7-dc290373d836\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" Jul 21 16:35:30.195939 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:30.195856 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" Jul 21 16:35:30.332469 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:30.332437 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:35:30.335879 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:35:30.335852 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19c1499_7da2_4303_80e7_dc290373d836.slice/crio-f47527eeb29c45933ab4c9e40b358376b7ca8269d14c0124cfc13440ea6e9e44 WatchSource:0}: Error finding container f47527eeb29c45933ab4c9e40b358376b7ca8269d14c0124cfc13440ea6e9e44: Status 404 returned error can't find the container with id f47527eeb29c45933ab4c9e40b358376b7ca8269d14c0124cfc13440ea6e9e44 Jul 21 16:35:31.007699 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:31.007664 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" event={"ID":"d19c1499-7da2-4303-80e7-dc290373d836","Type":"ContainerStarted","Data":"f47527eeb29c45933ab4c9e40b358376b7ca8269d14c0124cfc13440ea6e9e44"} Jul 21 16:35:33.020062 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:33.020031 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" event={"ID":"d19c1499-7da2-4303-80e7-dc290373d836","Type":"ContainerStarted","Data":"9397901a1e0191a9714cad2fe9c6f0697ca817374868dbec4e347ce8cbf9572f"} Jul 21 16:35:33.020463 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:33.020117 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" Jul 21 16:35:33.036351 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:33.036301 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" podStartSLOduration=1.634873019 podStartE2EDuration="4.036286282s" totalImagesPullingTime="2.401413263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:35:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:35:33.035252524 +0000 UTC m=+688.103333204" watchObservedRunningTime="2026-07-21 16:35:33.036286282 +0000 UTC m=+688.104366965" Jul 21 16:35:44.025191 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:35:44.025152 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nfgn2" Jul 21 16:36:43.533917 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:36:43.533884 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:37:03.989124 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:03.989084 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:37:07.788361 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:07.788328 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:37:23.587843 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.587814 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8"] Jul 21 16:37:23.590145 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.590121 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.594003 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.593964 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 21 16:37:23.594138 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.593964 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 21 16:37:23.594413 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.594382 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mkhrl\"" Jul 21 16:37:23.594521 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.594427 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 21 16:37:23.603974 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.603944 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8"] Jul 21 16:37:23.685484 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.685443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.685484 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.685493 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58315ae7-9a93-412e-a82d-d4db1e400575-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.685733 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.685546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.685733 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.685587 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg72c\" (UniqueName: \"kubernetes.io/projected/58315ae7-9a93-412e-a82d-d4db1e400575-kube-api-access-pg72c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.685733 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.685609 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.685733 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.685638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.786201 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.786160 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.786201 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.786210 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58315ae7-9a93-412e-a82d-d4db1e400575-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.786462 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.786228 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.786462 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.786257 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg72c\" (UniqueName: \"kubernetes.io/projected/58315ae7-9a93-412e-a82d-d4db1e400575-kube-api-access-pg72c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.786462 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.786277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.786462 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.786303 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.786669 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.786638 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.786765 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.786717 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.786821 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.786742 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.788510 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.788480 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/58315ae7-9a93-412e-a82d-d4db1e400575-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.788733 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.788713 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58315ae7-9a93-412e-a82d-d4db1e400575-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.794944 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.794917 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg72c\" (UniqueName: \"kubernetes.io/projected/58315ae7-9a93-412e-a82d-d4db1e400575-kube-api-access-pg72c\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rvcb8\" (UID: \"58315ae7-9a93-412e-a82d-d4db1e400575\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:23.900953 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:23.900863 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:24.034209 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:24.034178 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8"] Jul 21 16:37:24.037740 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:37:24.037713 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58315ae7_9a93_412e_a82d_d4db1e400575.slice/crio-85b9e1ecaf9972840a91bb248464fb7f4c379fe130c4fadafe48cf954a90566f WatchSource:0}: Error finding container 85b9e1ecaf9972840a91bb248464fb7f4c379fe130c4fadafe48cf954a90566f: Status 404 returned error can't find the container with id 85b9e1ecaf9972840a91bb248464fb7f4c379fe130c4fadafe48cf954a90566f Jul 21 16:37:24.039225 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:24.039208 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 21 16:37:24.478480 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:24.478389 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" event={"ID":"58315ae7-9a93-412e-a82d-d4db1e400575","Type":"ContainerStarted","Data":"85b9e1ecaf9972840a91bb248464fb7f4c379fe130c4fadafe48cf954a90566f"} Jul 21 16:37:24.990253 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:24.990204 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:37:25.484030 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:25.483997 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" event={"ID":"58315ae7-9a93-412e-a82d-d4db1e400575","Type":"ContainerStarted","Data":"dda0370f6dd81bc0c38904d3331984ef4bb8f10352f932f02afa911de9bc89c2"} Jul 21 16:37:25.503502 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:25.503430 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" podStartSLOduration=1.5052180590000002 podStartE2EDuration="2.503413249s" totalImagesPullingTime="998.19519ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:37:25.502203919 +0000 UTC m=+800.570284614" watchObservedRunningTime="2026-07-21 16:37:25.503413249 +0000 UTC m=+800.571493928" Jul 21 16:37:33.901368 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:33.901275 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:33.901368 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:33.901339 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:33.913675 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:33.913651 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:34.535524 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:34.535496 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rvcb8" Jul 21 16:37:35.914164 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:35.914130 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h"] Jul 21 16:37:35.916304 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:35.916289 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:35.920459 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:35.920439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 21 16:37:35.930769 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:35.930730 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h"] Jul 21 16:37:35.977401 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:35.977373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:35.977558 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:35.977407 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65spj\" (UniqueName: \"kubernetes.io/projected/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-kube-api-access-65spj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:35.977558 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:35.977443 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:35.977558 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:35.977468 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:35.977558 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:35.977504 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:35.977699 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:35.977565 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.078726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.078687 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.078726 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.078728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65spj\" (UniqueName: \"kubernetes.io/projected/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-kube-api-access-65spj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.078995 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.078772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.078995 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.078798 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.078995 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.078851 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.078995 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.078880 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.079205 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.079179 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.079246 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.079214 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.079298 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.079282 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.081402 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.081375 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.081787 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.081727 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.086741 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.086717 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65spj\" (UniqueName: \"kubernetes.io/projected/8bfdf310-b149-4737-9dfe-27d4f9ed70d7-kube-api-access-65spj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h\" (UID: \"8bfdf310-b149-4737-9dfe-27d4f9ed70d7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.226123 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.226040 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:36.352657 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.352630 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h"] Jul 21 16:37:36.355299 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:37:36.355272 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bfdf310_b149_4737_9dfe_27d4f9ed70d7.slice/crio-640e2efad2517c95e6288635b26645b697052306bf35f3898f39ad9c22f5ee6a WatchSource:0}: Error finding container 640e2efad2517c95e6288635b26645b697052306bf35f3898f39ad9c22f5ee6a: Status 404 returned error can't find the container with id 640e2efad2517c95e6288635b26645b697052306bf35f3898f39ad9c22f5ee6a Jul 21 16:37:36.533818 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:36.533790 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" event={"ID":"8bfdf310-b149-4737-9dfe-27d4f9ed70d7","Type":"ContainerStarted","Data":"640e2efad2517c95e6288635b26645b697052306bf35f3898f39ad9c22f5ee6a"} Jul 21 16:37:37.497858 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:37.497825 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:37:37.545311 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:37.545277 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" event={"ID":"8bfdf310-b149-4737-9dfe-27d4f9ed70d7","Type":"ContainerStarted","Data":"e3b771bd1894c30f7207488029d44abdfb04c91da4fca08563f685fbce5e9ef8"} Jul 21 16:37:37.561208 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:37.561161 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" podStartSLOduration=2.398679183 podStartE2EDuration="2.561146199s" totalImagesPullingTime="162.467016ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:37:37.559286485 +0000 UTC m=+812.627367188" watchObservedRunningTime="2026-07-21 16:37:37.561146199 +0000 UTC m=+812.629226877" Jul 21 16:37:44.788518 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.788486 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc"] Jul 21 16:37:44.792481 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.792452 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.795319 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.795294 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 21 16:37:44.802731 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.802711 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc"] Jul 21 16:37:44.857649 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.857613 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f453fa2e-11d2-48ab-892c-f75ba553049e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.857649 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.857650 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mc4b\" (UniqueName: \"kubernetes.io/projected/f453fa2e-11d2-48ab-892c-f75ba553049e-kube-api-access-4mc4b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.857900 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.857736 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.857900 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.857793 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.857900 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.857830 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.857900 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.857846 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.959164 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.959124 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f453fa2e-11d2-48ab-892c-f75ba553049e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.959164 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.959165 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mc4b\" (UniqueName: \"kubernetes.io/projected/f453fa2e-11d2-48ab-892c-f75ba553049e-kube-api-access-4mc4b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.959411 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.959213 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.959411 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.959237 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.959411 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.959265 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.959411 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.959280 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.959705 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.959683 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.959820 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.959762 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.959879 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.959810 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.961904 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.961872 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f453fa2e-11d2-48ab-892c-f75ba553049e-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.962123 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.962108 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f453fa2e-11d2-48ab-892c-f75ba553049e-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:44.967326 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:44.967299 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mc4b\" (UniqueName: \"kubernetes.io/projected/f453fa2e-11d2-48ab-892c-f75ba553049e-kube-api-access-4mc4b\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-mhtxc\" (UID: \"f453fa2e-11d2-48ab-892c-f75ba553049e\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:45.103714 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:45.103632 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:45.234114 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:45.234091 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc"] Jul 21 16:37:45.236526 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:37:45.236489 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf453fa2e_11d2_48ab_892c_f75ba553049e.slice/crio-668f279adad0d4b9cc7a45c7dd0eb832ac602a13e772ca1f8ce2bbeb2577ed47 WatchSource:0}: Error finding container 668f279adad0d4b9cc7a45c7dd0eb832ac602a13e772ca1f8ce2bbeb2577ed47: Status 404 returned error can't find the container with id 668f279adad0d4b9cc7a45c7dd0eb832ac602a13e772ca1f8ce2bbeb2577ed47 Jul 21 16:37:45.574438 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:45.574407 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" event={"ID":"f453fa2e-11d2-48ab-892c-f75ba553049e","Type":"ContainerStarted","Data":"1ef4da424947639a7f4cad439d093cdfe1c5e74e376a6ad9891b9aba9551e249"} Jul 21 16:37:45.574606 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:45.574467 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" event={"ID":"f453fa2e-11d2-48ab-892c-f75ba553049e","Type":"ContainerStarted","Data":"668f279adad0d4b9cc7a45c7dd0eb832ac602a13e772ca1f8ce2bbeb2577ed47"} Jul 21 16:37:45.598874 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:45.598830 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" podStartSLOduration=1.417389602 podStartE2EDuration="1.598812011s" totalImagesPullingTime="181.422409ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:37:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:37:45.598014658 +0000 UTC m=+820.666095334" watchObservedRunningTime="2026-07-21 16:37:45.598812011 +0000 UTC m=+820.666892687" Jul 21 16:37:46.226246 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:46.226206 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:46.226649 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:46.226282 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:46.238425 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:46.238402 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:46.589968 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:46.589942 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h" Jul 21 16:37:46.798093 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:46.798062 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:37:55.104639 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:55.104597 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:55.105136 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:55.104668 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:55.117108 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:55.117085 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:55.628527 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:55.628498 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-mhtxc" Jul 21 16:37:57.196888 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:37:57.196856 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:39:05.375584 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:39:05.375508 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:39:05.378125 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:39:05.378103 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:40:28.694391 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:40:28.694310 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:40:39.402060 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:40:39.402030 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:40:50.417033 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:40:50.416992 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:42:32.103536 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:42:32.103499 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:42:44.994118 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:42:44.994080 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:43:19.094032 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:43:19.093995 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:43:28.690129 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:43:28.690049 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:43:37.591043 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:43:37.591002 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:43:49.894125 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:43:49.894092 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:43:58.787305 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:43:58.787271 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:44:05.401616 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:44:05.401586 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:44:05.403276 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:44:05.403252 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:44:07.592452 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:44:07.592416 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:44:19.695690 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:44:19.695657 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:44:29.297912 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:44:29.297877 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:44:51.693950 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:44:51.693915 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:45:03.585349 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:45:03.585259 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:45:25.496431 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:45:25.496400 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:45:38.591531 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:45:38.591496 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:45:47.596395 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:45:47.596359 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:45:55.389458 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:45:55.389427 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:46:04.794928 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:46:04.794891 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:46:14.289447 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:46:14.289412 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:46:23.193432 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:46:23.193396 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:46:32.686529 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:46:32.686443 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:46:58.892943 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:46:58.892901 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h"] Jul 21 16:46:58.893724 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:46:58.893211 2564 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" podUID="d4474d0f-613f-448e-a3ad-c9f6099a43e3" containerName="manager" containerID="cri-o://9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354" gracePeriod=10 Jul 21 16:47:01.753330 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:01.753307 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:47:01.835903 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:01.835824 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4474d0f-613f-448e-a3ad-c9f6099a43e3-extensions-socket-volume\") pod \"d4474d0f-613f-448e-a3ad-c9f6099a43e3\" (UID: \"d4474d0f-613f-448e-a3ad-c9f6099a43e3\") " Jul 21 16:47:01.835903 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:01.835868 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msrbs\" (UniqueName: \"kubernetes.io/projected/d4474d0f-613f-448e-a3ad-c9f6099a43e3-kube-api-access-msrbs\") pod \"d4474d0f-613f-448e-a3ad-c9f6099a43e3\" (UID: \"d4474d0f-613f-448e-a3ad-c9f6099a43e3\") " Jul 21 16:47:01.836186 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:01.836165 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4474d0f-613f-448e-a3ad-c9f6099a43e3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d4474d0f-613f-448e-a3ad-c9f6099a43e3" (UID: "d4474d0f-613f-448e-a3ad-c9f6099a43e3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 21 16:47:01.837882 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:01.837861 2564 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4474d0f-613f-448e-a3ad-c9f6099a43e3-kube-api-access-msrbs" (OuterVolumeSpecName: "kube-api-access-msrbs") pod "d4474d0f-613f-448e-a3ad-c9f6099a43e3" (UID: "d4474d0f-613f-448e-a3ad-c9f6099a43e3"). InnerVolumeSpecName "kube-api-access-msrbs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 21 16:47:01.936976 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:01.936944 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d4474d0f-613f-448e-a3ad-c9f6099a43e3-extensions-socket-volume\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:47:01.936976 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:01.936968 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msrbs\" (UniqueName: \"kubernetes.io/projected/d4474d0f-613f-448e-a3ad-c9f6099a43e3-kube-api-access-msrbs\") on node \"ip-10-0-130-54.ec2.internal\" DevicePath \"\"" Jul 21 16:47:02.012207 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:02.012167 2564 generic.go:356] "Generic (PLEG): container finished" podID="d4474d0f-613f-448e-a3ad-c9f6099a43e3" containerID="9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354" exitCode=0 Jul 21 16:47:02.012353 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:02.012211 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" Jul 21 16:47:02.012353 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:02.012250 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" event={"ID":"d4474d0f-613f-448e-a3ad-c9f6099a43e3","Type":"ContainerDied","Data":"9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354"} Jul 21 16:47:02.012353 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:02.012305 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h" event={"ID":"d4474d0f-613f-448e-a3ad-c9f6099a43e3","Type":"ContainerDied","Data":"a2f085608584a093038913e9ac9531436da9d31668a7062a29df4c9231e462bb"} Jul 21 16:47:02.012353 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:02.012328 2564 scope.go:117] "RemoveContainer" containerID="9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354" Jul 21 16:47:02.021809 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:02.021791 2564 scope.go:117] "RemoveContainer" containerID="9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354" Jul 21 16:47:02.022032 ip-10-0-130-54 kubenswrapper[2564]: E0721 16:47:02.022013 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354\": container with ID starting with 9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354 not found: ID does not exist" containerID="9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354" Jul 21 16:47:02.022095 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:02.022045 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354"} err="failed to get container status \"9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354\": rpc error: code = NotFound desc = could not find container \"9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354\": container with ID starting with 9a30b7731b778646902057deba5a85da3b4457a032159886cfee539529329354 not found: ID does not exist" Jul 21 16:47:02.031815 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:02.031792 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h"] Jul 21 16:47:02.036032 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:02.036010 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zlz5h"] Jul 21 16:47:03.543816 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:47:03.543783 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4474d0f-613f-448e-a3ad-c9f6099a43e3" path="/var/lib/kubelet/pods/d4474d0f-613f-448e-a3ad-c9f6099a43e3/volumes" Jul 21 16:48:00.003649 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.003568 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll"] Jul 21 16:48:00.004179 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.003897 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4474d0f-613f-448e-a3ad-c9f6099a43e3" containerName="manager" Jul 21 16:48:00.004179 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.003907 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4474d0f-613f-448e-a3ad-c9f6099a43e3" containerName="manager" Jul 21 16:48:00.004179 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.003959 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4474d0f-613f-448e-a3ad-c9f6099a43e3" containerName="manager" Jul 21 16:48:00.006796 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.006778 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" Jul 21 16:48:00.009149 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.009130 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-mvkfh\"" Jul 21 16:48:00.018426 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.018407 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll"] Jul 21 16:48:00.034421 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.034392 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b279cdf0-250e-4ffe-ad9d-0efc785e31fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-twzll\" (UID: \"b279cdf0-250e-4ffe-ad9d-0efc785e31fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" Jul 21 16:48:00.034555 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.034430 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtpl2\" (UniqueName: \"kubernetes.io/projected/b279cdf0-250e-4ffe-ad9d-0efc785e31fe-kube-api-access-wtpl2\") pod \"kuadrant-operator-controller-manager-86878c769f-twzll\" (UID: \"b279cdf0-250e-4ffe-ad9d-0efc785e31fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" Jul 21 16:48:00.135149 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.135110 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b279cdf0-250e-4ffe-ad9d-0efc785e31fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-twzll\" (UID: \"b279cdf0-250e-4ffe-ad9d-0efc785e31fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" Jul 21 16:48:00.135149 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.135156 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtpl2\" (UniqueName: \"kubernetes.io/projected/b279cdf0-250e-4ffe-ad9d-0efc785e31fe-kube-api-access-wtpl2\") pod \"kuadrant-operator-controller-manager-86878c769f-twzll\" (UID: \"b279cdf0-250e-4ffe-ad9d-0efc785e31fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" Jul 21 16:48:00.135523 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.135506 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b279cdf0-250e-4ffe-ad9d-0efc785e31fe-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-twzll\" (UID: \"b279cdf0-250e-4ffe-ad9d-0efc785e31fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" Jul 21 16:48:00.147982 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.147952 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtpl2\" (UniqueName: \"kubernetes.io/projected/b279cdf0-250e-4ffe-ad9d-0efc785e31fe-kube-api-access-wtpl2\") pod \"kuadrant-operator-controller-manager-86878c769f-twzll\" (UID: \"b279cdf0-250e-4ffe-ad9d-0efc785e31fe\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" Jul 21 16:48:00.317096 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.317005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" Jul 21 16:48:00.451218 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:00.451195 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll"] Jul 21 16:48:00.453851 ip-10-0-130-54 kubenswrapper[2564]: W0721 16:48:00.453825 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb279cdf0_250e_4ffe_ad9d_0efc785e31fe.slice/crio-fb73854888c20d9e8307bd2b9df8cdf62548ec5eeca9eab04b786ed508b9a0bf WatchSource:0}: Error finding container fb73854888c20d9e8307bd2b9df8cdf62548ec5eeca9eab04b786ed508b9a0bf: Status 404 returned error can't find the container with id fb73854888c20d9e8307bd2b9df8cdf62548ec5eeca9eab04b786ed508b9a0bf Jul 21 16:48:01.280786 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:01.280730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" event={"ID":"b279cdf0-250e-4ffe-ad9d-0efc785e31fe","Type":"ContainerStarted","Data":"ab3d3bf3d3d86b3edbed0c674640f6294d5b8d3dfe7dd7b0dff71bfe97c80efb"} Jul 21 16:48:01.281261 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:01.280836 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" event={"ID":"b279cdf0-250e-4ffe-ad9d-0efc785e31fe","Type":"ContainerStarted","Data":"fb73854888c20d9e8307bd2b9df8cdf62548ec5eeca9eab04b786ed508b9a0bf"} Jul 21 16:48:01.281261 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:01.280887 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" Jul 21 16:48:01.300378 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:01.300332 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" podStartSLOduration=2.300318813 podStartE2EDuration="2.300318813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-21 16:47:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 16:48:01.299138721 +0000 UTC m=+1436.367219402" watchObservedRunningTime="2026-07-21 16:48:01.300318813 +0000 UTC m=+1436.368399490" Jul 21 16:48:12.288066 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:12.288037 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-twzll" Jul 21 16:48:22.993494 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:22.993461 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:48:34.499409 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:34.499372 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:48:43.106678 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:43.106643 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:48:53.994855 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:48:53.994818 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:49:04.387673 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:49:04.387638 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:49:05.426045 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:49:05.426013 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:49:05.427840 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:49:05.427820 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:49:15.898129 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:49:15.898093 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:49:25.290846 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:49:25.290810 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:49:36.092470 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:49:36.092378 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:49:46.711860 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:49:46.711829 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:49:56.328595 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:49:56.328560 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:50:07.796866 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:50:07.796832 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:50:31.393462 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:50:31.393424 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:50:40.426206 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:50:40.426165 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:51:02.498362 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:51:02.498278 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:51:26.801799 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:51:26.801762 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:51:44.999282 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:51:44.999246 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:51:58.291786 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:51:58.291739 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:52:05.093679 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:52:05.093647 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:52:21.499124 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:52:21.499090 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:52:32.002995 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:52:32.002914 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:52:41.099540 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:52:41.099505 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:52:51.306240 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:52:51.306208 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:53:07.102469 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:53:07.102437 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:53:15.194130 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:53:15.194094 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:53:24.607677 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:53:24.607634 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:53:34.203645 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:53:34.203607 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:53:49.906380 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:53:49.906348 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:54:02.493613 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:54:02.493529 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:54:05.457427 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:54:05.457395 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:54:05.458881 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:54:05.458861 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:54:10.404119 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:54:10.404076 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:54:22.295570 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:54:22.295533 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:54:33.298179 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:54:33.298141 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:54:42.187675 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:54:42.187638 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:54:49.799297 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:54:49.799254 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:55:02.796301 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:55:02.796260 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:55:14.748997 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:55:14.748965 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:55:31.302541 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:55:31.302508 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:56:02.592683 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:56:02.592649 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:56:14.100943 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:56:14.100905 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:56:46.790565 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:56:46.790530 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:56:57.992281 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:56:57.992195 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:57:30.687291 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:57:30.687257 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:57:41.894055 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:57:41.894015 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:58:14.886200 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:58:14.886162 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:59:05.482251 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:59:05.482221 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:59:05.484582 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:59:05.484556 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 16:59:42.393713 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:59:42.393677 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 16:59:52.148521 ip-10-0-130-54 kubenswrapper[2564]: I0721 16:59:52.148483 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:00:04.697911 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:00:04.697837 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:00:24.499477 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:00:24.499442 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:00:59.994412 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:00:59.994369 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:01:15.701235 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:01:15.701196 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:01:29.592403 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:01:29.592324 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:01:47.814844 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:01:47.814807 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:01:56.411554 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:01:56.411518 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:02:48.611352 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:02:48.611315 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:02:58.305009 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:02:58.304914 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:03:50.199347 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:03:50.199311 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:04:02.294031 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:04:02.293990 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:04:05.509142 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:04:05.509107 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 17:04:05.512232 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:04:05.512209 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 17:04:14.397111 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:04:14.397076 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:04:25.599182 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:04:25.599143 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:04:37.399458 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:04:37.399373 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:05:16.404498 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:05:16.404456 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:05:32.803529 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:05:32.803496 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:05:48.720574 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:05:48.720533 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:06:08.416135 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:06:08.416094 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:06:24.704927 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:06:24.704894 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:06:40.096206 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:06:40.096164 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:07:09.501571 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:07:09.501531 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:07:24.273239 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:07:24.273199 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:07:33.100860 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:07:33.100775 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:07:51.993016 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:07:51.992982 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:08:46.312357 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:08:46.312321 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:09:00.308770 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:09:00.308676 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:09:05.536094 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:09:05.536063 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 17:09:05.539615 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:09:05.539591 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 17:09:16.014790 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:09:16.014738 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:09:34.494313 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:09:34.494277 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:09:51.298686 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:09:51.298651 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:10:08.498635 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:10:08.498598 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:10:26.301418 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:10:26.301381 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:10:42.098739 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:10:42.098701 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:10:55.089713 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:10:55.089674 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:11:25.485565 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:11:25.485525 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:11:42.693708 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:11:42.693674 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:12:01.393517 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:12:01.393428 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:12:19.703433 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:12:19.703396 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:12:29.800226 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:12:29.800191 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:12:52.697406 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:12:52.697366 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:13:07.396646 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:13:07.396611 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:13:22.600482 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:13:22.600442 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:13:37.204684 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:13:37.204593 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:14:01.890443 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:01.890410 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:14:05.565266 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:05.565239 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 17:14:05.568053 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:05.568009 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mnx9h_d7358dd4-bdf0-46a7-9bf3-73b2d28e4ae2/ovn-acl-logging/0.log" Jul 21 17:14:24.392256 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:24.392223 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nfgn2"] Jul 21 17:14:38.690997 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:38.690963 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cp5x4_f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d/manager/0.log" Jul 21 17:14:38.815978 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:38.815948 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ts887_b96669e3-c154-42ef-aabd-4e69e52a21d5/manager/0.log" Jul 21 17:14:39.047364 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:39.047336 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fk7xj_c5523cd2-a7a5-4a9b-95c5-55b503efd5de/server/0.log" Jul 21 17:14:39.172038 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:39.172007 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mw4fj_836db5cd-88e8-42d9-97a9-75eaa8910d1c/manager/0.log" Jul 21 17:14:39.405875 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:39.405797 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk_9c4a3664-844a-46e5-8311-ed2c1760c5c6/copy-manifests/0.log" Jul 21 17:14:39.413554 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:39.413523 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk_9c4a3664-844a-46e5-8311-ed2c1760c5c6/manager/0.log" Jul 21 17:14:42.038000 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:42.037968 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-twzll_b279cdf0-250e-4ffe-ad9d-0efc785e31fe/manager/0.log" Jul 21 17:14:42.144700 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:42.144673 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nfgn2_d19c1499-7da2-4303-80e7-dc290373d836/limitador/0.log" Jul 21 17:14:42.804455 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:42.804425 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ldznj_4e3d9a21-b743-4fab-bec4-d34a2b17bfc5/discovery/0.log" Jul 21 17:14:42.944374 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:42.944340 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54864c54db-5gb6x_b89a4f61-3341-489b-9f42-d19e1189f210/kube-auth-proxy/0.log" Jul 21 17:14:44.098251 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:44.098225 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rvcb8_58315ae7-9a93-412e-a82d-d4db1e400575/main/0.log" Jul 21 17:14:44.206069 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:44.206036 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsn89h_8bfdf310-b149-4737-9dfe-27d4f9ed70d7/main/0.log" Jul 21 17:14:44.315705 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:44.315675 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-mhtxc_f453fa2e-11d2-48ab-892c-f75ba553049e/main/0.log" Jul 21 17:14:52.961175 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:52.961135 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-c7pb5_8ac3a036-67b1-49e6-a075-7f43a9dbc6c5/global-pull-secret-syncer/0.log" Jul 21 17:14:53.147212 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:53.147182 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fndhg_96fc0b6e-da00-40de-ad28-b2b45aa6de67/konnectivity-agent/0.log" Jul 21 17:14:53.261160 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:53.261112 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-54.ec2.internal_2cfdb6b3273ab625922b8832a1abf7ed/haproxy/0.log" Jul 21 17:14:59.178499 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:59.178389 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-twzll_b279cdf0-250e-4ffe-ad9d-0efc785e31fe/manager/0.log" Jul 21 17:14:59.200616 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:14:59.200592 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nfgn2_d19c1499-7da2-4303-80e7-dc290373d836/limitador/0.log" Jul 21 17:15:01.482351 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:01.482316 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lgp86_891e66e2-85d1-4ac2-91d0-f9f98a4fd662/node-exporter/0.log" Jul 21 17:15:01.502227 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:01.502193 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lgp86_891e66e2-85d1-4ac2-91d0-f9f98a4fd662/kube-rbac-proxy/0.log" Jul 21 17:15:01.522854 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:01.522830 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-lgp86_891e66e2-85d1-4ac2-91d0-f9f98a4fd662/init-textfile/0.log" Jul 21 17:15:01.957270 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:01.957233 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-fl6bj_e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f/prometheus-operator/0.log" Jul 21 17:15:01.976849 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:01.976817 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-5945b5cfd-fl6bj_e57fe286-9cfa-4f4a-a4b2-3df6bdfe2f0f/kube-rbac-proxy/0.log" Jul 21 17:15:03.242376 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.242340 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b"] Jul 21 17:15:03.251364 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.251329 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.253628 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.253604 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79c4t\"/\"kube-root-ca.crt\"" Jul 21 17:15:03.253773 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.253659 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-79c4t\"/\"default-dockercfg-cd55w\"" Jul 21 17:15:03.254160 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.254141 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-79c4t\"/\"openshift-service-ca.crt\"" Jul 21 17:15:03.257052 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.257033 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b"] Jul 21 17:15:03.259161 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.259005 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-lib-modules\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.259161 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.259117 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-podres\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.259161 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.259150 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssx4g\" (UniqueName: \"kubernetes.io/projected/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-kube-api-access-ssx4g\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.259359 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.259204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-sys\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.259359 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.259234 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-proc\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.359991 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.359951 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-podres\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.359991 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.359987 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssx4g\" (UniqueName: \"kubernetes.io/projected/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-kube-api-access-ssx4g\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.360205 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.360112 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-podres\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.360205 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.360107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-sys\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.360205 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.360156 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-sys\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.360205 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.360181 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-proc\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.360347 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.360224 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-lib-modules\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.360347 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.360287 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-proc\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.360419 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.360357 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-lib-modules\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.368581 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.368561 2564 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssx4g\" (UniqueName: \"kubernetes.io/projected/8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d-kube-api-access-ssx4g\") pod \"perf-node-gather-daemonset-tnf7b\" (UID: \"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d\") " pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.562182 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.562143 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:03.694341 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:03.694315 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b"] Jul 21 17:15:03.697079 ip-10-0-130-54 kubenswrapper[2564]: W0721 17:15:03.697046 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8c38ecd1_e6d2_49a7_9ea3_ab3fac25682d.slice/crio-419eb1cc4cb8c76a580c697ed0c23cdb864ea86fe8d6545956c311ae1323b5bd WatchSource:0}: Error finding container 419eb1cc4cb8c76a580c697ed0c23cdb864ea86fe8d6545956c311ae1323b5bd: Status 404 returned error can't find the container with id 419eb1cc4cb8c76a580c697ed0c23cdb864ea86fe8d6545956c311ae1323b5bd Jul 21 17:15:04.380596 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:04.380561 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" event={"ID":"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d","Type":"ContainerStarted","Data":"4b6ca3ce15e07dac0ecbe0c44240970d204d18092e4ad6005e3fc94a1fe60d26"} Jul 21 17:15:04.381003 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:04.380619 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" event={"ID":"8c38ecd1-e6d2-49a7-9ea3-ab3fac25682d","Type":"ContainerStarted","Data":"419eb1cc4cb8c76a580c697ed0c23cdb864ea86fe8d6545956c311ae1323b5bd"} Jul 21 17:15:04.381003 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:04.380661 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:04.396990 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:04.396941 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" podStartSLOduration=1.396926147 podStartE2EDuration="1.396926147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-21 17:15:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-21 17:15:04.396195567 +0000 UTC m=+3059.464276247" watchObservedRunningTime="2026-07-21 17:15:04.396926147 +0000 UTC m=+3059.465006825" Jul 21 17:15:06.190449 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:06.190422 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-92b7c_cca2f967-6f78-43f0-899d-e26230c2ed65/dns/0.log" Jul 21 17:15:06.213655 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:06.213625 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-92b7c_cca2f967-6f78-43f0-899d-e26230c2ed65/kube-rbac-proxy/0.log" Jul 21 17:15:06.335249 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:06.335217 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-f6sqs_f52743c1-68c7-43af-84ef-20a962d73e7b/dns-node-resolver/0.log" Jul 21 17:15:06.954168 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:06.954136 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7d7c7547-d4s5c_815bc1ca-8539-42af-9e3f-c9211dff5f10/registry/0.log" Jul 21 17:15:06.976210 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:06.976181 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-95ppj_2e834d1b-3be2-4b3e-a43b-70b049ffba0a/node-ca/0.log" Jul 21 17:15:08.213227 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:08.213197 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ldznj_4e3d9a21-b743-4fab-bec4-d34a2b17bfc5/discovery/0.log" Jul 21 17:15:08.241101 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:08.241076 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54864c54db-5gb6x_b89a4f61-3341-489b-9f42-d19e1189f210/kube-auth-proxy/0.log" Jul 21 17:15:09.098308 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:09.098278 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4zxbn_ddae606c-873e-4b94-8a82-425df16e34f7/serve-healthcheck-canary/0.log" Jul 21 17:15:09.815832 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:09.815799 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kjpxj_bc9a2e27-85f0-4c37-ad6a-692cb316cae3/kube-rbac-proxy/0.log" Jul 21 17:15:09.836674 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:09.836652 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kjpxj_bc9a2e27-85f0-4c37-ad6a-692cb316cae3/exporter/0.log" Jul 21 17:15:09.858198 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:09.858167 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kjpxj_bc9a2e27-85f0-4c37-ad6a-692cb316cae3/extractor/0.log" Jul 21 17:15:10.394631 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:10.394604 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-79c4t/perf-node-gather-daemonset-tnf7b" Jul 21 17:15:12.158710 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:12.158684 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-cp5x4_f2a0d7fb-64a8-47a6-a4f8-e4d061b7a70d/manager/0.log" Jul 21 17:15:12.480262 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:12.480177 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-ts887_b96669e3-c154-42ef-aabd-4e69e52a21d5/manager/0.log" Jul 21 17:15:12.628326 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:12.628290 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-fk7xj_c5523cd2-a7a5-4a9b-95c5-55b503efd5de/server/0.log" Jul 21 17:15:12.740992 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:12.740912 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-mw4fj_836db5cd-88e8-42d9-97a9-75eaa8910d1c/manager/0.log" Jul 21 17:15:12.841906 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:12.841878 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk_9c4a3664-844a-46e5-8311-ed2c1760c5c6/manager/0.log" Jul 21 17:15:12.864195 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:12.864172 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d4b6f8cb5-r5mkk_9c4a3664-844a-46e5-8311-ed2c1760c5c6/copy-manifests/0.log" Jul 21 17:15:13.875380 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:13.875351 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ldznj_4e3d9a21-b743-4fab-bec4-d34a2b17bfc5/discovery/0.log" Jul 21 17:15:13.885207 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:13.885157 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54864c54db-5gb6x_b89a4f61-3341-489b-9f42-d19e1189f210/kube-auth-proxy/0.log" Jul 21 17:15:15.653489 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:15.653449 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-ldznj_4e3d9a21-b743-4fab-bec4-d34a2b17bfc5/discovery/0.log" Jul 21 17:15:15.666088 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:15.666056 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54864c54db-5gb6x_b89a4f61-3341-489b-9f42-d19e1189f210/kube-auth-proxy/0.log" Jul 21 17:15:19.322771 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:19.322727 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-xzkwv_b3ee627e-1366-4c27-a01b-97b31572c9c0/migrator/0.log" Jul 21 17:15:19.343685 ip-10-0-130-54 kubenswrapper[2564]: I0721 17:15:19.343650 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-xzkwv_b3ee627e-1366-4c27-a01b-97b31572c9c0/graceful-termination/0.log"