Jul 09 14:31:58.154980 ip-10-0-140-220 systemd[1]: Starting Kubernetes Kubelet... Jul 09 14:31:58.470141 ip-10-0-140-220 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:31:58.470141 ip-10-0-140-220 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 14:31:58.470141 ip-10-0-140-220 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:31:58.470141 ip-10-0-140-220 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 14:31:58.470141 ip-10-0-140-220 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:31:58.470831 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.470207 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 14:31:58.473989 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.473974 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:58.473989 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.473989 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.473993 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.473996 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.473999 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474002 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474005 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474010 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474014 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474017 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474020 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474023 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474026 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474028 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474031 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474039 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474042 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474044 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474047 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474049 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:58.474053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474052 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474054 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474057 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474059 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474062 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474065 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474068 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474070 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474072 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474075 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474077 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474079 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474082 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474085 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474087 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474089 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474092 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474095 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474097 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:58.474527 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474099 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474103 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474105 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474108 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474110 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474112 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474115 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474117 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474120 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474122 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474124 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474127 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474129 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474131 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474134 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474137 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474140 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474143 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474145 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:58.475097 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474148 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474150 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474153 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474155 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474158 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474160 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474163 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474165 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474168 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474170 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474172 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474175 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474179 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474183 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474186 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474188 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474191 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474193 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474197 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474200 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:58.475579 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474202 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474205 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474207 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474211 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474214 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474216 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474219 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474222 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474224 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474227 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474229 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474232 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474234 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474236 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474239 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474242 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474244 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474246 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474249 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474251 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:58.476081 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.474254 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476251 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476258 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476261 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476265 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476268 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476271 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476274 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476276 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476279 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476281 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476284 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476287 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476289 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476292 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476294 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476297 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476300 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476302 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476305 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:58.476588 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476307 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476309 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476312 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476314 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476316 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476319 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476321 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476324 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476326 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476328 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476330 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476333 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476335 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476337 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476341 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476345 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476347 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476349 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476352 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476355 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:58.477095 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476357 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476360 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476362 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476365 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476367 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476369 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476372 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476374 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476377 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476379 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476382 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476384 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476387 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476389 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476392 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476395 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476399 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476402 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476405 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:58.477612 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476407 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476410 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476412 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476414 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476417 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476419 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476422 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476427 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476430 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476433 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476436 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476439 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476442 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476445 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476447 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476450 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476452 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476455 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476457 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:58.478087 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476459 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476461 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476464 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476466 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476469 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476471 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476474 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476476 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476479 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476482 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476486 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476489 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476492 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476494 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476497 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476500 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476503 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476505 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476508 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:58.478542 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476511 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476514 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476517 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476894 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476900 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476905 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476909 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476912 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476915 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476919 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476921 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476924 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476927 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476929 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476933 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476936 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476939 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476942 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:58.479019 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476944 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476947 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476950 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476953 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476955 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476965 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476970 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476974 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476977 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476979 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476982 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476984 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476987 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476990 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476992 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476995 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.476997 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477000 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477002 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477005 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:58.479453 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477008 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477010 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477013 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477016 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477018 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477021 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477023 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477026 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477029 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477031 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477034 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477037 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477039 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477042 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477044 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477046 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477049 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477051 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477053 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477056 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:58.479954 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477059 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477061 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477063 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477066 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477068 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477072 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477075 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477077 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477080 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477082 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477084 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477087 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477089 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477091 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477094 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477097 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477100 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477103 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477105 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477108 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:58.480433 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477110 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477112 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477115 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477117 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477120 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477122 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477124 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477127 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477129 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477132 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477134 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477136 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477139 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477141 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477143 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477146 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477148 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477152 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477155 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477157 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:58.480909 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477159 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477162 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477164 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477166 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477230 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477237 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477243 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477247 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477251 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477254 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477258 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477262 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477265 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477268 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477271 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477274 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477277 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477280 2570 flags.go:64] FLAG: --cgroup-root="" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477283 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477286 2570 flags.go:64] FLAG: --client-ca-file="" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477289 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477292 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477295 2570 flags.go:64] FLAG: --cluster-domain="" Jul 09 14:31:58.481386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477298 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477301 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477304 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477307 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477310 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477313 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477317 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477321 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477324 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477327 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477329 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477332 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477335 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477339 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477342 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477344 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477347 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477350 2570 flags.go:64] FLAG: --enable-server="true" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477353 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477358 2570 flags.go:64] FLAG: --event-burst="100" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477361 2570 flags.go:64] FLAG: --event-qps="50" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477364 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477366 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477369 2570 flags.go:64] FLAG: --eviction-hard="" Jul 09 14:31:58.481943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477373 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477375 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477378 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477381 2570 flags.go:64] FLAG: --eviction-soft="" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477384 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477386 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477389 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477392 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477394 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477397 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477400 2570 flags.go:64] FLAG: --feature-gates="" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477403 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477406 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477409 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477414 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477417 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477420 2570 flags.go:64] FLAG: --help="false" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477422 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477426 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477429 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477432 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477435 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477438 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477441 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 14:31:58.482513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477444 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477446 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477449 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477452 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477455 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477458 2570 flags.go:64] FLAG: --kube-reserved="" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477460 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477463 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477466 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477469 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477471 2570 flags.go:64] FLAG: --lock-file="" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477474 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477477 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477480 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477485 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477488 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477490 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477493 2570 flags.go:64] FLAG: --logging-format="text" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477495 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477498 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477501 2570 flags.go:64] FLAG: --manifest-url="" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477504 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477509 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477512 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477516 2570 flags.go:64] FLAG: --max-pods="110" Jul 09 14:31:58.483152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477519 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477522 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477524 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477527 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477530 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477533 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477535 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477542 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477544 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477547 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477550 2570 flags.go:64] FLAG: --pod-cidr="" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477553 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477558 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477561 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477564 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477567 2570 flags.go:64] FLAG: --port="10250" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477573 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477576 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-049b8c9a4e0b69119" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477579 2570 flags.go:64] FLAG: --qos-reserved="" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477582 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477584 2570 flags.go:64] FLAG: --register-node="true" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477587 2570 flags.go:64] FLAG: --register-with-taints="" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477591 2570 flags.go:64] FLAG: --registry-burst="10" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477593 2570 flags.go:64] FLAG: --registry-qps="5" Jul 09 14:31:58.483781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477596 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477598 2570 flags.go:64] FLAG: --reserved-memory="" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477602 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477604 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477607 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477611 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477614 2570 flags.go:64] FLAG: --runonce="false" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477617 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477620 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477623 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477626 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477629 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477632 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477635 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477638 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477640 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477643 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477646 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477649 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477651 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477655 2570 flags.go:64] FLAG: --system-cgroups="" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477658 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477663 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477665 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477669 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 14:31:58.484362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477673 2570 flags.go:64] FLAG: --tls-min-version="" Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477690 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477693 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477695 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477698 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477701 2570 flags.go:64] FLAG: --v="2" Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477705 2570 flags.go:64] FLAG: --version="false" Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477709 2570 flags.go:64] FLAG: --vmodule="" Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477712 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.477715 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477824 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477828 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477832 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477835 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477838 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477840 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477843 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477845 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477848 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477850 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477852 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477855 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:58.484982 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477857 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477860 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477862 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477865 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477867 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477870 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477873 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477875 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477877 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477881 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477884 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477886 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477889 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477892 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477894 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477896 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477899 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477901 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477904 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477907 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:58.485516 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477909 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477912 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477916 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477918 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477922 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477926 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477928 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477931 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477933 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477936 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477938 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477940 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477943 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477946 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477948 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477951 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477954 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477956 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477958 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:58.486041 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477961 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477963 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477967 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477970 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477972 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477975 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477977 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477980 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477982 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477984 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477987 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477989 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477992 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477994 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.477997 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478001 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478003 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478006 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478008 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478011 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:58.486538 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478013 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478015 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478019 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478023 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478026 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478029 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478032 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478035 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478037 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478040 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478042 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478045 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478048 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478051 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478054 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478057 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478059 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478062 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478064 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:58.487022 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478066 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478070 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478074 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478076 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478079 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478082 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478084 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478087 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.478091 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.478631 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.485219 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.485232 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.485247 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.485253 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 14:31:58.487472 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485307 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485312 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485316 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485319 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485322 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485325 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485328 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485331 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485333 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485336 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485338 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485341 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485343 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485346 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485348 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485351 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485354 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485356 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485359 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485361 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:58.487835 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485364 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485366 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485369 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485371 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485373 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485376 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485378 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485381 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485384 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485387 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485390 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485393 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485395 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485398 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485400 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485403 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485405 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485408 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485410 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485413 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:58.488312 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485416 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485420 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485423 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485425 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485428 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485430 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485433 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485435 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485438 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485440 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485443 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485445 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485448 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485450 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485453 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485456 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485458 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485460 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485463 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485465 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:58.488807 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485468 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485471 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485475 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485479 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485483 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485486 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485489 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485492 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485495 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485498 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485501 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485503 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485506 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485508 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485511 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485513 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485516 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485519 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:58.489300 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485521 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485524 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485527 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485529 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485532 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485535 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485537 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485539 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485542 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485545 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485547 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485549 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485552 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485555 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485558 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485560 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485563 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485566 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485568 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485571 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:58.489785 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485573 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.485578 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485705 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485710 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485713 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485716 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485718 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485721 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485724 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485726 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485729 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485731 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485733 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485736 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:31:58.490259 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485738 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485740 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485744 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485748 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485751 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485753 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485756 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485758 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485760 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485763 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485765 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485768 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485770 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485772 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485775 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485777 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485780 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485782 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485785 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:31:58.490646 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485787 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485790 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485792 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485794 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485797 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485799 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485801 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485804 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485806 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485808 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485811 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485813 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485817 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485820 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485822 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485825 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485828 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485830 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485833 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485835 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:31:58.491123 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485838 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485840 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485842 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485845 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485847 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485849 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485852 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485854 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485857 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485859 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485862 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485864 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485868 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485871 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485874 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485876 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485879 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485882 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485884 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485887 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:31:58.491599 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485889 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485892 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485895 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485897 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485899 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485902 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485905 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485907 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485910 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485912 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485915 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485917 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485920 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485922 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485925 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485927 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485929 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485932 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485934 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485936 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:31:58.492090 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485939 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485941 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485943 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485946 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485948 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485951 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485953 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:31:58.485955 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.485961 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.486049 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.488109 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.489279 2570 server.go:1019] "Starting client certificate rotation" Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.489384 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:31:58.492610 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.490006 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:31:58.492966 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.491315 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:31:58.492966 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.492473 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:31:58.500814 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.500795 2570 log.go:25] "Validated CRI v1 runtime API" Jul 09 14:31:58.504775 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.504754 2570 log.go:25] "Validated CRI v1 image API" Jul 09 14:31:58.506291 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.506262 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 14:31:58.508348 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.508317 2570 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 96b920af-ce4f-49e3-8f90-9cf66b42a2ae:/dev/nvme0n1p4 f5db0063-25bd-4b20-91eb-ca88462a1c71:/dev/nvme0n1p3] Jul 09 14:31:58.508438 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.508347 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 14:31:58.513938 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.513827 2570 manager.go:216] Machine: {Timestamp:2026-07-09 14:31:58.512691341 +0000 UTC m=+0.262458649 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3121719 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e1b897279063c75f5ac068f9f5818 SystemUUID:ec2e1b89-7279-063c-75f5-ac068f9f5818 BootID:963d1046-ef92-424f-9893-87e9e0e90c02 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:fb:94:73:5b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:fb:94:73:5b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:0c:c5:8b:f6:5a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 14:31:58.513938 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.513929 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 14:31:58.514083 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.514019 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 14:31:58.516519 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.516492 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 14:31:58.516649 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.516523 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-220.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 14:31:58.517126 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.517116 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 14:31:58.517157 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.517130 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 14:31:58.517157 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.517137 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:31:58.517157 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.517152 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:31:58.518046 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.518037 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 14:31:58.521712 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.521691 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:31:58.521999 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.521989 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 14:31:58.522561 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.522550 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 09 14:31:58.522593 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.522571 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 14:31:58.522593 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.522586 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 14:31:58.522646 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.522597 2570 kubelet.go:398] "Adding apiserver pod source" Jul 09 14:31:58.522646 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.522609 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 14:31:58.522955 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.522945 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:31:58.523006 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.522962 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:31:58.524640 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.524614 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 14:31:58.525819 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.525804 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:31:58.526026 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526013 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 14:31:58.526069 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526044 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 14:31:58.526712 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526691 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 14:31:58.526712 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526713 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 14:31:58.526818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526721 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 14:31:58.526818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526730 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 14:31:58.526818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526739 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 14:31:58.526818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526746 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 14:31:58.526818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526754 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 14:31:58.526818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526759 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 14:31:58.526818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526765 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 14:31:58.526818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526770 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 14:31:58.526818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526779 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 14:31:58.526818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.526784 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 14:31:58.527382 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.527372 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 14:31:58.527382 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.527381 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 14:31:58.530755 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.530739 2570 server.go:1268] "Started kubelet" Jul 09 14:31:58.530913 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.530861 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 14:31:58.530973 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.530935 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 14:31:58.531663 ip-10-0-140-220 systemd[1]: Started Kubernetes Kubelet. Jul 09 14:31:58.533909 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.531498 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 14:31:58.534029 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.534007 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 14:31:58.534734 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.534702 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-220.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 14:31:58.534932 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.534877 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 14:31:58.535134 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.535059 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 14:31:58.536987 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.536623 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 14:31:58.537307 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.537292 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 09 14:31:58.539595 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.538773 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-220.ec2.internal.18c0a59690bd285c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-220.ec2.internal,UID:ip-10-0-140-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-220.ec2.internal,},FirstTimestamp:2026-07-09 14:31:58.530709596 +0000 UTC m=+0.280476906,LastTimestamp:2026-07-09 14:31:58.530709596 +0000 UTC m=+0.280476906,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-220.ec2.internal,}" Jul 09 14:31:58.539803 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.539788 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 14:31:58.540251 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.539899 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:31:58.540251 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.539794 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 14:31:58.540387 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540351 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 14:31:58.540447 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540436 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 14:31:58.540486 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540454 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 14:31:58.540604 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540588 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 09 14:31:58.540604 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540605 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 09 14:31:58.540719 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540619 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 14:31:58.540719 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540632 2570 factory.go:55] Registering systemd factory Jul 09 14:31:58.540719 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540643 2570 factory.go:223] Registration of the systemd container factory successfully Jul 09 14:31:58.540889 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540872 2570 factory.go:153] Registering CRI-O factory Jul 09 14:31:58.540889 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540889 2570 factory.go:223] Registration of the crio container factory successfully Jul 09 14:31:58.541054 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540912 2570 factory.go:103] Registering Raw factory Jul 09 14:31:58.541054 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.540926 2570 manager.go:1196] Started watching for new ooms in manager Jul 09 14:31:58.541298 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.541276 2570 manager.go:349] Starting recovery of all containers Jul 09 14:31:58.542836 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.542810 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-220.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 14:31:58.543090 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.543070 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 14:31:58.551398 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.551257 2570 manager.go:354] Recovery completed Jul 09 14:31:58.553468 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.553336 2570 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 09 14:31:58.556142 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.556128 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:58.557939 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.557915 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:58.558004 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.557958 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:58.558004 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.557973 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:58.558493 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.558480 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 14:31:58.558493 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.558491 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 14:31:58.558562 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.558497 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:58.558562 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.558506 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:31:58.559193 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.559176 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:58.559249 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.559204 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:58.559249 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.559215 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:58.560635 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.560624 2570 policy_none.go:49] "None policy: Start" Jul 09 14:31:58.560673 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.560639 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 14:31:58.560673 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.560650 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 14:31:58.561449 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.561388 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-220.ec2.internal.18c0a596925cacd1 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-220.ec2.internal,UID:ip-10-0-140-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-220.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-220.ec2.internal,},FirstTimestamp:2026-07-09 14:31:58.557940945 +0000 UTC m=+0.307708261,LastTimestamp:2026-07-09 14:31:58.557940945 +0000 UTC m=+0.307708261,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-220.ec2.internal,}" Jul 09 14:31:58.562719 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.562670 2570 policy_none.go:47] "Start" Jul 09 14:31:58.563339 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.563319 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmwxq" Jul 09 14:31:58.572906 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.572846 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-220.ec2.internal.18c0a596925d0dcf default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-220.ec2.internal,UID:ip-10-0-140-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-220.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-220.ec2.internal,},FirstTimestamp:2026-07-09 14:31:58.557965775 +0000 UTC m=+0.307733084,LastTimestamp:2026-07-09 14:31:58.557965775 +0000 UTC m=+0.307733084,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-220.ec2.internal,}" Jul 09 14:31:58.580526 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.580504 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nmwxq" Jul 09 14:31:58.584713 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.584619 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-220.ec2.internal.18c0a596925d410e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-220.ec2.internal,UID:ip-10-0-140-220.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-220.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-220.ec2.internal,},FirstTimestamp:2026-07-09 14:31:58.557978894 +0000 UTC m=+0.307746207,LastTimestamp:2026-07-09 14:31:58.557978894 +0000 UTC m=+0.307746207,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-220.ec2.internal,}" Jul 09 14:31:58.600911 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.600900 2570 manager.go:337] "Starting Device Plugin manager" Jul 09 14:31:58.600966 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.600930 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 14:31:58.600966 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.600952 2570 server.go:87] "Starting device plugin registration server" Jul 09 14:31:58.601200 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.601185 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 14:31:58.601266 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.601203 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 14:31:58.601316 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.601284 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 14:31:58.601390 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.601372 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 14:31:58.601390 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.601388 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 14:31:58.601875 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.601857 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 14:31:58.601946 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.601897 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:31:58.683977 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.683942 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 14:31:58.690652 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.685265 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 14:31:58.690652 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.685297 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 14:31:58.690652 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.685318 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 14:31:58.690652 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.685347 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 14:31:58.690652 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.689532 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:31:58.701715 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.701696 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:58.702772 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.702754 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:58.702862 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.702791 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:58.702862 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.702805 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:58.702862 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.702834 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.711608 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.711587 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.711608 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.711609 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-220.ec2.internal\": node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:31:58.730337 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.730280 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:31:58.786342 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.786305 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal"] Jul 09 14:31:58.786450 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.786381 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:58.787231 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.787217 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:58.787312 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.787246 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:58.787312 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.787256 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:58.789575 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.789563 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:58.789752 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.789720 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.789795 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.789769 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:58.790205 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.790188 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:58.790264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.790219 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:58.790264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.790193 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:58.790264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.790229 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:58.790264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.790242 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:58.790264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.790252 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:58.792499 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.792479 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.792590 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.792506 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:31:58.793878 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.793861 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:31:58.793961 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.793895 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:31:58.793961 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.793909 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:31:58.805359 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.805337 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-220.ec2.internal\" not found" node="ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.809858 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.809844 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-220.ec2.internal\" not found" node="ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.830925 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.830910 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:31:58.842508 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.842485 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7508382f360a344c98db04a3d5c13216-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"7508382f360a344c98db04a3d5c13216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.842593 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.842510 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7508382f360a344c98db04a3d5c13216-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"7508382f360a344c98db04a3d5c13216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.842593 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.842526 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0465a62b10ff46565ba4cbcd0da6470-config\") pod \"kube-apiserver-proxy-ip-10-0-140-220.ec2.internal\" (UID: \"a0465a62b10ff46565ba4cbcd0da6470\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.931396 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:58.931369 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:31:58.942984 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.942966 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0465a62b10ff46565ba4cbcd0da6470-config\") pod \"kube-apiserver-proxy-ip-10-0-140-220.ec2.internal\" (UID: \"a0465a62b10ff46565ba4cbcd0da6470\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.943048 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.942989 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7508382f360a344c98db04a3d5c13216-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"7508382f360a344c98db04a3d5c13216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.943048 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.943004 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7508382f360a344c98db04a3d5c13216-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"7508382f360a344c98db04a3d5c13216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.943048 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.943041 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7508382f360a344c98db04a3d5c13216-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"7508382f360a344c98db04a3d5c13216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.943166 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.943061 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a0465a62b10ff46565ba4cbcd0da6470-config\") pod \"kube-apiserver-proxy-ip-10-0-140-220.ec2.internal\" (UID: \"a0465a62b10ff46565ba4cbcd0da6470\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 09 14:31:58.943166 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:58.943091 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7508382f360a344c98db04a3d5c13216-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal\" (UID: \"7508382f360a344c98db04a3d5c13216\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 09 14:31:59.032271 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:59.032188 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:31:59.107711 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:59.107667 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 09 14:31:59.112746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:31:59.112717 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 09 14:31:59.132460 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:59.132436 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:31:59.232988 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:59.232947 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:31:59.333473 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:31:59.333406 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:32:00.981643 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:00.981619 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:32:01.037098 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.037070 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 14:32:01.037702 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.037238 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 14:32:01.082457 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:01.082431 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-220.ec2.internal\" not found" Jul 09 14:32:01.093832 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.093813 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:32:01.133352 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.133280 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 14:27:00 +0000 UTC" deadline="2028-02-09 01:58:10.670409077 +0000 UTC" Jul 09 14:32:01.133352 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.133323 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13907h26m9.537089601s" Jul 09 14:32:01.188587 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.188565 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" Jul 09 14:32:01.201374 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.201359 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:32:01.202760 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.202744 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" Jul 09 14:32:01.214321 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.214299 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:32:01.244781 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:01.244750 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0465a62b10ff46565ba4cbcd0da6470.slice/crio-ce0c14acc49473336af94d484aca945846583720e637d20489789c45048495a0 WatchSource:0}: Error finding container ce0c14acc49473336af94d484aca945846583720e637d20489789c45048495a0: Status 404 returned error can't find the container with id ce0c14acc49473336af94d484aca945846583720e637d20489789c45048495a0 Jul 09 14:32:01.249171 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.249156 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:32:01.357114 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.357086 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:32:01.653996 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.653974 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:32:01.680094 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:01.680070 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7508382f360a344c98db04a3d5c13216.slice/crio-20da7eaf1776b853b0ca30a019f7695bbed76ed400afdcdae1a89eab1a70eb10 WatchSource:0}: Error finding container 20da7eaf1776b853b0ca30a019f7695bbed76ed400afdcdae1a89eab1a70eb10: Status 404 returned error can't find the container with id 20da7eaf1776b853b0ca30a019f7695bbed76ed400afdcdae1a89eab1a70eb10 Jul 09 14:32:01.892907 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:01.892876 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:32:02.071488 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.071462 2570 apiserver.go:52] "Watching apiserver" Jul 09 14:32:02.081062 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.081039 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 14:32:02.082692 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.082672 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw","openshift-dns/node-resolver-nfh5q","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal","openshift-multus/network-metrics-daemon-cxzs4","openshift-network-operator/iptables-alerter-fjj2z","openshift-cluster-node-tuning-operator/tuned-t2zwt","openshift-image-registry/node-ca-vlkd9","openshift-multus/multus-9mn4p","openshift-multus/multus-additional-cni-plugins-ttbl4","openshift-network-diagnostics/network-check-target-9l8rh","openshift-ovn-kubernetes/ovnkube-node-vn2j9","kube-system/global-pull-secret-syncer-84t2b","kube-system/konnectivity-agent-5mdwl"] Jul 09 14:32:02.085139 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.085117 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.087229 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.087206 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:02.087327 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.087291 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:02.089338 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.089321 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 14:32:02.089609 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.089591 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nfh5q" Jul 09 14:32:02.091989 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.091970 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:02.094192 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.094172 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:02.094290 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.094239 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:02.096503 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096373 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-cnibin\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.096503 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096408 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e112330b-09d8-499a-9be7-21e0f525098c-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.096503 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096436 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fjj2z" Jul 09 14:32:02.096766 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096435 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eecab63-82b5-4f23-a147-b1113057ad00-tmp-dir\") pod \"node-resolver-nfh5q\" (UID: \"3eecab63-82b5-4f23-a147-b1113057ad00\") " pod="openshift-dns/node-resolver-nfh5q" Jul 09 14:32:02.096766 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096574 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-system-cni-dir\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.096766 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096601 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.096766 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096628 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crrgs\" (UniqueName: \"kubernetes.io/projected/e112330b-09d8-499a-9be7-21e0f525098c-kube-api-access-crrgs\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.096766 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096653 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-dbus\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:02.096766 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096678 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-os-release\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.096766 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096700 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-kubelet-config\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:02.096766 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096718 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:02.096766 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096769 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e112330b-09d8-499a-9be7-21e0f525098c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.097141 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096789 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e112330b-09d8-499a-9be7-21e0f525098c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.097141 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096813 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3eecab63-82b5-4f23-a147-b1113057ad00-hosts-file\") pod \"node-resolver-nfh5q\" (UID: \"3eecab63-82b5-4f23-a147-b1113057ad00\") " pod="openshift-dns/node-resolver-nfh5q" Jul 09 14:32:02.097141 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.096834 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tq9n\" (UniqueName: \"kubernetes.io/projected/3eecab63-82b5-4f23-a147-b1113057ad00-kube-api-access-5tq9n\") pod \"node-resolver-nfh5q\" (UID: \"3eecab63-82b5-4f23-a147-b1113057ad00\") " pod="openshift-dns/node-resolver-nfh5q" Jul 09 14:32:02.098714 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.098693 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.101028 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.101010 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.101952 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.101929 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 14:32:02.102060 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.101979 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 14:32:02.102060 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.101990 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-t42p7\"" Jul 09 14:32:02.102254 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.102085 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 14:32:02.102254 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.102207 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kx2hk\"" Jul 09 14:32:02.102427 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.102411 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 14:32:02.102504 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.102416 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-nr2dv\"" Jul 09 14:32:02.103044 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.103017 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-6tzjv\"" Jul 09 14:32:02.103122 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.103049 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 14:32:02.103203 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.103188 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:32:02.103320 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.103294 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 14:32:02.103384 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.103358 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5jkqd\"" Jul 09 14:32:02.103437 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.103395 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 14:32:02.103485 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.103397 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 14:32:02.103485 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.103362 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 14:32:02.103670 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.103657 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.103839 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.103820 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 14:32:02.106111 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.106085 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vlkd9" Jul 09 14:32:02.108245 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.108220 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:02.108339 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.108279 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:02.115136 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.113143 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.115136 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.113991 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 14:32:02.115136 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.114063 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-b6cn5\"" Jul 09 14:32:02.115136 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.114906 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 14:32:02.117187 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.117170 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 14:32:02.117328 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.117212 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 14:32:02.118747 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.118729 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8s8q8\"" Jul 09 14:32:02.118850 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.118771 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 14:32:02.119794 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.119778 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 14:32:02.120109 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.120095 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 14:32:02.120721 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.120704 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 14:32:02.121178 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.121096 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-mrg22\"" Jul 09 14:32:02.121404 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.121384 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 14:32:02.137389 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.136677 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 14:32:02.137389 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.136737 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 14:32:02.137389 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.136770 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:32:02.137389 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.136963 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 14:32:02.137389 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.136970 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 14:32:02.137389 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.137070 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-4bjpr\"" Jul 09 14:32:02.137389 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.137166 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 14:32:02.137389 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.137256 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 14:32:02.150676 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.150649 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:32:02.189855 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.189839 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 14:32:02.197201 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197182 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tq9n\" (UniqueName: \"kubernetes.io/projected/3eecab63-82b5-4f23-a147-b1113057ad00-kube-api-access-5tq9n\") pod \"node-resolver-nfh5q\" (UID: \"3eecab63-82b5-4f23-a147-b1113057ad00\") " pod="openshift-dns/node-resolver-nfh5q" Jul 09 14:32:02.197309 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197220 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-cnibin\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.197309 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197246 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-socket-dir-parent\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.197309 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197283 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-hostroot\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.197309 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197304 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-systemd\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.197508 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197333 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eecab63-82b5-4f23-a147-b1113057ad00-tmp-dir\") pod \"node-resolver-nfh5q\" (UID: \"3eecab63-82b5-4f23-a147-b1113057ad00\") " pod="openshift-dns/node-resolver-nfh5q" Jul 09 14:32:02.197508 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197358 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-run-ovn\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.197508 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197380 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-kubernetes\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.197508 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197406 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.197508 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197428 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-etc-openvswitch\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.197508 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197453 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-sysconfig\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.197508 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197487 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-sysctl-d\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197532 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-etc-kubernetes\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197561 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-os-release\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197584 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-kubelet-config\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197604 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-device-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197628 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-systemd-units\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197652 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-node-log\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197668 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-var-lib-cni-multus\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197694 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-socket-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197716 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-registration-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197730 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-var-lib-kubelet\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197745 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gml6\" (UniqueName: \"kubernetes.io/projected/344ad782-e324-42c3-b50a-04006e1d1c62-kube-api-access-2gml6\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197762 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3eecab63-82b5-4f23-a147-b1113057ad00-tmp-dir\") pod \"node-resolver-nfh5q\" (UID: \"3eecab63-82b5-4f23-a147-b1113057ad00\") " pod="openshift-dns/node-resolver-nfh5q" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197765 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-os-release\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.197853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197847 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-os-release\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197884 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d89b2149-fbf7-4b86-b91b-c11c19e2c862-iptables-alerter-script\") pod \"iptables-alerter-fjj2z\" (UID: \"d89b2149-fbf7-4b86-b91b-c11c19e2c862\") " pod="openshift-network-operator/iptables-alerter-fjj2z" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197909 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-system-cni-dir\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197933 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crrgs\" (UniqueName: \"kubernetes.io/projected/e112330b-09d8-499a-9be7-21e0f525098c-kube-api-access-crrgs\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197957 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5xkt\" (UniqueName: \"kubernetes.io/projected/ec8f4eb3-372d-4095-98fc-1fe2c8483150-kube-api-access-g5xkt\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197972 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-var-lib-cni-bin\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.197987 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-etc-selinux\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198002 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/344ad782-e324-42c3-b50a-04006e1d1c62-tmp\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198001 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198044 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-var-lib-openvswitch\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198071 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lvdg\" (UniqueName: \"kubernetes.io/projected/0e2ccbba-82ab-40ec-ab03-121c974af538-kube-api-access-2lvdg\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198070 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-kubelet-config\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198097 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-var-lib-kubelet\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198137 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-run-multus-certs\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198146 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-system-cni-dir\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198157 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3eecab63-82b5-4f23-a147-b1113057ad00-hosts-file\") pod \"node-resolver-nfh5q\" (UID: \"3eecab63-82b5-4f23-a147-b1113057ad00\") " pod="openshift-dns/node-resolver-nfh5q" Jul 09 14:32:02.198479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198400 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-run-netns\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198428 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ab965c9-a202-40cb-88a0-882ef334ed2e-agent-certs\") pod \"konnectivity-agent-5mdwl\" (UID: \"7ab965c9-a202-40cb-88a0-882ef334ed2e\") " pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198455 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-run-openvswitch\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198480 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-run-ovn-kubernetes\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198508 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198585 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-system-cni-dir\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198615 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4g8q\" (UniqueName: \"kubernetes.io/projected/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-kube-api-access-t4g8q\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198677 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3eecab63-82b5-4f23-a147-b1113057ad00-hosts-file\") pod \"node-resolver-nfh5q\" (UID: \"3eecab63-82b5-4f23-a147-b1113057ad00\") " pod="openshift-dns/node-resolver-nfh5q" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198678 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ab965c9-a202-40cb-88a0-882ef334ed2e-konnectivity-ca\") pod \"konnectivity-agent-5mdwl\" (UID: \"7ab965c9-a202-40cb-88a0-882ef334ed2e\") " pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198711 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-run\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198742 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a346c634-df16-4e2d-af0b-7408c90d6735-host\") pod \"node-ca-vlkd9\" (UID: \"a346c634-df16-4e2d-af0b-7408c90d6735\") " pod="openshift-image-registry/node-ca-vlkd9" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198786 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-run-netns\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198828 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-run-systemd\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198857 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e2ccbba-82ab-40ec-ab03-121c974af538-ovn-node-metrics-cert\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198893 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-run-k8s-cni-cncf-io\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198917 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwcrh\" (UniqueName: \"kubernetes.io/projected/d89b2149-fbf7-4b86-b91b-c11c19e2c862-kube-api-access-wwcrh\") pod \"iptables-alerter-fjj2z\" (UID: \"d89b2149-fbf7-4b86-b91b-c11c19e2c862\") " pod="openshift-network-operator/iptables-alerter-fjj2z" Jul 09 14:32:02.199181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.198984 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-cni-binary-copy\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199003 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199038 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-slash\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199103 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-cni-netd\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.199134 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199146 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.199198 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret podName:cbd60921-6ec5-48e9-9b52-cdcf119ce07e nodeName:}" failed. No retries permitted until 2026-07-09 14:32:02.699177417 +0000 UTC m=+2.901104563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret") pod "global-pull-secret-syncer-84t2b" (UID: "cbd60921-6ec5-48e9-9b52-cdcf119ce07e") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199210 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e2ccbba-82ab-40ec-ab03-121c974af538-ovnkube-config\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199227 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2fltf\" (UniqueName: \"kubernetes.io/projected/778767ba-64a7-4cf2-8136-a369e1f6dcb3-kube-api-access-2fltf\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199244 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e112330b-09d8-499a-9be7-21e0f525098c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199267 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-daemon-config\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199281 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-sys-fs\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199296 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-cnibin\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199311 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e112330b-09d8-499a-9be7-21e0f525098c-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199327 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-log-socket\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199374 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e112330b-09d8-499a-9be7-21e0f525098c-cnibin\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.199992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199798 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-conf-dir\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199830 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-modprobe-d\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199854 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-sys\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199877 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a346c634-df16-4e2d-af0b-7408c90d6735-serviceca\") pod \"node-ca-vlkd9\" (UID: \"a346c634-df16-4e2d-af0b-7408c90d6735\") " pod="openshift-image-registry/node-ca-vlkd9" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199902 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-dbus\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199904 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e112330b-09d8-499a-9be7-21e0f525098c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199925 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flwxq\" (UniqueName: \"kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq\") pod \"network-check-target-9l8rh\" (UID: \"2a37909b-4421-4481-853d-7e88f330aa94\") " pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199909 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e112330b-09d8-499a-9be7-21e0f525098c-cni-binary-copy\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-kubelet\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.199972 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e2ccbba-82ab-40ec-ab03-121c974af538-ovnkube-script-lib\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200021 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d89b2149-fbf7-4b86-b91b-c11c19e2c862-host-slash\") pod \"iptables-alerter-fjj2z\" (UID: \"d89b2149-fbf7-4b86-b91b-c11c19e2c862\") " pod="openshift-network-operator/iptables-alerter-fjj2z" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200017 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-dbus\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200055 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/344ad782-e324-42c3-b50a-04006e1d1c62-etc-tuned\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200073 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njhfn\" (UniqueName: \"kubernetes.io/projected/a346c634-df16-4e2d-af0b-7408c90d6735-kube-api-access-njhfn\") pod \"node-ca-vlkd9\" (UID: \"a346c634-df16-4e2d-af0b-7408c90d6735\") " pod="openshift-image-registry/node-ca-vlkd9" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200087 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-cni-bin\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e2ccbba-82ab-40ec-ab03-121c974af538-env-overrides\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200128 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-cni-dir\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.200440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200143 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-sysctl-conf\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.200957 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200156 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-lib-modules\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.200957 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200174 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-host\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.200957 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200191 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e112330b-09d8-499a-9be7-21e0f525098c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.200957 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.200578 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e112330b-09d8-499a-9be7-21e0f525098c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.219347 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.219313 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 14:32:02.223084 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.223067 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crrgs\" (UniqueName: \"kubernetes.io/projected/e112330b-09d8-499a-9be7-21e0f525098c-kube-api-access-crrgs\") pod \"multus-additional-cni-plugins-ttbl4\" (UID: \"e112330b-09d8-499a-9be7-21e0f525098c\") " pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.223813 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.223789 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tq9n\" (UniqueName: \"kubernetes.io/projected/3eecab63-82b5-4f23-a147-b1113057ad00-kube-api-access-5tq9n\") pod \"node-resolver-nfh5q\" (UID: \"3eecab63-82b5-4f23-a147-b1113057ad00\") " pod="openshift-dns/node-resolver-nfh5q" Jul 09 14:32:02.238040 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.237998 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" event={"ID":"7508382f360a344c98db04a3d5c13216","Type":"ContainerStarted","Data":"20da7eaf1776b853b0ca30a019f7695bbed76ed400afdcdae1a89eab1a70eb10"} Jul 09 14:32:02.239044 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.239024 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" event={"ID":"a0465a62b10ff46565ba4cbcd0da6470","Type":"ContainerStarted","Data":"ce0c14acc49473336af94d484aca945846583720e637d20489789c45048495a0"} Jul 09 14:32:02.239225 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.239210 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-54rd7" Jul 09 14:32:02.249235 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.249216 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-54rd7" Jul 09 14:32:02.301291 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-systemd\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.301417 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301299 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-run-ovn\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.301417 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301320 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-kubernetes\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.301417 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301340 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-etc-openvswitch\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.301417 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301363 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-sysconfig\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.301417 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301386 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-sysctl-d\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.301417 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301408 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-systemd\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301420 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-etc-kubernetes\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301433 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-kubernetes\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301454 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-device-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301465 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-sysconfig\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301480 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-systemd-units\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301488 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-etc-openvswitch\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301410 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-run-ovn\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301504 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-node-log\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301509 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-etc-kubernetes\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301552 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-var-lib-cni-multus\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301556 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-node-log\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301577 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-sysctl-d\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301581 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-device-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301588 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-socket-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301595 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-var-lib-cni-multus\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301608 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-systemd-units\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301620 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-registration-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.301746 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301645 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-var-lib-kubelet\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301668 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gml6\" (UniqueName: \"kubernetes.io/projected/344ad782-e324-42c3-b50a-04006e1d1c62-kube-api-access-2gml6\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301693 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-os-release\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301692 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-socket-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301739 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d89b2149-fbf7-4b86-b91b-c11c19e2c862-iptables-alerter-script\") pod \"iptables-alerter-fjj2z\" (UID: \"d89b2149-fbf7-4b86-b91b-c11c19e2c862\") " pod="openshift-network-operator/iptables-alerter-fjj2z" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301740 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-var-lib-kubelet\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301778 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-registration-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301880 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5xkt\" (UniqueName: \"kubernetes.io/projected/ec8f4eb3-372d-4095-98fc-1fe2c8483150-kube-api-access-g5xkt\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.301982 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-os-release\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302255 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-var-lib-cni-bin\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302294 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-var-lib-cni-bin\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302309 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-etc-selinux\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302255 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d89b2149-fbf7-4b86-b91b-c11c19e2c862-iptables-alerter-script\") pod \"iptables-alerter-fjj2z\" (UID: \"d89b2149-fbf7-4b86-b91b-c11c19e2c862\") " pod="openshift-network-operator/iptables-alerter-fjj2z" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302360 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/344ad782-e324-42c3-b50a-04006e1d1c62-tmp\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302386 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-var-lib-openvswitch\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.302402 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302399 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-etc-selinux\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.303064 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302413 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lvdg\" (UniqueName: \"kubernetes.io/projected/0e2ccbba-82ab-40ec-ab03-121c974af538-kube-api-access-2lvdg\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303064 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302436 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-var-lib-openvswitch\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303064 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302437 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-var-lib-kubelet\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.303064 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302487 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-var-lib-kubelet\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.303064 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302568 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-run-multus-certs\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.303064 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.302504 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-run-multus-certs\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.303064 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303016 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-run-netns\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.303064 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303055 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ab965c9-a202-40cb-88a0-882ef334ed2e-agent-certs\") pod \"konnectivity-agent-5mdwl\" (UID: \"7ab965c9-a202-40cb-88a0-882ef334ed2e\") " pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:02.303416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303082 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-run-openvswitch\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303115 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-run-ovn-kubernetes\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303147 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:02.303416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303180 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-system-cni-dir\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.303416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303210 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4g8q\" (UniqueName: \"kubernetes.io/projected/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-kube-api-access-t4g8q\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.303416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303242 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ab965c9-a202-40cb-88a0-882ef334ed2e-konnectivity-ca\") pod \"konnectivity-agent-5mdwl\" (UID: \"7ab965c9-a202-40cb-88a0-882ef334ed2e\") " pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:02.303416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303274 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-run\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.303416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303304 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a346c634-df16-4e2d-af0b-7408c90d6735-host\") pod \"node-ca-vlkd9\" (UID: \"a346c634-df16-4e2d-af0b-7408c90d6735\") " pod="openshift-image-registry/node-ca-vlkd9" Jul 09 14:32:02.303416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303334 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-run-netns\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303358 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-run-systemd\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e2ccbba-82ab-40ec-ab03-121c974af538-ovn-node-metrics-cert\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303426 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-run-k8s-cni-cncf-io\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303457 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303504 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwcrh\" (UniqueName: \"kubernetes.io/projected/d89b2149-fbf7-4b86-b91b-c11c19e2c862-kube-api-access-wwcrh\") pod \"iptables-alerter-fjj2z\" (UID: \"d89b2149-fbf7-4b86-b91b-c11c19e2c862\") " pod="openshift-network-operator/iptables-alerter-fjj2z" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303546 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-cni-binary-copy\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303599 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-slash\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303626 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-cni-netd\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303656 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303690 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e2ccbba-82ab-40ec-ab03-121c974af538-ovnkube-config\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303722 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2fltf\" (UniqueName: \"kubernetes.io/projected/778767ba-64a7-4cf2-8136-a369e1f6dcb3-kube-api-access-2fltf\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303753 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-daemon-config\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303778 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-sys-fs\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303803 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-log-socket\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.303834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303822 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-conf-dir\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303846 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-modprobe-d\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303865 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-sys\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303881 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a346c634-df16-4e2d-af0b-7408c90d6735-serviceca\") pod \"node-ca-vlkd9\" (UID: \"a346c634-df16-4e2d-af0b-7408c90d6735\") " pod="openshift-image-registry/node-ca-vlkd9" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303907 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flwxq\" (UniqueName: \"kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq\") pod \"network-check-target-9l8rh\" (UID: \"2a37909b-4421-4481-853d-7e88f330aa94\") " pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303924 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-kubelet\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303944 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e2ccbba-82ab-40ec-ab03-121c974af538-ovnkube-script-lib\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303962 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d89b2149-fbf7-4b86-b91b-c11c19e2c862-host-slash\") pod \"iptables-alerter-fjj2z\" (UID: \"d89b2149-fbf7-4b86-b91b-c11c19e2c862\") " pod="openshift-network-operator/iptables-alerter-fjj2z" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303979 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/344ad782-e324-42c3-b50a-04006e1d1c62-etc-tuned\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.303999 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njhfn\" (UniqueName: \"kubernetes.io/projected/a346c634-df16-4e2d-af0b-7408c90d6735-kube-api-access-njhfn\") pod \"node-ca-vlkd9\" (UID: \"a346c634-df16-4e2d-af0b-7408c90d6735\") " pod="openshift-image-registry/node-ca-vlkd9" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304017 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-cni-bin\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304035 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e2ccbba-82ab-40ec-ab03-121c974af538-env-overrides\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304052 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-cni-dir\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304070 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-sysctl-conf\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304086 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-lib-modules\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304103 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-host\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304121 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-cnibin\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304140 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-socket-dir-parent\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.304221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304158 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-hostroot\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.305008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304240 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-hostroot\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.305008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304292 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-run-netns\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.305008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304630 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-sys-fs\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.305008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304647 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-system-cni-dir\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.305008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304705 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-run-systemd\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.305008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304717 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-run-ovn-kubernetes\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.305008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304769 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-conf-dir\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.305008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304888 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-modprobe-d\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.305008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.304948 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-sys\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.305442 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.305080 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-slash\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.305442 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.305103 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.305442 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.305166 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/778767ba-64a7-4cf2-8136-a369e1f6dcb3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.305442 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.305230 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:02.305442 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.305297 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs podName:ec8f4eb3-372d-4095-98fc-1fe2c8483150 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:02.805273762 +0000 UTC m=+3.007200908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs") pod "network-metrics-daemon-cxzs4" (UID: "ec8f4eb3-372d-4095-98fc-1fe2c8483150") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:02.305442 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.305392 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a346c634-df16-4e2d-af0b-7408c90d6735-serviceca\") pod \"node-ca-vlkd9\" (UID: \"a346c634-df16-4e2d-af0b-7408c90d6735\") " pod="openshift-image-registry/node-ca-vlkd9" Jul 09 14:32:02.305790 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.305709 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-kubelet\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.305984 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.305957 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0e2ccbba-82ab-40ec-ab03-121c974af538-ovnkube-config\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.305984 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.305977 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-etc-sysctl-conf\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.306129 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306053 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d89b2149-fbf7-4b86-b91b-c11c19e2c862-host-slash\") pod \"iptables-alerter-fjj2z\" (UID: \"d89b2149-fbf7-4b86-b91b-c11c19e2c862\") " pod="openshift-network-operator/iptables-alerter-fjj2z" Jul 09 14:32:02.306129 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306070 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-cni-bin\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.306129 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306082 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-cni-binary-copy\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.306270 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306174 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-socket-dir-parent\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.306270 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306215 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0e2ccbba-82ab-40ec-ab03-121c974af538-ovnkube-script-lib\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.306362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306299 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-lib-modules\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.306412 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306363 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-host\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.306488 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306430 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-cnibin\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.306578 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306558 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-daemon-config\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.306728 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306709 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-run-openvswitch\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.306778 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306754 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a346c634-df16-4e2d-af0b-7408c90d6735-host\") pod \"node-ca-vlkd9\" (UID: \"a346c634-df16-4e2d-af0b-7408c90d6735\") " pod="openshift-image-registry/node-ca-vlkd9" Jul 09 14:32:02.306831 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306782 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-log-socket\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.306831 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306809 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-cni-netd\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.306961 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.306865 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-multus-cni-dir\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.307138 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.307123 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0e2ccbba-82ab-40ec-ab03-121c974af538-env-overrides\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.307184 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.307126 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/344ad782-e324-42c3-b50a-04006e1d1c62-run\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.307273 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.307261 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0e2ccbba-82ab-40ec-ab03-121c974af538-host-run-netns\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.307322 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.307293 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/344ad782-e324-42c3-b50a-04006e1d1c62-tmp\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.307322 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.307299 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-host-run-k8s-cni-cncf-io\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.308432 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.308412 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7ab965c9-a202-40cb-88a0-882ef334ed2e-konnectivity-ca\") pod \"konnectivity-agent-5mdwl\" (UID: \"7ab965c9-a202-40cb-88a0-882ef334ed2e\") " pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:02.309308 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.309274 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/344ad782-e324-42c3-b50a-04006e1d1c62-etc-tuned\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.310330 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.310311 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7ab965c9-a202-40cb-88a0-882ef334ed2e-agent-certs\") pod \"konnectivity-agent-5mdwl\" (UID: \"7ab965c9-a202-40cb-88a0-882ef334ed2e\") " pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:02.310985 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.310962 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0e2ccbba-82ab-40ec-ab03-121c974af538-ovn-node-metrics-cert\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.311998 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.311973 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5xkt\" (UniqueName: \"kubernetes.io/projected/ec8f4eb3-372d-4095-98fc-1fe2c8483150-kube-api-access-g5xkt\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:02.313716 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.313690 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:32:02.313716 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.313717 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:32:02.313853 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.313729 2570 projected.go:196] Error preparing data for projected volume kube-api-access-flwxq for pod openshift-network-diagnostics/network-check-target-9l8rh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:02.313853 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.313800 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq podName:2a37909b-4421-4481-853d-7e88f330aa94 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:02.81378363 +0000 UTC m=+3.015710779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-flwxq" (UniqueName: "kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq") pod "network-check-target-9l8rh" (UID: "2a37909b-4421-4481-853d-7e88f330aa94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:02.314061 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.314041 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gml6\" (UniqueName: \"kubernetes.io/projected/344ad782-e324-42c3-b50a-04006e1d1c62-kube-api-access-2gml6\") pod \"tuned-t2zwt\" (UID: \"344ad782-e324-42c3-b50a-04006e1d1c62\") " pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.316973 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.316950 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njhfn\" (UniqueName: \"kubernetes.io/projected/a346c634-df16-4e2d-af0b-7408c90d6735-kube-api-access-njhfn\") pod \"node-ca-vlkd9\" (UID: \"a346c634-df16-4e2d-af0b-7408c90d6735\") " pod="openshift-image-registry/node-ca-vlkd9" Jul 09 14:32:02.317049 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.316990 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4g8q\" (UniqueName: \"kubernetes.io/projected/0ee3219a-bd74-4a69-a9b8-66785fe4d4e4-kube-api-access-t4g8q\") pod \"multus-9mn4p\" (UID: \"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4\") " pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.317316 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.317297 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2fltf\" (UniqueName: \"kubernetes.io/projected/778767ba-64a7-4cf2-8136-a369e1f6dcb3-kube-api-access-2fltf\") pod \"aws-ebs-csi-driver-node-dh5rw\" (UID: \"778767ba-64a7-4cf2-8136-a369e1f6dcb3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.318037 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.318004 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lvdg\" (UniqueName: \"kubernetes.io/projected/0e2ccbba-82ab-40ec-ab03-121c974af538-kube-api-access-2lvdg\") pod \"ovnkube-node-vn2j9\" (UID: \"0e2ccbba-82ab-40ec-ab03-121c974af538\") " pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.318110 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.318004 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwcrh\" (UniqueName: \"kubernetes.io/projected/d89b2149-fbf7-4b86-b91b-c11c19e2c862-kube-api-access-wwcrh\") pod \"iptables-alerter-fjj2z\" (UID: \"d89b2149-fbf7-4b86-b91b-c11c19e2c862\") " pod="openshift-network-operator/iptables-alerter-fjj2z" Jul 09 14:32:02.394650 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.394579 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ttbl4" Jul 09 14:32:02.402618 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.402595 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nfh5q" Jul 09 14:32:02.404975 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:02.404952 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode112330b_09d8_499a_9be7_21e0f525098c.slice/crio-918b14b736ba7d9d2aab954821c8f0dcf962f8637bca2b179b3d9c5e9187d1f3 WatchSource:0}: Error finding container 918b14b736ba7d9d2aab954821c8f0dcf962f8637bca2b179b3d9c5e9187d1f3: Status 404 returned error can't find the container with id 918b14b736ba7d9d2aab954821c8f0dcf962f8637bca2b179b3d9c5e9187d1f3 Jul 09 14:32:02.417383 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.417356 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:02.425442 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.425296 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fjj2z" Jul 09 14:32:02.428375 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:02.428353 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ab965c9_a202_40cb_88a0_882ef334ed2e.slice/crio-ca38e6d2982ccc45891516ca71d4e8a0114dfc79b2022e4be033b5c678ce8f66 WatchSource:0}: Error finding container ca38e6d2982ccc45891516ca71d4e8a0114dfc79b2022e4be033b5c678ce8f66: Status 404 returned error can't find the container with id ca38e6d2982ccc45891516ca71d4e8a0114dfc79b2022e4be033b5c678ce8f66 Jul 09 14:32:02.431097 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.431083 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9mn4p" Jul 09 14:32:02.434851 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:02.434824 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd89b2149_fbf7_4b86_b91b_c11c19e2c862.slice/crio-868a80cb877c270bdf90315c856765ce2f79f1c9197dce8233d688726ff02bf7 WatchSource:0}: Error finding container 868a80cb877c270bdf90315c856765ce2f79f1c9197dce8233d688726ff02bf7: Status 404 returned error can't find the container with id 868a80cb877c270bdf90315c856765ce2f79f1c9197dce8233d688726ff02bf7 Jul 09 14:32:02.437633 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.437619 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" Jul 09 14:32:02.440856 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:02.440827 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee3219a_bd74_4a69_a9b8_66785fe4d4e4.slice/crio-5aa1b75f322c5ad6073dad27c6de2d5de255eb0a78b44834c5021aa671b73896 WatchSource:0}: Error finding container 5aa1b75f322c5ad6073dad27c6de2d5de255eb0a78b44834c5021aa671b73896: Status 404 returned error can't find the container with id 5aa1b75f322c5ad6073dad27c6de2d5de255eb0a78b44834c5021aa671b73896 Jul 09 14:32:02.443615 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.443572 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" Jul 09 14:32:02.450743 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.450722 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vlkd9" Jul 09 14:32:02.452159 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:02.452113 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod344ad782_e324_42c3_b50a_04006e1d1c62.slice/crio-046e2fbeb865ae31b515d78ac8739337571108fff3d9607f3289c22fc9ff1c79 WatchSource:0}: Error finding container 046e2fbeb865ae31b515d78ac8739337571108fff3d9607f3289c22fc9ff1c79: Status 404 returned error can't find the container with id 046e2fbeb865ae31b515d78ac8739337571108fff3d9607f3289c22fc9ff1c79 Jul 09 14:32:02.455753 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.455565 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:02.456448 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:02.456428 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778767ba_64a7_4cf2_8136_a369e1f6dcb3.slice/crio-5347317fa4941b8f3d9009752054711f27c2416509c83b3c073c41bb97405aa1 WatchSource:0}: Error finding container 5347317fa4941b8f3d9009752054711f27c2416509c83b3c073c41bb97405aa1: Status 404 returned error can't find the container with id 5347317fa4941b8f3d9009752054711f27c2416509c83b3c073c41bb97405aa1 Jul 09 14:32:02.465405 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:02.465382 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda346c634_df16_4e2d_af0b_7408c90d6735.slice/crio-7ebde3f5b9f2340b5db615b610790cb259c17a98369ec860a800c44a1ca39d0e WatchSource:0}: Error finding container 7ebde3f5b9f2340b5db615b610790cb259c17a98369ec860a800c44a1ca39d0e: Status 404 returned error can't find the container with id 7ebde3f5b9f2340b5db615b610790cb259c17a98369ec860a800c44a1ca39d0e Jul 09 14:32:02.470002 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:02.469943 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e2ccbba_82ab_40ec_ab03_121c974af538.slice/crio-bb49daa142e99e85d2c39be89b8934405a158652f8038b9d10bdf1b7fcc76867 WatchSource:0}: Error finding container bb49daa142e99e85d2c39be89b8934405a158652f8038b9d10bdf1b7fcc76867: Status 404 returned error can't find the container with id bb49daa142e99e85d2c39be89b8934405a158652f8038b9d10bdf1b7fcc76867 Jul 09 14:32:02.707818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.707786 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:02.707978 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.707938 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:02.708032 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.708004 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret podName:cbd60921-6ec5-48e9-9b52-cdcf119ce07e nodeName:}" failed. No retries permitted until 2026-07-09 14:32:03.707984917 +0000 UTC m=+3.909912062 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret") pod "global-pull-secret-syncer-84t2b" (UID: "cbd60921-6ec5-48e9-9b52-cdcf119ce07e") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:02.808609 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.808579 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:02.808783 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.808753 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:02.808850 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.808828 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs podName:ec8f4eb3-372d-4095-98fc-1fe2c8483150 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:03.808804169 +0000 UTC m=+4.010731311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs") pod "network-metrics-daemon-cxzs4" (UID: "ec8f4eb3-372d-4095-98fc-1fe2c8483150") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:02.909663 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:02.909631 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flwxq\" (UniqueName: \"kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq\") pod \"network-check-target-9l8rh\" (UID: \"2a37909b-4421-4481-853d-7e88f330aa94\") " pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:02.909823 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.909811 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:32:02.909887 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.909829 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:32:02.909887 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.909841 2570 projected.go:196] Error preparing data for projected volume kube-api-access-flwxq for pod openshift-network-diagnostics/network-check-target-9l8rh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:02.910049 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:02.909901 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq podName:2a37909b-4421-4481-853d-7e88f330aa94 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:03.909881994 +0000 UTC m=+4.111809141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-flwxq" (UniqueName: "kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq") pod "network-check-target-9l8rh" (UID: "2a37909b-4421-4481-853d-7e88f330aa94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:03.233806 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.233569 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:03.234355 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:03.233925 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:03.242571 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.242542 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" event={"ID":"0e2ccbba-82ab-40ec-ab03-121c974af538","Type":"ContainerStarted","Data":"bb49daa142e99e85d2c39be89b8934405a158652f8038b9d10bdf1b7fcc76867"} Jul 09 14:32:03.244883 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.244857 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vlkd9" event={"ID":"a346c634-df16-4e2d-af0b-7408c90d6735","Type":"ContainerStarted","Data":"7ebde3f5b9f2340b5db615b610790cb259c17a98369ec860a800c44a1ca39d0e"} Jul 09 14:32:03.247351 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.247321 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" event={"ID":"778767ba-64a7-4cf2-8136-a369e1f6dcb3","Type":"ContainerStarted","Data":"5347317fa4941b8f3d9009752054711f27c2416509c83b3c073c41bb97405aa1"} Jul 09 14:32:03.248778 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.248751 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" event={"ID":"344ad782-e324-42c3-b50a-04006e1d1c62","Type":"ContainerStarted","Data":"046e2fbeb865ae31b515d78ac8739337571108fff3d9607f3289c22fc9ff1c79"} Jul 09 14:32:03.251048 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.251017 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fjj2z" event={"ID":"d89b2149-fbf7-4b86-b91b-c11c19e2c862","Type":"ContainerStarted","Data":"868a80cb877c270bdf90315c856765ce2f79f1c9197dce8233d688726ff02bf7"} Jul 09 14:32:03.252366 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.252340 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nfh5q" event={"ID":"3eecab63-82b5-4f23-a147-b1113057ad00","Type":"ContainerStarted","Data":"9da6192f9806ff80792d21e87092250e4e4c02a3c94ec372731019bb52930e30"} Jul 09 14:32:03.253251 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.253227 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:27:02 +0000 UTC" deadline="2028-04-07 17:14:38.752035448 +0000 UTC" Jul 09 14:32:03.253251 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.253252 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15314h42m35.49878789s" Jul 09 14:32:03.254118 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.254093 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9mn4p" event={"ID":"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4","Type":"ContainerStarted","Data":"5aa1b75f322c5ad6073dad27c6de2d5de255eb0a78b44834c5021aa671b73896"} Jul 09 14:32:03.256674 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.256650 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5mdwl" event={"ID":"7ab965c9-a202-40cb-88a0-882ef334ed2e","Type":"ContainerStarted","Data":"ca38e6d2982ccc45891516ca71d4e8a0114dfc79b2022e4be033b5c678ce8f66"} Jul 09 14:32:03.259132 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.259107 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttbl4" event={"ID":"e112330b-09d8-499a-9be7-21e0f525098c","Type":"ContainerStarted","Data":"918b14b736ba7d9d2aab954821c8f0dcf962f8637bca2b179b3d9c5e9187d1f3"} Jul 09 14:32:03.716285 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.716249 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:03.716466 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:03.716396 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:03.716466 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:03.716458 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret podName:cbd60921-6ec5-48e9-9b52-cdcf119ce07e nodeName:}" failed. No retries permitted until 2026-07-09 14:32:05.716440286 +0000 UTC m=+5.918367431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret") pod "global-pull-secret-syncer-84t2b" (UID: "cbd60921-6ec5-48e9-9b52-cdcf119ce07e") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:03.817270 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.817232 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:03.817452 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:03.817400 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:03.817512 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:03.817471 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs podName:ec8f4eb3-372d-4095-98fc-1fe2c8483150 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:05.817453272 +0000 UTC m=+6.019380432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs") pod "network-metrics-daemon-cxzs4" (UID: "ec8f4eb3-372d-4095-98fc-1fe2c8483150") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:03.918028 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:03.917985 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flwxq\" (UniqueName: \"kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq\") pod \"network-check-target-9l8rh\" (UID: \"2a37909b-4421-4481-853d-7e88f330aa94\") " pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:03.918200 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:03.918145 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:32:03.918200 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:03.918163 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:32:03.918200 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:03.918174 2570 projected.go:196] Error preparing data for projected volume kube-api-access-flwxq for pod openshift-network-diagnostics/network-check-target-9l8rh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:03.918390 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:03.918222 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq podName:2a37909b-4421-4481-853d-7e88f330aa94 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:05.91820857 +0000 UTC m=+6.120135712 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-flwxq" (UniqueName: "kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq") pod "network-check-target-9l8rh" (UID: "2a37909b-4421-4481-853d-7e88f330aa94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:04.234219 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:04.234184 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:04.234702 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:04.234360 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:04.234794 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:04.234774 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:04.234897 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:04.234876 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:04.253667 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:04.253611 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:27:02 +0000 UTC" deadline="2028-02-04 16:22:57.817838746 +0000 UTC" Jul 09 14:32:04.253831 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:04.253663 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13801h50m53.564178717s" Jul 09 14:32:05.234032 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:05.234000 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:05.234213 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:05.234129 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:05.733135 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:05.732497 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:05.733135 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:05.732723 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:05.733135 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:05.732790 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret podName:cbd60921-6ec5-48e9-9b52-cdcf119ce07e nodeName:}" failed. No retries permitted until 2026-07-09 14:32:09.732767343 +0000 UTC m=+9.934694488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret") pod "global-pull-secret-syncer-84t2b" (UID: "cbd60921-6ec5-48e9-9b52-cdcf119ce07e") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:05.833457 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:05.832917 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:05.833457 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:05.833070 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:05.833457 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:05.833130 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs podName:ec8f4eb3-372d-4095-98fc-1fe2c8483150 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:09.833113418 +0000 UTC m=+10.035040562 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs") pod "network-metrics-daemon-cxzs4" (UID: "ec8f4eb3-372d-4095-98fc-1fe2c8483150") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:05.934673 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:05.934062 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flwxq\" (UniqueName: \"kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq\") pod \"network-check-target-9l8rh\" (UID: \"2a37909b-4421-4481-853d-7e88f330aa94\") " pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:05.934673 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:05.934220 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:32:05.934673 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:05.934237 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:32:05.934673 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:05.934250 2570 projected.go:196] Error preparing data for projected volume kube-api-access-flwxq for pod openshift-network-diagnostics/network-check-target-9l8rh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:05.934673 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:05.934309 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq podName:2a37909b-4421-4481-853d-7e88f330aa94 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:09.934289889 +0000 UTC m=+10.136217032 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-flwxq" (UniqueName: "kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq") pod "network-check-target-9l8rh" (UID: "2a37909b-4421-4481-853d-7e88f330aa94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:06.234392 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:06.234358 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:06.234601 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:06.234358 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:06.234601 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:06.234536 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:06.234726 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:06.234608 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:07.234858 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:07.234252 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:07.234858 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:07.234400 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:08.233625 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:08.233593 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:08.233785 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:08.233594 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:08.233785 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:08.233734 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:08.233867 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:08.233796 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:09.233731 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:09.233686 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:09.234157 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:09.233823 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:09.763330 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:09.763243 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:09.763484 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:09.763379 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:09.763484 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:09.763442 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret podName:cbd60921-6ec5-48e9-9b52-cdcf119ce07e nodeName:}" failed. No retries permitted until 2026-07-09 14:32:17.763424578 +0000 UTC m=+17.965351724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret") pod "global-pull-secret-syncer-84t2b" (UID: "cbd60921-6ec5-48e9-9b52-cdcf119ce07e") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:09.864282 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:09.864251 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:09.864448 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:09.864432 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:09.864502 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:09.864491 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs podName:ec8f4eb3-372d-4095-98fc-1fe2c8483150 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:17.864475699 +0000 UTC m=+18.066402841 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs") pod "network-metrics-daemon-cxzs4" (UID: "ec8f4eb3-372d-4095-98fc-1fe2c8483150") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:09.964689 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:09.964658 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flwxq\" (UniqueName: \"kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq\") pod \"network-check-target-9l8rh\" (UID: \"2a37909b-4421-4481-853d-7e88f330aa94\") " pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:09.964857 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:09.964805 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:32:09.964857 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:09.964824 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:32:09.964857 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:09.964836 2570 projected.go:196] Error preparing data for projected volume kube-api-access-flwxq for pod openshift-network-diagnostics/network-check-target-9l8rh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:09.965028 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:09.964895 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq podName:2a37909b-4421-4481-853d-7e88f330aa94 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:17.964877205 +0000 UTC m=+18.166804364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-flwxq" (UniqueName: "kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq") pod "network-check-target-9l8rh" (UID: "2a37909b-4421-4481-853d-7e88f330aa94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:10.234505 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:10.234470 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:10.234969 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:10.234610 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:10.234969 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:10.234682 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:10.234969 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:10.234745 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:11.233353 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:11.233321 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:11.233561 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:11.233450 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:12.234544 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:12.234307 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:12.234544 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:12.234463 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:12.234544 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:12.234531 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:12.235099 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:12.234667 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:13.233736 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:13.233658 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:13.233882 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:13.233825 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:13.282217 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:13.282182 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" event={"ID":"a0465a62b10ff46565ba4cbcd0da6470","Type":"ContainerStarted","Data":"4fb70716de649fe040c039bb90d6098cbf5a0362ccb33324cffa46b23f1cbd1d"} Jul 09 14:32:13.286965 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:13.286920 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" event={"ID":"344ad782-e324-42c3-b50a-04006e1d1c62","Type":"ContainerStarted","Data":"1152f749cd65e228efc68c56fdef9de5e1ef75ecf9c1b4e6bbf980172fccd0de"} Jul 09 14:32:13.301042 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:13.301001 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-220.ec2.internal" podStartSLOduration=12.300988634 podStartE2EDuration="12.300988634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:32:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:13.300765348 +0000 UTC m=+13.502692514" watchObservedRunningTime="2026-07-09 14:32:13.300988634 +0000 UTC m=+13.502915797" Jul 09 14:32:13.320658 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:13.320073 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-t2zwt" podStartSLOduration=2.910865383 podStartE2EDuration="13.320053376s" totalImagesPullingTime="10.409187993s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:13.31992457 +0000 UTC m=+13.521851735" watchObservedRunningTime="2026-07-09 14:32:13.320053376 +0000 UTC m=+13.521980541" Jul 09 14:32:14.233903 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.233696 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:14.234101 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.233696 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:14.237157 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:14.234344 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:14.237157 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:14.235267 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:14.290730 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.290692 2570 generic.go:356] "Generic (PLEG): container finished" podID="7508382f360a344c98db04a3d5c13216" containerID="526b06403a710467de131739ae65734b3ee92dde2b00bb0f90654606a3d9063f" exitCode=0 Jul 09 14:32:14.291135 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.290776 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" event={"ID":"7508382f360a344c98db04a3d5c13216","Type":"ContainerDied","Data":"526b06403a710467de131739ae65734b3ee92dde2b00bb0f90654606a3d9063f"} Jul 09 14:32:14.292459 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.292435 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vlkd9" event={"ID":"a346c634-df16-4e2d-af0b-7408c90d6735","Type":"ContainerStarted","Data":"c6cad7296ce88ad57514f3ab407340d1911a72fea46d4208e9aa7f023127ab4e"} Jul 09 14:32:14.293921 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.293900 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" event={"ID":"778767ba-64a7-4cf2-8136-a369e1f6dcb3","Type":"ContainerStarted","Data":"b9fd2a1aca0cad7b04545f44350374c02aea266a5986814d6300f176c90cee5f"} Jul 09 14:32:14.295379 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.295358 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nfh5q" event={"ID":"3eecab63-82b5-4f23-a147-b1113057ad00","Type":"ContainerStarted","Data":"9bf4bc516041480781622ee9f1e6ba8ddd7d58672ce16ce542aadca77caebc98"} Jul 09 14:32:14.297424 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.297401 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5mdwl" event={"ID":"7ab965c9-a202-40cb-88a0-882ef334ed2e","Type":"ContainerStarted","Data":"1a043996618ce0c9a89397055eaa8fc8f183d6c6d2257c28d19545fb60c040b6"} Jul 09 14:32:14.299366 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.299343 2570 generic.go:356] "Generic (PLEG): container finished" podID="e112330b-09d8-499a-9be7-21e0f525098c" containerID="7b8cfdffeafb2406c4073690ca8691594ed5a66a0993d74f9a1effb8b53b5c4c" exitCode=0 Jul 09 14:32:14.299462 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.299416 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttbl4" event={"ID":"e112330b-09d8-499a-9be7-21e0f525098c","Type":"ContainerDied","Data":"7b8cfdffeafb2406c4073690ca8691594ed5a66a0993d74f9a1effb8b53b5c4c"} Jul 09 14:32:14.350039 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.349978 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vlkd9" podStartSLOduration=4.108381811 podStartE2EDuration="14.349957531s" totalImagesPullingTime="10.24157572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:14.349529538 +0000 UTC m=+14.551456699" watchObservedRunningTime="2026-07-09 14:32:14.349957531 +0000 UTC m=+14.551884696" Jul 09 14:32:14.386246 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:14.386189 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nfh5q" podStartSLOduration=4.091666613 podStartE2EDuration="14.386164839s" totalImagesPullingTime="10.294498226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:14.367371629 +0000 UTC m=+14.569298792" watchObservedRunningTime="2026-07-09 14:32:14.386164839 +0000 UTC m=+14.588092005" Jul 09 14:32:15.233968 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:15.233932 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:15.234165 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:15.234055 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:15.303383 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:15.303339 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" event={"ID":"7508382f360a344c98db04a3d5c13216","Type":"ContainerStarted","Data":"2de9234078eee1bd78a3716304774a077944e239feab6ae158e3044942c27b70"} Jul 09 14:32:15.305304 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:15.305276 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fjj2z" event={"ID":"d89b2149-fbf7-4b86-b91b-c11c19e2c862","Type":"ContainerStarted","Data":"042088d339fa6f7497aefd6d5e2686c0d8d09caff4602b051a47c2d9d6993102"} Jul 09 14:32:15.320056 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:15.320006 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-220.ec2.internal" podStartSLOduration=14.319991334000001 podStartE2EDuration="14.319991334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:32:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:15.319971969 +0000 UTC m=+15.521899143" watchObservedRunningTime="2026-07-09 14:32:15.319991334 +0000 UTC m=+15.521918497" Jul 09 14:32:15.320690 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:15.320652 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5mdwl" podStartSLOduration=5.060653644 podStartE2EDuration="15.320640906s" totalImagesPullingTime="10.259987262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:14.386771246 +0000 UTC m=+14.588698519" watchObservedRunningTime="2026-07-09 14:32:15.320640906 +0000 UTC m=+15.522568071" Jul 09 14:32:15.334980 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:15.334932 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fjj2z" podStartSLOduration=5.063697921 podStartE2EDuration="15.334923818s" totalImagesPullingTime="10.271225897s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:15.334818077 +0000 UTC m=+15.536745242" watchObservedRunningTime="2026-07-09 14:32:15.334923818 +0000 UTC m=+15.536850983" Jul 09 14:32:16.233490 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:16.233456 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:16.233490 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:16.233503 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:16.233743 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:16.233622 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:16.233817 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:16.233783 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:17.234098 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:17.234063 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:17.234779 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:17.234180 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:17.569872 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:17.569795 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:17.570765 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:17.570738 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:17.824444 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:17.824355 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:17.824623 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:17.824513 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:17.824623 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:17.824609 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret podName:cbd60921-6ec5-48e9-9b52-cdcf119ce07e nodeName:}" failed. No retries permitted until 2026-07-09 14:32:33.824588564 +0000 UTC m=+34.026515709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret") pod "global-pull-secret-syncer-84t2b" (UID: "cbd60921-6ec5-48e9-9b52-cdcf119ce07e") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:17.925095 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:17.925063 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:17.925264 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:17.925184 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:17.925264 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:17.925233 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs podName:ec8f4eb3-372d-4095-98fc-1fe2c8483150 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:33.925220586 +0000 UTC m=+34.127147727 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs") pod "network-metrics-daemon-cxzs4" (UID: "ec8f4eb3-372d-4095-98fc-1fe2c8483150") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:18.026383 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:18.026349 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flwxq\" (UniqueName: \"kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq\") pod \"network-check-target-9l8rh\" (UID: \"2a37909b-4421-4481-853d-7e88f330aa94\") " pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:18.026569 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:18.026500 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:32:18.026569 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:18.026532 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:32:18.026569 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:18.026546 2570 projected.go:196] Error preparing data for projected volume kube-api-access-flwxq for pod openshift-network-diagnostics/network-check-target-9l8rh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:18.026742 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:18.026610 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq podName:2a37909b-4421-4481-853d-7e88f330aa94 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:34.026591329 +0000 UTC m=+34.228518472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-flwxq" (UniqueName: "kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq") pod "network-check-target-9l8rh" (UID: "2a37909b-4421-4481-853d-7e88f330aa94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:18.237039 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:18.237008 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:18.237039 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:18.237030 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:18.237479 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:18.237118 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:18.237479 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:18.237279 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:19.233676 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:19.233650 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:19.233864 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:19.233748 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:20.237403 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:20.237198 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:20.237880 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:20.237508 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:20.237943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:20.237921 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:20.238034 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:20.238012 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:21.233575 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:21.233536 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:21.233764 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:21.233679 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:21.304993 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:21.304959 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:22.233614 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:22.233568 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:22.233614 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:22.233600 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:22.233943 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:22.233709 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:22.233943 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:22.233820 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:22.882506 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:22.882475 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:23.233445 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:23.233407 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:23.233654 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:23.233506 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:24.234080 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:24.234042 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:24.234496 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:24.234096 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:24.234496 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:24.234189 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:24.234927 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:24.234889 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:24.261990 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:24.261956 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:24.359921 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:24.359888 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:25.233993 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:25.233968 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:25.234148 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:25.234060 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:25.385901 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:25.385870 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:25.764464 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:25.764438 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 14:32:26.167294 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.167026 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:32:25.764460963Z","UUID":"70dd47b8-e50e-4645-884d-a5075e4878d0","Handler":null,"Name":"","Endpoint":""} Jul 09 14:32:26.168738 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.168717 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 14:32:26.168866 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.168760 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 14:32:26.233862 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.233830 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:26.234018 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.233830 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:26.234018 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:26.233980 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:26.234122 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:26.234026 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:26.331447 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.331357 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9mn4p" event={"ID":"0ee3219a-bd74-4a69-a9b8-66785fe4d4e4","Type":"ContainerStarted","Data":"c53df0f5f36ae7e7cbf0b44cc8e3305a02a269168e65878f3cd2ff7c394d31c9"} Jul 09 14:32:26.333667 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.333640 2570 generic.go:356] "Generic (PLEG): container finished" podID="e112330b-09d8-499a-9be7-21e0f525098c" containerID="dd2cd30fc9717a9f7d1d9cf63af91efde50d6c7c4b8a5ba039303a1e10c4ba8b" exitCode=0 Jul 09 14:32:26.333793 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.333728 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttbl4" event={"ID":"e112330b-09d8-499a-9be7-21e0f525098c","Type":"ContainerDied","Data":"dd2cd30fc9717a9f7d1d9cf63af91efde50d6c7c4b8a5ba039303a1e10c4ba8b"} Jul 09 14:32:26.337448 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.337427 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vn2j9_0e2ccbba-82ab-40ec-ab03-121c974af538/ovn-acl-logging/0.log" Jul 09 14:32:26.337855 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.337819 2570 generic.go:356] "Generic (PLEG): container finished" podID="0e2ccbba-82ab-40ec-ab03-121c974af538" containerID="1df574a5ed74f4dcea950581f77224c0b393100404fd6a84301765bd21ca1424" exitCode=1 Jul 09 14:32:26.337966 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.337898 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" event={"ID":"0e2ccbba-82ab-40ec-ab03-121c974af538","Type":"ContainerStarted","Data":"3d9a43d93cf8b3fc0f83f4c9a3c5c0ab84d3ef98c21fc8c27fca5d46161b1a68"} Jul 09 14:32:26.337966 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.337961 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" event={"ID":"0e2ccbba-82ab-40ec-ab03-121c974af538","Type":"ContainerStarted","Data":"9b66a5e3267ff695a0c0d053de1342800b39cb4f8144469a2df30ff095691a4a"} Jul 09 14:32:26.338104 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.338011 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" event={"ID":"0e2ccbba-82ab-40ec-ab03-121c974af538","Type":"ContainerStarted","Data":"f75f67e4ac08213fcd63748e9792becf594b3fef137c0d8f9667bec9fc259f62"} Jul 09 14:32:26.338104 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.338046 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" event={"ID":"0e2ccbba-82ab-40ec-ab03-121c974af538","Type":"ContainerStarted","Data":"ea3fffcca9f9ccf41d139ffe1fdeb8e22522ae29029eed44cf2a70dcb9480718"} Jul 09 14:32:26.338104 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.338086 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" event={"ID":"0e2ccbba-82ab-40ec-ab03-121c974af538","Type":"ContainerDied","Data":"1df574a5ed74f4dcea950581f77224c0b393100404fd6a84301765bd21ca1424"} Jul 09 14:32:26.338394 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.338134 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" event={"ID":"0e2ccbba-82ab-40ec-ab03-121c974af538","Type":"ContainerStarted","Data":"f2759778872c9bca97f6433ffa783430bfdcad7c50b80714a3514690bbb8043b"} Jul 09 14:32:26.339764 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.339740 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" event={"ID":"778767ba-64a7-4cf2-8136-a369e1f6dcb3","Type":"ContainerStarted","Data":"d8d6c90b93b605d47b4892b197d625d091a882a72fb9e5e4d68352fe18158dab"} Jul 09 14:32:26.351893 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.351857 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-9mn4p" podStartSLOduration=3.252968009 podStartE2EDuration="26.35184599s" totalImagesPullingTime="23.098877981s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:26.351472507 +0000 UTC m=+26.553399671" watchObservedRunningTime="2026-07-09 14:32:26.35184599 +0000 UTC m=+26.553773145" Jul 09 14:32:26.419983 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.419948 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:26.520090 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.520053 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:26.623445 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.623372 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:26.693476 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:26.693433 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:27.234248 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:27.234224 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:27.234419 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:27.234321 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:27.344284 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:27.344217 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" event={"ID":"778767ba-64a7-4cf2-8136-a369e1f6dcb3","Type":"ContainerStarted","Data":"7bc727cd5fc809f623da00163218cf118564b23ea3d807070bf6dbca37413ba5"} Jul 09 14:32:27.365579 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:27.365537 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dh5rw" podStartSLOduration=3.999779708 podStartE2EDuration="27.365502483s" totalImagesPullingTime="23.365722775s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:27.364863914 +0000 UTC m=+27.566791078" watchObservedRunningTime="2026-07-09 14:32:27.365502483 +0000 UTC m=+27.567429647" Jul 09 14:32:28.233670 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:28.233646 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:28.233801 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:28.233652 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:28.233801 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:28.233785 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:28.233905 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:28.233876 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:28.348425 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:28.348385 2570 generic.go:356] "Generic (PLEG): container finished" podID="e112330b-09d8-499a-9be7-21e0f525098c" containerID="b5b7ecbc1ea4974b5e87a184dd7e0014e749c49ff14633eba82884d22861501d" exitCode=0 Jul 09 14:32:28.348827 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:28.348469 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttbl4" event={"ID":"e112330b-09d8-499a-9be7-21e0f525098c","Type":"ContainerDied","Data":"b5b7ecbc1ea4974b5e87a184dd7e0014e749c49ff14633eba82884d22861501d"} Jul 09 14:32:28.352062 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:28.352038 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vn2j9_0e2ccbba-82ab-40ec-ab03-121c974af538/ovn-acl-logging/0.log" Jul 09 14:32:28.352504 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:28.352484 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" event={"ID":"0e2ccbba-82ab-40ec-ab03-121c974af538","Type":"ContainerStarted","Data":"65314c5950badadbb36ea9967b5db6c8fd4480dbdf28a87ffcd921924e2b4997"} Jul 09 14:32:29.233594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:29.233568 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:29.233754 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:29.233672 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:30.072249 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:30.072217 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:30.072720 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:30.072322 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 14:32:30.072861 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:30.072844 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5mdwl" Jul 09 14:32:30.234146 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:30.234115 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:30.234325 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:30.234194 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:30.234325 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:30.234294 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:30.234440 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:30.234408 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:30.363183 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:30.363157 2570 generic.go:356] "Generic (PLEG): container finished" podID="e112330b-09d8-499a-9be7-21e0f525098c" containerID="c23b2684248b9a0b66503cd8e97b01c2860cd08b4e926ad6723b65ae95d4a5f0" exitCode=0 Jul 09 14:32:30.363302 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:30.363243 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttbl4" event={"ID":"e112330b-09d8-499a-9be7-21e0f525098c","Type":"ContainerDied","Data":"c23b2684248b9a0b66503cd8e97b01c2860cd08b4e926ad6723b65ae95d4a5f0"} Jul 09 14:32:30.680718 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:30.680445 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:31.233778 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:31.233744 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:31.234188 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:31.233871 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:31.370206 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:31.370169 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vn2j9_0e2ccbba-82ab-40ec-ab03-121c974af538/ovn-acl-logging/0.log" Jul 09 14:32:31.370687 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:31.370648 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" event={"ID":"0e2ccbba-82ab-40ec-ab03-121c974af538","Type":"ContainerStarted","Data":"a59c414a9f127f5ec817618a7ae7a8b5536a23c0110bad2b323c40de08738e28"} Jul 09 14:32:31.371050 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:31.371031 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:31.371180 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:31.371165 2570 scope.go:117] "RemoveContainer" containerID="1df574a5ed74f4dcea950581f77224c0b393100404fd6a84301765bd21ca1424" Jul 09 14:32:31.391971 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:31.391951 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:32.233875 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.233845 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:32.234329 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:32.233965 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:32.234329 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.234028 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:32.234329 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:32.234217 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:32.360637 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.360601 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-84t2b"] Jul 09 14:32:32.367443 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.367413 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cxzs4"] Jul 09 14:32:32.367930 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.367912 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9l8rh"] Jul 09 14:32:32.368038 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.368023 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:32.368146 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:32.368127 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:32.376377 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.376354 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vn2j9_0e2ccbba-82ab-40ec-ab03-121c974af538/ovn-acl-logging/0.log" Jul 09 14:32:32.376769 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.376748 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:32.376872 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.376770 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" event={"ID":"0e2ccbba-82ab-40ec-ab03-121c974af538","Type":"ContainerStarted","Data":"53733cdbcd42b778f8423e6209093692a6a475bcf1c07fdd233770e19cfca15b"} Jul 09 14:32:32.376935 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:32.376866 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:32.376935 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.376906 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:32.377032 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:32.377005 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:32.377213 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.377179 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:32.377324 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.377259 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:32.395027 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.394968 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:32:32.410411 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:32.410369 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" podStartSLOduration=9.342484744 podStartE2EDuration="32.410354848s" totalImagesPullingTime="23.067870104s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:32.410030494 +0000 UTC m=+32.611957658" watchObservedRunningTime="2026-07-09 14:32:32.410354848 +0000 UTC m=+32.612281990" Jul 09 14:32:33.850031 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:33.849788 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:33.850550 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:33.849958 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:33.850550 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:33.850177 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret podName:cbd60921-6ec5-48e9-9b52-cdcf119ce07e nodeName:}" failed. No retries permitted until 2026-07-09 14:33:05.850158285 +0000 UTC m=+66.052085427 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret") pod "global-pull-secret-syncer-84t2b" (UID: "cbd60921-6ec5-48e9-9b52-cdcf119ce07e") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:32:33.951291 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:33.951250 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:33.951476 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:33.951424 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:33.951565 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:33.951507 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs podName:ec8f4eb3-372d-4095-98fc-1fe2c8483150 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:05.951485282 +0000 UTC m=+66.153412436 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs") pod "network-metrics-daemon-cxzs4" (UID: "ec8f4eb3-372d-4095-98fc-1fe2c8483150") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:32:34.052063 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:34.052023 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flwxq\" (UniqueName: \"kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq\") pod \"network-check-target-9l8rh\" (UID: \"2a37909b-4421-4481-853d-7e88f330aa94\") " pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:34.052249 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:34.052180 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:32:34.052249 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:34.052199 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:32:34.052249 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:34.052211 2570 projected.go:196] Error preparing data for projected volume kube-api-access-flwxq for pod openshift-network-diagnostics/network-check-target-9l8rh: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:34.052378 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:34.052269 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq podName:2a37909b-4421-4481-853d-7e88f330aa94 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:06.052254383 +0000 UTC m=+66.254181544 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-flwxq" (UniqueName: "kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq") pod "network-check-target-9l8rh" (UID: "2a37909b-4421-4481-853d-7e88f330aa94") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:32:34.233850 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:34.233549 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:34.234585 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:34.233549 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:34.234585 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:34.234029 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:34.234585 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:34.234095 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:34.234585 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:34.234234 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:34.234585 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:34.234333 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:36.233730 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:36.233703 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:36.233730 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:36.233716 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:36.234304 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:36.233808 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:36.234304 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:36.233903 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:36.234304 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:36.233950 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:36.234304 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:36.234000 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:36.389865 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:36.389833 2570 generic.go:356] "Generic (PLEG): container finished" podID="e112330b-09d8-499a-9be7-21e0f525098c" containerID="202a926732d267ead484612e96645d1542a56c89b2bd6076ee30f1d32bcccc07" exitCode=0 Jul 09 14:32:36.390018 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:36.389915 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttbl4" event={"ID":"e112330b-09d8-499a-9be7-21e0f525098c","Type":"ContainerDied","Data":"202a926732d267ead484612e96645d1542a56c89b2bd6076ee30f1d32bcccc07"} Jul 09 14:32:37.395126 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:37.395044 2570 generic.go:356] "Generic (PLEG): container finished" podID="e112330b-09d8-499a-9be7-21e0f525098c" containerID="6829d2f60d7517f92768ba78da5a12243940d8953209857c5b9069ded60a3358" exitCode=0 Jul 09 14:32:37.395126 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:37.395085 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttbl4" event={"ID":"e112330b-09d8-499a-9be7-21e0f525098c","Type":"ContainerDied","Data":"6829d2f60d7517f92768ba78da5a12243940d8953209857c5b9069ded60a3358"} Jul 09 14:32:38.233660 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:38.233621 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:38.233660 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:38.233662 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:38.233909 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:38.233622 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:38.233909 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:38.233742 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9l8rh" podUID="2a37909b-4421-4481-853d-7e88f330aa94" Jul 09 14:32:38.233909 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:38.233811 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-84t2b" podUID="cbd60921-6ec5-48e9-9b52-cdcf119ce07e" Jul 09 14:32:38.234023 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:38.233914 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cxzs4" podUID="ec8f4eb3-372d-4095-98fc-1fe2c8483150" Jul 09 14:32:38.365570 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:38.365538 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:38.400144 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:38.400115 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ttbl4" event={"ID":"e112330b-09d8-499a-9be7-21e0f525098c","Type":"ContainerStarted","Data":"3e8e3a8df8a8051ba9bb8152ce71467d2625a1a19729435aa66b1191bc71e38e"} Jul 09 14:32:38.426643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:38.426600 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ttbl4" podStartSLOduration=9.583597812 podStartE2EDuration="38.426584792s" totalImagesPullingTime="28.84298698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:38.42607287 +0000 UTC m=+38.628000033" watchObservedRunningTime="2026-07-09 14:32:38.426584792 +0000 UTC m=+38.628511955" Jul 09 14:32:38.444281 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:38.444254 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:38.568894 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:38.568822 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:38.642350 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:38.642325 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:38.767811 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:38.767786 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:39.128686 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.128666 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-220.ec2.internal" event="NodeReady" Jul 09 14:32:39.128821 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.128810 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 14:32:39.183913 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.183889 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-nl64z"] Jul 09 14:32:39.213885 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.213862 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r5fq4"] Jul 09 14:32:39.214021 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.213995 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.216258 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.216237 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 14:32:39.216258 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.216258 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 14:32:39.216405 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.216355 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkg97\"" Jul 09 14:32:39.227672 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.227651 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nl64z"] Jul 09 14:32:39.227763 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.227694 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r5fq4"] Jul 09 14:32:39.227763 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.227752 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r5fq4" Jul 09 14:32:39.230338 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.230319 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 14:32:39.230418 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.230341 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 14:32:39.230418 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.230386 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 14:32:39.230418 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.230341 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k2mrc\"" Jul 09 14:32:39.291469 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.291409 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.291469 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.291450 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8a41997-1d04-466b-be20-b5c118b42b46-config-volume\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.291643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.291471 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a41997-1d04-466b-be20-b5c118b42b46-tmp-dir\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.291643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.291499 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwrgh\" (UniqueName: \"kubernetes.io/projected/a8a41997-1d04-466b-be20-b5c118b42b46-kube-api-access-qwrgh\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.392773 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.392727 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.393043 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.392792 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8a41997-1d04-466b-be20-b5c118b42b46-config-volume\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.393043 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.392814 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a41997-1d04-466b-be20-b5c118b42b46-tmp-dir\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.393043 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.392833 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfdh2\" (UniqueName: \"kubernetes.io/projected/e288aaaa-06b4-45bd-a94b-b8e785e1e1fa-kube-api-access-dfdh2\") pod \"ingress-canary-r5fq4\" (UID: \"e288aaaa-06b4-45bd-a94b-b8e785e1e1fa\") " pod="openshift-ingress-canary/ingress-canary-r5fq4" Jul 09 14:32:39.393043 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.392859 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwrgh\" (UniqueName: \"kubernetes.io/projected/a8a41997-1d04-466b-be20-b5c118b42b46-kube-api-access-qwrgh\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.393043 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:39.392889 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:39.393043 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.392899 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e288aaaa-06b4-45bd-a94b-b8e785e1e1fa-cert\") pod \"ingress-canary-r5fq4\" (UID: \"e288aaaa-06b4-45bd-a94b-b8e785e1e1fa\") " pod="openshift-ingress-canary/ingress-canary-r5fq4" Jul 09 14:32:39.393043 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:39.392954 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls podName:a8a41997-1d04-466b-be20-b5c118b42b46 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:39.892935402 +0000 UTC m=+40.094862567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls") pod "dns-default-nl64z" (UID: "a8a41997-1d04-466b-be20-b5c118b42b46") : secret "dns-default-metrics-tls" not found Jul 09 14:32:39.393418 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.393171 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a8a41997-1d04-466b-be20-b5c118b42b46-tmp-dir\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.393502 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.393480 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a8a41997-1d04-466b-be20-b5c118b42b46-config-volume\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.412552 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.412506 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwrgh\" (UniqueName: \"kubernetes.io/projected/a8a41997-1d04-466b-be20-b5c118b42b46-kube-api-access-qwrgh\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.494108 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.494076 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e288aaaa-06b4-45bd-a94b-b8e785e1e1fa-cert\") pod \"ingress-canary-r5fq4\" (UID: \"e288aaaa-06b4-45bd-a94b-b8e785e1e1fa\") " pod="openshift-ingress-canary/ingress-canary-r5fq4" Jul 09 14:32:39.494237 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.494165 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dfdh2\" (UniqueName: \"kubernetes.io/projected/e288aaaa-06b4-45bd-a94b-b8e785e1e1fa-kube-api-access-dfdh2\") pod \"ingress-canary-r5fq4\" (UID: \"e288aaaa-06b4-45bd-a94b-b8e785e1e1fa\") " pod="openshift-ingress-canary/ingress-canary-r5fq4" Jul 09 14:32:39.496577 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.496553 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e288aaaa-06b4-45bd-a94b-b8e785e1e1fa-cert\") pod \"ingress-canary-r5fq4\" (UID: \"e288aaaa-06b4-45bd-a94b-b8e785e1e1fa\") " pod="openshift-ingress-canary/ingress-canary-r5fq4" Jul 09 14:32:39.503254 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.503233 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfdh2\" (UniqueName: \"kubernetes.io/projected/e288aaaa-06b4-45bd-a94b-b8e785e1e1fa-kube-api-access-dfdh2\") pod \"ingress-canary-r5fq4\" (UID: \"e288aaaa-06b4-45bd-a94b-b8e785e1e1fa\") " pod="openshift-ingress-canary/ingress-canary-r5fq4" Jul 09 14:32:39.535481 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.535457 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r5fq4" Jul 09 14:32:39.741776 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.741604 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r5fq4"] Jul 09 14:32:39.745609 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:39.745577 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode288aaaa_06b4_45bd_a94b_b8e785e1e1fa.slice/crio-e96acd4bbbee93d71e5f336434a5d7e5d3559d1c0dd0773163d670fb8b6f8b86 WatchSource:0}: Error finding container e96acd4bbbee93d71e5f336434a5d7e5d3559d1c0dd0773163d670fb8b6f8b86: Status 404 returned error can't find the container with id e96acd4bbbee93d71e5f336434a5d7e5d3559d1c0dd0773163d670fb8b6f8b86 Jul 09 14:32:39.897649 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:39.897505 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:39.897814 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:39.897686 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:39.897814 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:39.897774 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls podName:a8a41997-1d04-466b-be20-b5c118b42b46 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:40.897751811 +0000 UTC m=+41.099678980 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls") pod "dns-default-nl64z" (UID: "a8a41997-1d04-466b-be20-b5c118b42b46") : secret "dns-default-metrics-tls" not found Jul 09 14:32:40.235183 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:40.235155 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:32:40.235338 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:40.235224 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:32:40.235416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:40.235397 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:32:40.238011 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:40.237992 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:32:40.238837 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:40.238814 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:32:40.238952 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:40.238923 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-txwkz\"" Jul 09 14:32:40.238952 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:40.238944 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:32:40.239062 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:40.238950 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l2qn4\"" Jul 09 14:32:40.239062 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:40.238949 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:32:40.407584 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:40.407547 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r5fq4" event={"ID":"e288aaaa-06b4-45bd-a94b-b8e785e1e1fa","Type":"ContainerStarted","Data":"e96acd4bbbee93d71e5f336434a5d7e5d3559d1c0dd0773163d670fb8b6f8b86"} Jul 09 14:32:40.904553 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:40.904502 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:40.905010 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:40.904673 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:40.905010 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:40.904751 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls podName:a8a41997-1d04-466b-be20-b5c118b42b46 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:42.904731222 +0000 UTC m=+43.106658369 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls") pod "dns-default-nl64z" (UID: "a8a41997-1d04-466b-be20-b5c118b42b46") : secret "dns-default-metrics-tls" not found Jul 09 14:32:42.235316 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:42.235280 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:42.335908 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:42.335872 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:42.919782 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:42.919745 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:42.919914 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:42.919894 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:42.919978 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:42.919969 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls podName:a8a41997-1d04-466b-be20-b5c118b42b46 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:46.919953688 +0000 UTC m=+47.121880830 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls") pod "dns-default-nl64z" (UID: "a8a41997-1d04-466b-be20-b5c118b42b46") : secret "dns-default-metrics-tls" not found Jul 09 14:32:43.416283 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:43.416247 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r5fq4" event={"ID":"e288aaaa-06b4-45bd-a94b-b8e785e1e1fa","Type":"ContainerStarted","Data":"32d2061839e9b0eaf20bd326b03df39906928680defcd8df71bb9c202bc10d12"} Jul 09 14:32:43.434193 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:43.434152 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r5fq4" podStartSLOduration=1.335308035 podStartE2EDuration="4.434137585s" totalImagesPullingTime="3.09882955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:32:43.433495202 +0000 UTC m=+43.635422377" watchObservedRunningTime="2026-07-09 14:32:43.434137585 +0000 UTC m=+43.636064765" Jul 09 14:32:46.947701 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:46.947495 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:46.948076 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:46.947655 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:46.948076 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:46.947827 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls podName:a8a41997-1d04-466b-be20-b5c118b42b46 nodeName:}" failed. No retries permitted until 2026-07-09 14:32:54.94780922 +0000 UTC m=+55.149736378 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls") pod "dns-default-nl64z" (UID: "a8a41997-1d04-466b-be20-b5c118b42b46") : secret "dns-default-metrics-tls" not found Jul 09 14:32:47.299744 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:47.299653 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:47.361455 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:47.361422 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:47.678128 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:47.678039 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:55.003380 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:55.003342 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:32:55.003943 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:55.003469 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:32:55.003943 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:55.003537 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls podName:a8a41997-1d04-466b-be20-b5c118b42b46 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:11.003506814 +0000 UTC m=+71.205433957 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls") pod "dns-default-nl64z" (UID: "a8a41997-1d04-466b-be20-b5c118b42b46") : secret "dns-default-metrics-tls" not found Jul 09 14:32:56.206188 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:56.206125 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:56.288335 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:56.288302 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:58.430908 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.430871 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8"] Jul 09 14:32:58.455951 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.455926 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-mlmrr"] Jul 09 14:32:58.456086 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.456051 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:32:58.459445 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.459420 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 14:32:58.459755 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.459740 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w7z72\"" Jul 09 14:32:58.460741 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.460725 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 14:32:58.460912 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.460891 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 14:32:58.460990 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.460958 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 14:32:58.475997 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.475981 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8"] Jul 09 14:32:58.476074 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.476017 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-mlmrr"] Jul 09 14:32:58.476112 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.476098 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.479207 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.479189 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-rvqlr\"" Jul 09 14:32:58.479301 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.479226 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 14:32:58.479359 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.479306 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 09 14:32:58.479564 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.479551 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 09 14:32:58.479838 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.479824 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 14:32:58.485974 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.485955 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 09 14:32:58.542996 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.542972 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4gcz4"] Jul 09 14:32:58.558941 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.558916 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-vphpl"] Jul 09 14:32:58.559056 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.558922 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4gcz4" Jul 09 14:32:58.562054 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.562038 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5hkkn\"" Jul 09 14:32:58.572917 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.572899 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4gcz4"] Jul 09 14:32:58.573013 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.572925 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vphpl"] Jul 09 14:32:58.573013 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.572997 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.576752 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.576734 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 09 14:32:58.576863 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.576781 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:32:58.577005 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.576988 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 09 14:32:58.577069 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.577053 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-t4wlq\"" Jul 09 14:32:58.577550 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.577530 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 09 14:32:58.584692 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.584672 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 09 14:32:58.631741 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.631715 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5894b9-5035-4464-8f52-42cf46cc95c4-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.631848 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.631745 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d5894b9-5035-4464-8f52-42cf46cc95c4-serving-cert\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.631848 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.631775 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5894b9-5035-4464-8f52-42cf46cc95c4-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.631848 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.631797 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ae68db00-049e-481a-9113-1e3db992ddec-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:32:58.631848 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.631820 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:32:58.632005 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.631853 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7d5894b9-5035-4464-8f52-42cf46cc95c4-snapshots\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.632005 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.631882 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6t4r\" (UniqueName: \"kubernetes.io/projected/ae68db00-049e-481a-9113-1e3db992ddec-kube-api-access-n6t4r\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:32:58.632005 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.631905 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5894b9-5035-4464-8f52-42cf46cc95c4-tmp\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.632005 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.631929 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67fhg\" (UniqueName: \"kubernetes.io/projected/7d5894b9-5035-4464-8f52-42cf46cc95c4-kube-api-access-67fhg\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.671960 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.671905 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:58.732409 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.732382 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce1628fd-5991-4d14-b958-9f1d28e671be-serving-cert\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.732509 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.732419 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5894b9-5035-4464-8f52-42cf46cc95c4-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.732509 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.732471 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ae68db00-049e-481a-9113-1e3db992ddec-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:32:58.732509 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.732502 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:32:58.732640 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.732541 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72cbf\" (UniqueName: \"kubernetes.io/projected/ce1628fd-5991-4d14-b958-9f1d28e671be-kube-api-access-72cbf\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.732640 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.732580 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7d5894b9-5035-4464-8f52-42cf46cc95c4-snapshots\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.732640 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.732605 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1628fd-5991-4d14-b958-9f1d28e671be-trusted-ca\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.732640 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.732636 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6t4r\" (UniqueName: \"kubernetes.io/projected/ae68db00-049e-481a-9113-1e3db992ddec-kube-api-access-n6t4r\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:32:58.732799 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:58.732638 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:32:58.732799 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.732662 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5894b9-5035-4464-8f52-42cf46cc95c4-tmp\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.732799 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:58.732753 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls podName:ae68db00-049e-481a-9113-1e3db992ddec nodeName:}" failed. No retries permitted until 2026-07-09 14:32:59.232713257 +0000 UTC m=+59.434640400 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5ksp8" (UID: "ae68db00-049e-481a-9113-1e3db992ddec") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:32:58.732945 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.732808 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67fhg\" (UniqueName: \"kubernetes.io/projected/7d5894b9-5035-4464-8f52-42cf46cc95c4-kube-api-access-67fhg\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.733052 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.733027 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5894b9-5035-4464-8f52-42cf46cc95c4-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.733138 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.733075 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d5894b9-5035-4464-8f52-42cf46cc95c4-serving-cert\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.733138 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.733104 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce1628fd-5991-4d14-b958-9f1d28e671be-config\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.733262 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.733152 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7d5894b9-5035-4464-8f52-42cf46cc95c4-tmp\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.733262 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.733252 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7d5894b9-5035-4464-8f52-42cf46cc95c4-snapshots\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.733362 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.733262 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj2gv\" (UniqueName: \"kubernetes.io/projected/b772f568-0724-4daf-8d77-852eb2ee868a-kube-api-access-kj2gv\") pod \"network-check-source-869dcfcdcd-4gcz4\" (UID: \"b772f568-0724-4daf-8d77-852eb2ee868a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4gcz4" Jul 09 14:32:58.733418 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.733366 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ae68db00-049e-481a-9113-1e3db992ddec-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:32:58.733418 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.733382 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5894b9-5035-4464-8f52-42cf46cc95c4-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.733642 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.733622 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7d5894b9-5035-4464-8f52-42cf46cc95c4-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.737101 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.737073 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7d5894b9-5035-4464-8f52-42cf46cc95c4-serving-cert\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.741486 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.741452 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6t4r\" (UniqueName: \"kubernetes.io/projected/ae68db00-049e-481a-9113-1e3db992ddec-kube-api-access-n6t4r\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:32:58.742236 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.742218 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67fhg\" (UniqueName: \"kubernetes.io/projected/7d5894b9-5035-4464-8f52-42cf46cc95c4-kube-api-access-67fhg\") pod \"insights-operator-68d9dd94cf-mlmrr\" (UID: \"7d5894b9-5035-4464-8f52-42cf46cc95c4\") " pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.773496 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.773470 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:32:58.784240 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.784219 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" Jul 09 14:32:58.834090 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.834059 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1628fd-5991-4d14-b958-9f1d28e671be-trusted-ca\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.834202 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.834124 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce1628fd-5991-4d14-b958-9f1d28e671be-config\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.834202 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.834143 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj2gv\" (UniqueName: \"kubernetes.io/projected/b772f568-0724-4daf-8d77-852eb2ee868a-kube-api-access-kj2gv\") pod \"network-check-source-869dcfcdcd-4gcz4\" (UID: \"b772f568-0724-4daf-8d77-852eb2ee868a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4gcz4" Jul 09 14:32:58.834202 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.834169 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce1628fd-5991-4d14-b958-9f1d28e671be-serving-cert\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.834382 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.834204 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72cbf\" (UniqueName: \"kubernetes.io/projected/ce1628fd-5991-4d14-b958-9f1d28e671be-kube-api-access-72cbf\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.834966 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.834943 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ce1628fd-5991-4d14-b958-9f1d28e671be-config\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.835129 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.835113 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ce1628fd-5991-4d14-b958-9f1d28e671be-trusted-ca\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.836414 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.836396 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ce1628fd-5991-4d14-b958-9f1d28e671be-serving-cert\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.843188 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.843168 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72cbf\" (UniqueName: \"kubernetes.io/projected/ce1628fd-5991-4d14-b958-9f1d28e671be-kube-api-access-72cbf\") pod \"console-operator-7866497494-vphpl\" (UID: \"ce1628fd-5991-4d14-b958-9f1d28e671be\") " pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.843357 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.843336 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj2gv\" (UniqueName: \"kubernetes.io/projected/b772f568-0724-4daf-8d77-852eb2ee868a-kube-api-access-kj2gv\") pod \"network-check-source-869dcfcdcd-4gcz4\" (UID: \"b772f568-0724-4daf-8d77-852eb2ee868a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4gcz4" Jul 09 14:32:58.867508 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.867485 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4gcz4" Jul 09 14:32:58.883283 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.883257 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:32:58.948066 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:58.948040 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-mlmrr"] Jul 09 14:32:58.951999 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:58.951956 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d5894b9_5035_4464_8f52_42cf46cc95c4.slice/crio-d0b47345d590b15fdb359a38b78ee53c593f646d20b2108d6cc6f272791acf85 WatchSource:0}: Error finding container d0b47345d590b15fdb359a38b78ee53c593f646d20b2108d6cc6f272791acf85: Status 404 returned error can't find the container with id d0b47345d590b15fdb359a38b78ee53c593f646d20b2108d6cc6f272791acf85 Jul 09 14:32:59.031202 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:59.031176 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4gcz4"] Jul 09 14:32:59.035042 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:59.035017 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb772f568_0724_4daf_8d77_852eb2ee868a.slice/crio-30e1f34da72296dda5646bcb9355cefac1eaf05b9207f22b868be18497a6a17d WatchSource:0}: Error finding container 30e1f34da72296dda5646bcb9355cefac1eaf05b9207f22b868be18497a6a17d: Status 404 returned error can't find the container with id 30e1f34da72296dda5646bcb9355cefac1eaf05b9207f22b868be18497a6a17d Jul 09 14:32:59.048048 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:59.048023 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-vphpl"] Jul 09 14:32:59.052032 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:32:59.052012 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce1628fd_5991_4d14_b958_9f1d28e671be.slice/crio-05db99b66d841e919bbb10cf0ea4cf959743c34f7cb97ddbed3091d3b16123b3 WatchSource:0}: Error finding container 05db99b66d841e919bbb10cf0ea4cf959743c34f7cb97ddbed3091d3b16123b3: Status 404 returned error can't find the container with id 05db99b66d841e919bbb10cf0ea4cf959743c34f7cb97ddbed3091d3b16123b3 Jul 09 14:32:59.236251 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:59.236221 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:32:59.236443 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:59.236368 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:32:59.236443 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:32:59.236432 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls podName:ae68db00-049e-481a-9113-1e3db992ddec nodeName:}" failed. No retries permitted until 2026-07-09 14:33:00.236416304 +0000 UTC m=+60.438343446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5ksp8" (UID: "ae68db00-049e-481a-9113-1e3db992ddec") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:32:59.452895 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:59.452859 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vphpl" event={"ID":"ce1628fd-5991-4d14-b958-9f1d28e671be","Type":"ContainerStarted","Data":"05db99b66d841e919bbb10cf0ea4cf959743c34f7cb97ddbed3091d3b16123b3"} Jul 09 14:32:59.454311 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:59.454284 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4gcz4" event={"ID":"b772f568-0724-4daf-8d77-852eb2ee868a","Type":"ContainerStarted","Data":"30e1f34da72296dda5646bcb9355cefac1eaf05b9207f22b868be18497a6a17d"} Jul 09 14:32:59.455286 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:32:59.455262 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" event={"ID":"7d5894b9-5035-4464-8f52-42cf46cc95c4","Type":"ContainerStarted","Data":"d0b47345d590b15fdb359a38b78ee53c593f646d20b2108d6cc6f272791acf85"} Jul 09 14:33:00.243845 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:00.243465 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:33:00.243845 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:00.243825 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:33:00.244142 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:00.243887 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls podName:ae68db00-049e-481a-9113-1e3db992ddec nodeName:}" failed. No retries permitted until 2026-07-09 14:33:02.243872273 +0000 UTC m=+62.445799416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5ksp8" (UID: "ae68db00-049e-481a-9113-1e3db992ddec") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:33:01.405699 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:01.405661 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:01.507700 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:01.507662 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:02.259173 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:02.259135 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:33:02.259366 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:02.259281 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:33:02.259366 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:02.259341 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls podName:ae68db00-049e-481a-9113-1e3db992ddec nodeName:}" failed. No retries permitted until 2026-07-09 14:33:06.259321853 +0000 UTC m=+66.461248996 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5ksp8" (UID: "ae68db00-049e-481a-9113-1e3db992ddec") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:33:03.360120 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.360094 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:03.465263 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.465181 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:03.468416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.468398 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vphpl_ce1628fd-5991-4d14-b958-9f1d28e671be/console-operator/0.log" Jul 09 14:33:03.468514 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.468434 2570 generic.go:356] "Generic (PLEG): container finished" podID="ce1628fd-5991-4d14-b958-9f1d28e671be" containerID="d770e25a67a13174ac63158c1628577ccc901486a0ff2b6ad13c963306bd773c" exitCode=255 Jul 09 14:33:03.468514 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.468466 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vphpl" event={"ID":"ce1628fd-5991-4d14-b958-9f1d28e671be","Type":"ContainerDied","Data":"d770e25a67a13174ac63158c1628577ccc901486a0ff2b6ad13c963306bd773c"} Jul 09 14:33:03.468785 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.468755 2570 scope.go:117] "RemoveContainer" containerID="d770e25a67a13174ac63158c1628577ccc901486a0ff2b6ad13c963306bd773c" Jul 09 14:33:03.470420 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.470099 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4gcz4" event={"ID":"b772f568-0724-4daf-8d77-852eb2ee868a","Type":"ContainerStarted","Data":"61e9ef8e30ed566ff4117815f985ea0c89ed2e794f7d02815731eafe3b890735"} Jul 09 14:33:03.471653 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.471635 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" event={"ID":"7d5894b9-5035-4464-8f52-42cf46cc95c4","Type":"ContainerStarted","Data":"b0e46dce1ee5ad5b4149db0f38f3cb11eb494781df71022c9fc6bfb6dff61b04"} Jul 09 14:33:03.541407 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.541345 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4gcz4" podStartSLOduration=1.345633203 podStartE2EDuration="5.541324014s" totalImagesPullingTime="4.195690811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:03.54038423 +0000 UTC m=+63.742311395" watchObservedRunningTime="2026-07-09 14:33:03.541324014 +0000 UTC m=+63.743251178" Jul 09 14:33:03.563271 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.563201 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" podStartSLOduration=1.289518365 podStartE2EDuration="5.563181804s" totalImagesPullingTime="4.273663439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:03.56241277 +0000 UTC m=+63.764339946" watchObservedRunningTime="2026-07-09 14:33:03.563181804 +0000 UTC m=+63.765108970" Jul 09 14:33:03.593010 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.592982 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t"] Jul 09 14:33:03.619135 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.608771 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t" Jul 09 14:33:03.619135 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.613074 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:03.619135 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.613095 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t"] Jul 09 14:33:03.619135 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.613435 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ggtnl\"" Jul 09 14:33:03.619135 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.613680 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 14:33:03.619135 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.613706 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 14:33:03.670855 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.670827 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bhs9\" (UniqueName: \"kubernetes.io/projected/c2de977a-694e-4827-9bd1-593dc389ede6-kube-api-access-5bhs9\") pod \"migrator-7f59b54f6c-7pd6t\" (UID: \"c2de977a-694e-4827-9bd1-593dc389ede6\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t" Jul 09 14:33:03.691232 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.691206 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:03.771595 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.771499 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bhs9\" (UniqueName: \"kubernetes.io/projected/c2de977a-694e-4827-9bd1-593dc389ede6-kube-api-access-5bhs9\") pod \"migrator-7f59b54f6c-7pd6t\" (UID: \"c2de977a-694e-4827-9bd1-593dc389ede6\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t" Jul 09 14:33:03.780562 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.780512 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bhs9\" (UniqueName: \"kubernetes.io/projected/c2de977a-694e-4827-9bd1-593dc389ede6-kube-api-access-5bhs9\") pod \"migrator-7f59b54f6c-7pd6t\" (UID: \"c2de977a-694e-4827-9bd1-593dc389ede6\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t" Jul 09 14:33:03.935707 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:03.935669 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t" Jul 09 14:33:04.075258 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.075224 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t"] Jul 09 14:33:04.079177 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:04.079154 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2de977a_694e_4827_9bd1_593dc389ede6.slice/crio-e20e7875bc285a4d20757aa5b20fd6a28e97e26c3cbbabda16f09b7b91b0f4c4 WatchSource:0}: Error finding container e20e7875bc285a4d20757aa5b20fd6a28e97e26c3cbbabda16f09b7b91b0f4c4: Status 404 returned error can't find the container with id e20e7875bc285a4d20757aa5b20fd6a28e97e26c3cbbabda16f09b7b91b0f4c4 Jul 09 14:33:04.142419 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.142385 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:04.264566 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.264532 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:04.391511 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.391427 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vn2j9" Jul 09 14:33:04.477034 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.477007 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vphpl_ce1628fd-5991-4d14-b958-9f1d28e671be/console-operator/1.log" Jul 09 14:33:04.477442 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.477425 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vphpl_ce1628fd-5991-4d14-b958-9f1d28e671be/console-operator/0.log" Jul 09 14:33:04.477534 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.477467 2570 generic.go:356] "Generic (PLEG): container finished" podID="ce1628fd-5991-4d14-b958-9f1d28e671be" containerID="9ebe59abad12da9a4aff0d781e756892f1f1b200f83597390e28fcce4dd65d66" exitCode=255 Jul 09 14:33:04.477590 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.477568 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vphpl" event={"ID":"ce1628fd-5991-4d14-b958-9f1d28e671be","Type":"ContainerDied","Data":"9ebe59abad12da9a4aff0d781e756892f1f1b200f83597390e28fcce4dd65d66"} Jul 09 14:33:04.477649 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.477627 2570 scope.go:117] "RemoveContainer" containerID="d770e25a67a13174ac63158c1628577ccc901486a0ff2b6ad13c963306bd773c" Jul 09 14:33:04.478275 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.477900 2570 scope.go:117] "RemoveContainer" containerID="9ebe59abad12da9a4aff0d781e756892f1f1b200f83597390e28fcce4dd65d66" Jul 09 14:33:04.478275 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:04.478068 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vphpl_openshift-console-operator(ce1628fd-5991-4d14-b958-9f1d28e671be)\"" pod="openshift-console-operator/console-operator-7866497494-vphpl" podUID="ce1628fd-5991-4d14-b958-9f1d28e671be" Jul 09 14:33:04.479289 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.479262 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t" event={"ID":"c2de977a-694e-4827-9bd1-593dc389ede6","Type":"ContainerStarted","Data":"e20e7875bc285a4d20757aa5b20fd6a28e97e26c3cbbabda16f09b7b91b0f4c4"} Jul 09 14:33:04.523344 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.523320 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:04.584445 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.584417 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:04.722261 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.722227 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:04.874511 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.874475 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xrzxn"] Jul 09 14:33:04.877959 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.877933 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:04.881086 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.881058 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 14:33:04.881299 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.881272 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 14:33:04.881432 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.881302 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-qwk62\"" Jul 09 14:33:04.893853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.893782 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xrzxn"] Jul 09 14:33:04.918782 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.918755 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:04.981738 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.981664 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e92e928a-74d2-4243-9828-224a2700397d-crio-socket\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:04.981738 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.981704 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e92e928a-74d2-4243-9828-224a2700397d-data-volume\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:04.981899 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.981747 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:04.981899 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.981762 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:04.981899 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.981799 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cq644\" (UniqueName: \"kubernetes.io/projected/e92e928a-74d2-4243-9828-224a2700397d-kube-api-access-cq644\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:04.987455 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:04.987427 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:05.082261 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.082219 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:05.082261 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.082253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:05.082490 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:05.082357 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:33:05.082490 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:05.082369 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:05.082490 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:05.082437 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm podName:e92e928a-74d2-4243-9828-224a2700397d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:05.582416288 +0000 UTC m=+65.784343440 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xrzxn" (UID: "e92e928a-74d2-4243-9828-224a2700397d") : configmap "kube-rbac-proxy" not found Jul 09 14:33:05.082490 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.082461 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cq644\" (UniqueName: \"kubernetes.io/projected/e92e928a-74d2-4243-9828-224a2700397d-kube-api-access-cq644\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:05.082744 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:05.082497 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls podName:e92e928a-74d2-4243-9828-224a2700397d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:05.582478152 +0000 UTC m=+65.784405294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xrzxn" (UID: "e92e928a-74d2-4243-9828-224a2700397d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:05.082744 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.082606 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e92e928a-74d2-4243-9828-224a2700397d-crio-socket\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:05.082744 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.082707 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e92e928a-74d2-4243-9828-224a2700397d-data-volume\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:05.082744 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.082733 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e92e928a-74d2-4243-9828-224a2700397d-crio-socket\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:05.083080 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.083057 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e92e928a-74d2-4243-9828-224a2700397d-data-volume\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:05.092134 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.092108 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cq644\" (UniqueName: \"kubernetes.io/projected/e92e928a-74d2-4243-9828-224a2700397d-kube-api-access-cq644\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:05.482978 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.482952 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vphpl_ce1628fd-5991-4d14-b958-9f1d28e671be/console-operator/1.log" Jul 09 14:33:05.483397 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.483250 2570 scope.go:117] "RemoveContainer" containerID="9ebe59abad12da9a4aff0d781e756892f1f1b200f83597390e28fcce4dd65d66" Jul 09 14:33:05.483397 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:05.483387 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vphpl_openshift-console-operator(ce1628fd-5991-4d14-b958-9f1d28e671be)\"" pod="openshift-console-operator/console-operator-7866497494-vphpl" podUID="ce1628fd-5991-4d14-b958-9f1d28e671be" Jul 09 14:33:05.585952 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.585920 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:05.586127 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.585963 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:05.586127 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:05.586033 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:33:05.586127 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:05.586055 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:05.586127 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:05.586103 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm podName:e92e928a-74d2-4243-9828-224a2700397d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:06.586083125 +0000 UTC m=+66.788010292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xrzxn" (UID: "e92e928a-74d2-4243-9828-224a2700397d") : configmap "kube-rbac-proxy" not found Jul 09 14:33:05.586127 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:05.586120 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls podName:e92e928a-74d2-4243-9828-224a2700397d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:06.586112145 +0000 UTC m=+66.788039287 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xrzxn" (UID: "e92e928a-74d2-4243-9828-224a2700397d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:05.779419 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.779337 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:05.849465 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.849427 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:05.888622 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.888588 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:33:05.891454 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.891432 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:33:05.901942 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.901919 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cbd60921-6ec5-48e9-9b52-cdcf119ce07e-original-pull-secret\") pod \"global-pull-secret-syncer-84t2b\" (UID: \"cbd60921-6ec5-48e9-9b52-cdcf119ce07e\") " pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:33:05.989568 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.989513 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:33:05.992229 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:05.992210 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:33:06.000645 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:06.000626 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 14:33:06.000725 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:06.000691 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs podName:ec8f4eb3-372d-4095-98fc-1fe2c8483150 nodeName:}" failed. No retries permitted until 2026-07-09 14:34:10.000671447 +0000 UTC m=+130.202598597 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs") pod "network-metrics-daemon-cxzs4" (UID: "ec8f4eb3-372d-4095-98fc-1fe2c8483150") : secret "metrics-daemon-secret" not found Jul 09 14:33:06.045331 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.045309 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-84t2b" Jul 09 14:33:06.089920 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.089893 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flwxq\" (UniqueName: \"kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq\") pod \"network-check-target-9l8rh\" (UID: \"2a37909b-4421-4481-853d-7e88f330aa94\") " pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:33:06.093283 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.093261 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flwxq\" (UniqueName: \"kubernetes.io/projected/2a37909b-4421-4481-853d-7e88f330aa94-kube-api-access-flwxq\") pod \"network-check-target-9l8rh\" (UID: \"2a37909b-4421-4481-853d-7e88f330aa94\") " pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:33:06.183478 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.183453 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-84t2b"] Jul 09 14:33:06.185664 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:06.185638 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd60921_6ec5_48e9_9b52_cdcf119ce07e.slice/crio-11b1f79ebea9eadac6f48327e11015aa1265e0f0483161368675bf3d660a282a WatchSource:0}: Error finding container 11b1f79ebea9eadac6f48327e11015aa1265e0f0483161368675bf3d660a282a: Status 404 returned error can't find the container with id 11b1f79ebea9eadac6f48327e11015aa1265e0f0483161368675bf3d660a282a Jul 09 14:33:06.291387 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.291329 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:33:06.291496 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:06.291459 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:33:06.291573 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:06.291530 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls podName:ae68db00-049e-481a-9113-1e3db992ddec nodeName:}" failed. No retries permitted until 2026-07-09 14:33:14.2915005 +0000 UTC m=+74.493427646 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5ksp8" (UID: "ae68db00-049e-481a-9113-1e3db992ddec") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:33:06.358239 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.358212 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-l2qn4\"" Jul 09 14:33:06.365545 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.365511 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:33:06.488888 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.488853 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t" event={"ID":"c2de977a-694e-4827-9bd1-593dc389ede6","Type":"ContainerStarted","Data":"b7071d095440f81e4be2bccba5ec94b25467aef2f0b61115283922db6fa6cb02"} Jul 09 14:33:06.489224 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.488922 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t" event={"ID":"c2de977a-694e-4827-9bd1-593dc389ede6","Type":"ContainerStarted","Data":"36113a085a0467d687a48247d382d2222f4f84eeebc43a5f116d796cfef9cf3e"} Jul 09 14:33:06.489977 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.489957 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-84t2b" event={"ID":"cbd60921-6ec5-48e9-9b52-cdcf119ce07e","Type":"ContainerStarted","Data":"11b1f79ebea9eadac6f48327e11015aa1265e0f0483161368675bf3d660a282a"} Jul 09 14:33:06.508545 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.508492 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-7pd6t" podStartSLOduration=1.593031593 podStartE2EDuration="3.508479108s" totalImagesPullingTime="1.915447515s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:33:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:06.50773642 +0000 UTC m=+66.709663587" watchObservedRunningTime="2026-07-09 14:33:06.508479108 +0000 UTC m=+66.710406271" Jul 09 14:33:06.513535 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.513498 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9l8rh"] Jul 09 14:33:06.516830 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:06.516805 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a37909b_4421_4481_853d_7e88f330aa94.slice/crio-a69ce5278ace4f926ecc0ef7a34e255d09daf2652cb2b782bd0b9bcba0616c05 WatchSource:0}: Error finding container a69ce5278ace4f926ecc0ef7a34e255d09daf2652cb2b782bd0b9bcba0616c05: Status 404 returned error can't find the container with id a69ce5278ace4f926ecc0ef7a34e255d09daf2652cb2b782bd0b9bcba0616c05 Jul 09 14:33:06.593731 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.593711 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:06.593823 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.593738 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:06.593865 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:06.593826 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:33:06.593905 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:06.593892 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:06.593938 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:06.593894 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm podName:e92e928a-74d2-4243-9828-224a2700397d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:08.593880428 +0000 UTC m=+68.795807569 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xrzxn" (UID: "e92e928a-74d2-4243-9828-224a2700397d") : configmap "kube-rbac-proxy" not found Jul 09 14:33:06.593974 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:06.593950 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls podName:e92e928a-74d2-4243-9828-224a2700397d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:08.593936876 +0000 UTC m=+68.795864017 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xrzxn" (UID: "e92e928a-74d2-4243-9828-224a2700397d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:06.744597 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:06.744561 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:07.495949 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:07.495910 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9l8rh" event={"ID":"2a37909b-4421-4481-853d-7e88f330aa94","Type":"ContainerStarted","Data":"9731d21283fe590d8fb268c904b752a5bd4249a00507383f1f3d832df1af492f"} Jul 09 14:33:07.496364 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:07.495968 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9l8rh" event={"ID":"2a37909b-4421-4481-853d-7e88f330aa94","Type":"ContainerStarted","Data":"a69ce5278ace4f926ecc0ef7a34e255d09daf2652cb2b782bd0b9bcba0616c05"} Jul 09 14:33:07.513652 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:07.513600 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9l8rh" podStartSLOduration=67.513580958 podStartE2EDuration="1m7.513580958s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:07.513148484 +0000 UTC m=+67.715075649" watchObservedRunningTime="2026-07-09 14:33:07.513580958 +0000 UTC m=+67.715508125" Jul 09 14:33:07.667489 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:07.667464 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nfh5q_3eecab63-82b5-4f23-a147-b1113057ad00/dns-node-resolver/0.log" Jul 09 14:33:08.499384 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:08.499353 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:33:08.608453 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:08.608413 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:08.608652 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:08.608464 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:08.608652 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:08.608563 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:33:08.608652 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:08.608629 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm podName:e92e928a-74d2-4243-9828-224a2700397d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:12.608612634 +0000 UTC m=+72.810539777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xrzxn" (UID: "e92e928a-74d2-4243-9828-224a2700397d") : configmap "kube-rbac-proxy" not found Jul 09 14:33:08.608652 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:08.608645 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:08.608858 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:08.608706 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls podName:e92e928a-74d2-4243-9828-224a2700397d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:12.608688669 +0000 UTC m=+72.810615826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xrzxn" (UID: "e92e928a-74d2-4243-9828-224a2700397d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:08.860254 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:08.860187 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vlkd9_a346c634-df16-4e2d-af0b-7408c90d6735/node-ca/0.log" Jul 09 14:33:08.884352 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:08.884329 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:33:08.884512 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:08.884396 2570 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:33:08.884818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:08.884791 2570 scope.go:117] "RemoveContainer" containerID="9ebe59abad12da9a4aff0d781e756892f1f1b200f83597390e28fcce4dd65d66" Jul 09 14:33:08.884989 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:08.884968 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-vphpl_openshift-console-operator(ce1628fd-5991-4d14-b958-9f1d28e671be)\"" pod="openshift-console-operator/console-operator-7866497494-vphpl" podUID="ce1628fd-5991-4d14-b958-9f1d28e671be" Jul 09 14:33:09.662207 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:09.662168 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r5fq4_e288aaaa-06b4-45bd-a94b-b8e785e1e1fa/serve-healthcheck-canary/0.log" Jul 09 14:33:09.860439 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:09.860413 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-7pd6t_c2de977a-694e-4827-9bd1-593dc389ede6/migrator/0.log" Jul 09 14:33:09.876374 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:09.876338 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:10.061187 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:10.061156 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-7pd6t_c2de977a-694e-4827-9bd1-593dc389ede6/graceful-termination/0.log" Jul 09 14:33:10.842625 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:10.842590 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:10.988313 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:10.988276 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:11.029124 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:11.029098 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:33:11.029279 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:11.029239 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:33:11.029322 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:11.029297 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls podName:a8a41997-1d04-466b-be20-b5c118b42b46 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:43.029282169 +0000 UTC m=+103.231209315 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls") pod "dns-default-nl64z" (UID: "a8a41997-1d04-466b-be20-b5c118b42b46") : secret "dns-default-metrics-tls" not found Jul 09 14:33:11.169590 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:11.169554 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:11.273986 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:11.273903 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:11.384965 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:11.384932 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:11.481623 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:11.481590 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:11.514009 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:11.513975 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-84t2b" event={"ID":"cbd60921-6ec5-48e9-9b52-cdcf119ce07e","Type":"ContainerStarted","Data":"85f5dcb3b3a94b2b7dfb44b2099b0e709dacd22a09395e895e93e72d3208742a"} Jul 09 14:33:11.530128 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:11.530038 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-84t2b" podStartSLOduration=67.044282147 podStartE2EDuration="1m11.530021001s" totalImagesPullingTime="4.485738854s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:11.529254693 +0000 UTC m=+71.731181857" watchObservedRunningTime="2026-07-09 14:33:11.530021001 +0000 UTC m=+71.731948174" Jul 09 14:33:11.740533 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:11.740483 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:11.938262 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:11.938228 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:12.640036 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:12.640000 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:12.640036 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:12.640035 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:12.640244 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:12.640118 2570 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:33:12.640244 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:12.640175 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm podName:e92e928a-74d2-4243-9828-224a2700397d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:20.640159021 +0000 UTC m=+80.842086163 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xrzxn" (UID: "e92e928a-74d2-4243-9828-224a2700397d") : configmap "kube-rbac-proxy" not found Jul 09 14:33:12.640244 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:12.640220 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:12.640341 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:12.640281 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls podName:e92e928a-74d2-4243-9828-224a2700397d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:20.640266454 +0000 UTC m=+80.842193619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xrzxn" (UID: "e92e928a-74d2-4243-9828-224a2700397d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:13.137229 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:13.137200 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:13.262662 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:13.262614 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:13.624719 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:13.624683 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:13.725385 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:13.725352 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:13.838511 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:13.838479 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:13.965276 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:13.965250 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:14.352931 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:14.352824 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:33:14.353287 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:14.352989 2570 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 14:33:14.353287 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:14.353056 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls podName:ae68db00-049e-481a-9113-1e3db992ddec nodeName:}" failed. No retries permitted until 2026-07-09 14:33:30.353038742 +0000 UTC m=+90.554965891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-5ksp8" (UID: "ae68db00-049e-481a-9113-1e3db992ddec") : secret "cluster-monitoring-operator-tls" not found Jul 09 14:33:14.539029 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:14.538999 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:14.652701 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:14.652619 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:14.937510 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:14.937464 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:15.136414 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:15.136386 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:15.542798 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:15.542762 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:15.740118 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:15.740082 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:16.139444 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:16.139408 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:16.754020 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:16.753992 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:16.967949 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:16.967913 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:17.170330 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:17.170244 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:17.303216 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:17.303184 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:17.539140 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:17.539106 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:17.735828 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:17.735795 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:18.135662 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:18.135633 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:18.943482 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:18.943447 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:19.137609 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:19.137582 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:19.546627 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:19.546581 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:19.780056 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:19.780010 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:20.342049 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:20.342011 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:20.702890 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:20.702858 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:20.702890 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:20.702892 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:20.703106 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:20.703033 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:33:20.703144 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:20.703126 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls podName:e92e928a-74d2-4243-9828-224a2700397d nodeName:}" failed. No retries permitted until 2026-07-09 14:33:36.703111784 +0000 UTC m=+96.905038927 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xrzxn" (UID: "e92e928a-74d2-4243-9828-224a2700397d") : secret "insights-runtime-extractor-tls" not found Jul 09 14:33:20.703429 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:20.703408 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e92e928a-74d2-4243-9828-224a2700397d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:20.742581 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:20.742438 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:20.937989 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:20.937955 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:21.338852 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:21.338818 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:21.541257 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:21.541225 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:22.278413 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:22.278375 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:22.382625 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:22.382598 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:23.234190 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:23.234161 2570 scope.go:117] "RemoveContainer" containerID="9ebe59abad12da9a4aff0d781e756892f1f1b200f83597390e28fcce4dd65d66" Jul 09 14:33:23.556129 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:23.556056 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vphpl_ce1628fd-5991-4d14-b958-9f1d28e671be/console-operator/1.log" Jul 09 14:33:23.556129 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:23.556113 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-vphpl" event={"ID":"ce1628fd-5991-4d14-b958-9f1d28e671be","Type":"ContainerStarted","Data":"bf9f569b49a67028dd7aa6ad10f4d66251d62932b0872100cb511848b06a82de"} Jul 09 14:33:23.556444 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:23.556423 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:33:23.575454 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:23.575386 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-vphpl" podStartSLOduration=21.403479452 podStartE2EDuration="25.575369951s" totalImagesPullingTime="4.171890499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:23.574322397 +0000 UTC m=+83.776249566" watchObservedRunningTime="2026-07-09 14:33:23.575369951 +0000 UTC m=+83.777297115" Jul 09 14:33:23.859125 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:23.859048 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-vphpl" Jul 09 14:33:24.040127 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:24.040091 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:24.141277 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:24.141186 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:24.207549 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:24.207499 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:24.344788 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:24.344751 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:24.527131 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:24.527100 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:24.766386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:24.766348 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:24.966392 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:24.966360 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:25.052087 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:25.052054 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:25.940789 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:25.940753 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:26.127140 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:26.127104 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:26.352313 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:26.352230 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:26.456080 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:26.456044 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:26.617504 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:26.617419 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:27.757722 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.757685 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p"] Jul 09 14:33:27.761882 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.761859 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p" Jul 09 14:33:27.765608 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.765591 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 14:33:27.765845 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.765828 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 14:33:27.765941 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.765874 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 14:33:27.765941 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.765886 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 14:33:27.765941 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.765880 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-6b754\"" Jul 09 14:33:27.773622 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.773602 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p"] Jul 09 14:33:27.860788 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.860759 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8twfd\" (UniqueName: \"kubernetes.io/projected/7cf4ebf8-386e-473e-a5c8-6b25cf023dc6-kube-api-access-8twfd\") pod \"managed-serviceaccount-addon-agent-7c6f84d988-69g2p\" (UID: \"7cf4ebf8-386e-473e-a5c8-6b25cf023dc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p" Jul 09 14:33:27.860918 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.860811 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7cf4ebf8-386e-473e-a5c8-6b25cf023dc6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c6f84d988-69g2p\" (UID: \"7cf4ebf8-386e-473e-a5c8-6b25cf023dc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p" Jul 09 14:33:27.907513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.907485 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-755f7f4dcb-pnq46"] Jul 09 14:33:27.910427 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.910411 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:27.915013 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:27.914982 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"image-registry-755f7f4dcb-pnq46\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="47acb15f-51cb-45ae-ac7d-580226ce1d17" pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:27.915013 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.914992 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 14:33:27.915154 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.914998 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 14:33:27.915236 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:27.915216 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"registry-dockercfg-gcbfq\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-image-registry\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gcbfq\"" type="*v1.Secret" Jul 09 14:33:27.915299 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.915249 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 14:33:27.920656 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.920637 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 14:33:27.933292 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.933263 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:27.935026 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.935004 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755f7f4dcb-pnq46"] Jul 09 14:33:27.961178 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.961154 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47acb15f-51cb-45ae-ac7d-580226ce1d17-installation-pull-secrets\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:27.961279 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.961198 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8twfd\" (UniqueName: \"kubernetes.io/projected/7cf4ebf8-386e-473e-a5c8-6b25cf023dc6-kube-api-access-8twfd\") pod \"managed-serviceaccount-addon-agent-7c6f84d988-69g2p\" (UID: \"7cf4ebf8-386e-473e-a5c8-6b25cf023dc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p" Jul 09 14:33:27.961279 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.961225 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47acb15f-51cb-45ae-ac7d-580226ce1d17-registry-tls\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:27.961279 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.961262 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47acb15f-51cb-45ae-ac7d-580226ce1d17-ca-trust-extracted\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:27.961380 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.961279 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47acb15f-51cb-45ae-ac7d-580226ce1d17-bound-sa-token\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:27.961380 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.961300 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47acb15f-51cb-45ae-ac7d-580226ce1d17-image-registry-private-configuration\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:27.961380 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.961341 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7cf4ebf8-386e-473e-a5c8-6b25cf023dc6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c6f84d988-69g2p\" (UID: \"7cf4ebf8-386e-473e-a5c8-6b25cf023dc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p" Jul 09 14:33:27.961380 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.961375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47acb15f-51cb-45ae-ac7d-580226ce1d17-trusted-ca\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:27.961508 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.961397 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcvc4\" (UniqueName: \"kubernetes.io/projected/47acb15f-51cb-45ae-ac7d-580226ce1d17-kube-api-access-gcvc4\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:27.961508 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.961426 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47acb15f-51cb-45ae-ac7d-580226ce1d17-registry-certificates\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:27.964106 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.964083 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7cf4ebf8-386e-473e-a5c8-6b25cf023dc6-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7c6f84d988-69g2p\" (UID: \"7cf4ebf8-386e-473e-a5c8-6b25cf023dc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p" Jul 09 14:33:27.970533 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:27.970495 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8twfd\" (UniqueName: \"kubernetes.io/projected/7cf4ebf8-386e-473e-a5c8-6b25cf023dc6-kube-api-access-8twfd\") pod \"managed-serviceaccount-addon-agent-7c6f84d988-69g2p\" (UID: \"7cf4ebf8-386e-473e-a5c8-6b25cf023dc6\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p" Jul 09 14:33:28.032820 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.032760 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:28.062492 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.062470 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47acb15f-51cb-45ae-ac7d-580226ce1d17-trusted-ca\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.062598 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.062507 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcvc4\" (UniqueName: \"kubernetes.io/projected/47acb15f-51cb-45ae-ac7d-580226ce1d17-kube-api-access-gcvc4\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.062598 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.062566 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47acb15f-51cb-45ae-ac7d-580226ce1d17-registry-certificates\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.062721 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.062627 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47acb15f-51cb-45ae-ac7d-580226ce1d17-installation-pull-secrets\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.062721 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.062674 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47acb15f-51cb-45ae-ac7d-580226ce1d17-registry-tls\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.062721 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.062707 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47acb15f-51cb-45ae-ac7d-580226ce1d17-ca-trust-extracted\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.062873 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.062732 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47acb15f-51cb-45ae-ac7d-580226ce1d17-bound-sa-token\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.062873 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.062769 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47acb15f-51cb-45ae-ac7d-580226ce1d17-image-registry-private-configuration\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.063261 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.063228 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/47acb15f-51cb-45ae-ac7d-580226ce1d17-ca-trust-extracted\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.063535 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.063466 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/47acb15f-51cb-45ae-ac7d-580226ce1d17-trusted-ca\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.063535 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.063481 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/47acb15f-51cb-45ae-ac7d-580226ce1d17-registry-certificates\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.065130 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.065112 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/47acb15f-51cb-45ae-ac7d-580226ce1d17-image-registry-private-configuration\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.065741 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.065721 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/47acb15f-51cb-45ae-ac7d-580226ce1d17-installation-pull-secrets\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.065822 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.065807 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/47acb15f-51cb-45ae-ac7d-580226ce1d17-registry-tls\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.072276 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.072251 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcvc4\" (UniqueName: \"kubernetes.io/projected/47acb15f-51cb-45ae-ac7d-580226ce1d17-kube-api-access-gcvc4\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.072541 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.072501 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/47acb15f-51cb-45ae-ac7d-580226ce1d17-bound-sa-token\") pod \"image-registry-755f7f4dcb-pnq46\" (UID: \"47acb15f-51cb-45ae-ac7d-580226ce1d17\") " pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.086407 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.086387 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p" Jul 09 14:33:28.212102 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.212073 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p"] Jul 09 14:33:28.216255 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:28.216230 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cf4ebf8_386e_473e_a5c8_6b25cf023dc6.slice/crio-34e80b82908c9bf7d415d1ce39b4cc9addc7a7ccb0b020c105084f19b610cf55 WatchSource:0}: Error finding container 34e80b82908c9bf7d415d1ce39b4cc9addc7a7ccb0b020c105084f19b610cf55: Status 404 returned error can't find the container with id 34e80b82908c9bf7d415d1ce39b4cc9addc7a7ccb0b020c105084f19b610cf55 Jul 09 14:33:28.577217 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.577179 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p" event={"ID":"7cf4ebf8-386e-473e-a5c8-6b25cf023dc6","Type":"ContainerStarted","Data":"34e80b82908c9bf7d415d1ce39b4cc9addc7a7ccb0b020c105084f19b610cf55"} Jul 09 14:33:28.728106 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.728072 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gcbfq\"" Jul 09 14:33:28.730077 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.730060 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:28.861560 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:28.861389 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-755f7f4dcb-pnq46"] Jul 09 14:33:28.864320 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:28.864294 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47acb15f_51cb_45ae_ac7d_580226ce1d17.slice/crio-31f8ff9747ecc720989bdf3555a73345b64ddc2a7e51bfbeb110dc69ac1bb65f WatchSource:0}: Error finding container 31f8ff9747ecc720989bdf3555a73345b64ddc2a7e51bfbeb110dc69ac1bb65f: Status 404 returned error can't find the container with id 31f8ff9747ecc720989bdf3555a73345b64ddc2a7e51bfbeb110dc69ac1bb65f Jul 09 14:33:29.582109 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:29.582073 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" event={"ID":"47acb15f-51cb-45ae-ac7d-580226ce1d17","Type":"ContainerStarted","Data":"9a1eccbd3eb7caf4c487f77fcb70817a6150d6b426148110f3a5688a21e2b0c9"} Jul 09 14:33:29.582308 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:29.582128 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" event={"ID":"47acb15f-51cb-45ae-ac7d-580226ce1d17","Type":"ContainerStarted","Data":"31f8ff9747ecc720989bdf3555a73345b64ddc2a7e51bfbeb110dc69ac1bb65f"} Jul 09 14:33:29.582308 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:29.582182 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:29.605981 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:29.605925 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" podStartSLOduration=2.605907493 podStartE2EDuration="2.605907493s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:33:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:29.605622851 +0000 UTC m=+89.807550016" watchObservedRunningTime="2026-07-09 14:33:29.605907493 +0000 UTC m=+89.807834656" Jul 09 14:33:30.384187 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:30.384154 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:33:30.386782 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:30.386755 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ae68db00-049e-481a-9113-1e3db992ddec-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-5ksp8\" (UID: \"ae68db00-049e-481a-9113-1e3db992ddec\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:33:30.525096 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:30.525065 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:30.567613 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:30.567585 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-w7z72\"" Jul 09 14:33:30.575712 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:30.575688 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" Jul 09 14:33:30.593166 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:30.593088 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:30.803179 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:30.803122 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8"] Jul 09 14:33:30.805287 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:30.805263 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae68db00_049e_481a_9113_1e3db992ddec.slice/crio-c0ad169c2f4d5f0f102fa1877029afbfe9a30adba940d0ba5ae24a0a1aac16db WatchSource:0}: Error finding container c0ad169c2f4d5f0f102fa1877029afbfe9a30adba940d0ba5ae24a0a1aac16db: Status 404 returned error can't find the container with id c0ad169c2f4d5f0f102fa1877029afbfe9a30adba940d0ba5ae24a0a1aac16db Jul 09 14:33:31.591566 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:31.591506 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" event={"ID":"ae68db00-049e-481a-9113-1e3db992ddec","Type":"ContainerStarted","Data":"c0ad169c2f4d5f0f102fa1877029afbfe9a30adba940d0ba5ae24a0a1aac16db"} Jul 09 14:33:31.593332 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:31.593293 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p" event={"ID":"7cf4ebf8-386e-473e-a5c8-6b25cf023dc6","Type":"ContainerStarted","Data":"4100c5b4f8219819ea385d56002b62f9c6fe75a2295c8dfc874475cb439e7c4b"} Jul 09 14:33:31.611034 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:31.610986 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7c6f84d988-69g2p" podStartSLOduration=2.092384568 podStartE2EDuration="4.610968381s" totalImagesPullingTime="2.518583813s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:33:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:31.610420745 +0000 UTC m=+91.812347908" watchObservedRunningTime="2026-07-09 14:33:31.610968381 +0000 UTC m=+91.812895548" Jul 09 14:33:31.762534 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:31.762471 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:31.863113 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:31.863043 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:33.138053 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:33.137972 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:33.238150 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:33.238106 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:33.342965 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:33.342921 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:33.582714 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:33.582674 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:33.600374 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:33.600343 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" event={"ID":"ae68db00-049e-481a-9113-1e3db992ddec","Type":"ContainerStarted","Data":"df44e887107f70fa96c77edda551a7e0edede2eb230ab38bbffdfafa9ca8a3a0"} Jul 09 14:33:33.621945 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:33.621905 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-5ksp8" podStartSLOduration=33.634662895 podStartE2EDuration="35.621890864s" totalImagesPullingTime="1.987227969s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:33.617303459 +0000 UTC m=+93.819230622" watchObservedRunningTime="2026-07-09 14:33:33.621890864 +0000 UTC m=+93.823818028" Jul 09 14:33:36.735833 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:36.735803 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:36.738261 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:36.738234 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e92e928a-74d2-4243-9828-224a2700397d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrzxn\" (UID: \"e92e928a-74d2-4243-9828-224a2700397d\") " pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:36.990269 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:36.990196 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xrzxn" Jul 09 14:33:37.148997 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:37.148962 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xrzxn"] Jul 09 14:33:37.152269 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:37.152240 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode92e928a_74d2_4243_9828_224a2700397d.slice/crio-add651a264507d20d0e6a23d78bf34f5f64b1fe608e4fb370325d3ea3bf79560 WatchSource:0}: Error finding container add651a264507d20d0e6a23d78bf34f5f64b1fe608e4fb370325d3ea3bf79560: Status 404 returned error can't find the container with id add651a264507d20d0e6a23d78bf34f5f64b1fe608e4fb370325d3ea3bf79560 Jul 09 14:33:37.335751 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:37.335659 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:37.419544 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:37.419498 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:37.614604 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:37.614542 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrzxn" event={"ID":"e92e928a-74d2-4243-9828-224a2700397d","Type":"ContainerStarted","Data":"add651a264507d20d0e6a23d78bf34f5f64b1fe608e4fb370325d3ea3bf79560"} Jul 09 14:33:37.644559 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:37.644509 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:39.509513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:39.509478 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9l8rh" Jul 09 14:33:40.115302 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:40.115261 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:40.185041 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:40.185002 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:40.758618 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:40.758560 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:40.859764 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:40.859723 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:41.636459 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:41.636436 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrzxn" event={"ID":"e92e928a-74d2-4243-9828-224a2700397d","Type":"ContainerStarted","Data":"854ab34d44d679aa8ab7313f75695b4494cc8c5401f111ecc358b3fad2f0d27c"} Jul 09 14:33:42.141264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.141193 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dfccb8697-rcqv9"] Jul 09 14:33:42.144492 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.144471 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.146990 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.146968 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 14:33:42.147850 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.147727 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 14:33:42.147850 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.147795 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dh6l6\"" Jul 09 14:33:42.148013 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.147935 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 14:33:42.148013 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.147957 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 14:33:42.148117 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.148021 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 14:33:42.148117 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.148084 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 14:33:42.148221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.148202 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 14:33:42.152557 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.152538 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 14:33:42.156428 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.156409 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dfccb8697-rcqv9"] Jul 09 14:33:42.284643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.284501 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-trusted-ca-bundle\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.284643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.284568 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-service-ca\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.284643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.284596 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-config\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.284643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.284622 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvh24\" (UniqueName: \"kubernetes.io/projected/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-kube-api-access-rvh24\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.284933 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.284661 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-oauth-config\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.284933 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.284690 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-oauth-serving-cert\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.284933 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.284819 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-serving-cert\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.385475 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.385442 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-trusted-ca-bundle\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.385674 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.385498 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-service-ca\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.385674 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.385540 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-config\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.385674 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.385564 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvh24\" (UniqueName: \"kubernetes.io/projected/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-kube-api-access-rvh24\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.385674 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.385602 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-oauth-config\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.385674 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.385630 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-oauth-serving-cert\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.385674 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.385672 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-serving-cert\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.386371 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.386342 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-service-ca\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.387977 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.387159 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-config\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.387977 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.387415 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-oauth-serving-cert\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.388158 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.388032 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-trusted-ca-bundle\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.389170 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.389140 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-serving-cert\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.389170 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.389155 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-oauth-config\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.395181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.395121 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvh24\" (UniqueName: \"kubernetes.io/projected/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-kube-api-access-rvh24\") pod \"console-7dfccb8697-rcqv9\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.423786 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.423752 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:42.455608 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.455583 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:42.523965 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.523929 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:42.596299 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.596111 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dfccb8697-rcqv9"] Jul 09 14:33:42.599408 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.599381 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:42.601885 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:42.601849 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2376b7b9_dc32_40a6_bcc9_f8f59ab09a51.slice/crio-17fb239863e622fb7a26036a8a61985ee25762e845fd299e12b9feaf274046bd WatchSource:0}: Error finding container 17fb239863e622fb7a26036a8a61985ee25762e845fd299e12b9feaf274046bd: Status 404 returned error can't find the container with id 17fb239863e622fb7a26036a8a61985ee25762e845fd299e12b9feaf274046bd Jul 09 14:33:42.646208 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.646136 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfccb8697-rcqv9" event={"ID":"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51","Type":"ContainerStarted","Data":"17fb239863e622fb7a26036a8a61985ee25762e845fd299e12b9feaf274046bd"} Jul 09 14:33:42.648122 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.648091 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrzxn" event={"ID":"e92e928a-74d2-4243-9828-224a2700397d","Type":"ContainerStarted","Data":"f5b81559766da356ea2578b083ad88abc5ea1a76d335bda0af15fd2a0bc883ca"} Jul 09 14:33:42.755500 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.755462 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:42.851685 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:42.851651 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:43.093980 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:43.093946 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:33:43.096469 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:43.096438 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a8a41997-1d04-466b-be20-b5c118b42b46-metrics-tls\") pod \"dns-default-nl64z\" (UID: \"a8a41997-1d04-466b-be20-b5c118b42b46\") " pod="openshift-dns/dns-default-nl64z" Jul 09 14:33:43.125184 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:43.125159 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xkg97\"" Jul 09 14:33:43.133357 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:43.133340 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-nl64z" Jul 09 14:33:44.545750 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:44.545721 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-nl64z"] Jul 09 14:33:44.560484 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:44.560457 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8a41997_1d04_466b_be20_b5c118b42b46.slice/crio-0493f5446aa07031136d4109c084df398a1b5fb6572b65f9f93a002e223ff9a7 WatchSource:0}: Error finding container 0493f5446aa07031136d4109c084df398a1b5fb6572b65f9f93a002e223ff9a7: Status 404 returned error can't find the container with id 0493f5446aa07031136d4109c084df398a1b5fb6572b65f9f93a002e223ff9a7 Jul 09 14:33:44.658229 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:44.658163 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrzxn" event={"ID":"e92e928a-74d2-4243-9828-224a2700397d","Type":"ContainerStarted","Data":"74ae3a9c3fd58b5015d484b42419e6a5ba82bdd3c2a555cbc80a8759d972f98c"} Jul 09 14:33:44.659368 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:44.659330 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nl64z" event={"ID":"a8a41997-1d04-466b-be20-b5c118b42b46","Type":"ContainerStarted","Data":"0493f5446aa07031136d4109c084df398a1b5fb6572b65f9f93a002e223ff9a7"} Jul 09 14:33:44.679946 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:44.679898 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xrzxn" podStartSLOduration=33.378332721 podStartE2EDuration="40.679881891s" totalImagesPullingTime="7.30154917s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:33:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:44.678565774 +0000 UTC m=+104.880492939" watchObservedRunningTime="2026-07-09 14:33:44.679881891 +0000 UTC m=+104.881809054" Jul 09 14:33:46.569466 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:46.569427 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:46.669721 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:46.669687 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfccb8697-rcqv9" event={"ID":"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51","Type":"ContainerStarted","Data":"a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df"} Jul 09 14:33:46.673127 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:46.673097 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:46.691415 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:46.691377 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dfccb8697-rcqv9" podStartSLOduration=1.565403441 podStartE2EDuration="4.691363346s" totalImagesPullingTime="3.125959905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:46.690362878 +0000 UTC m=+106.892290048" watchObservedRunningTime="2026-07-09 14:33:46.691363346 +0000 UTC m=+106.893290509" Jul 09 14:33:48.164985 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:48.164946 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:48.234269 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:48.234237 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:48.677900 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:48.677871 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nl64z" event={"ID":"a8a41997-1d04-466b-be20-b5c118b42b46","Type":"ContainerStarted","Data":"26aa3bf53e1fe7ce6c380c81e15b37b6d9b4fcd0bb0b63aa9693a4f63b0301e7"} Jul 09 14:33:48.678051 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:48.677926 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-nl64z" event={"ID":"a8a41997-1d04-466b-be20-b5c118b42b46","Type":"ContainerStarted","Data":"90caa10e2b1ad6ceffebe7170a92bcd127eeda0fc38ee13b2ac9713157dbb3c6"} Jul 09 14:33:48.678051 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:48.678006 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-nl64z" Jul 09 14:33:48.696786 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:48.696739 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-nl64z" podStartSLOduration=66.635706675 podStartE2EDuration="1m9.696726501s" totalImagesPullingTime="3.061019826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:48.695313756 +0000 UTC m=+108.897240930" watchObservedRunningTime="2026-07-09 14:33:48.696726501 +0000 UTC m=+108.898653664" Jul 09 14:33:49.246940 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:49.246906 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:49.358245 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:49.358197 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:49.923738 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:49.923706 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:50.590254 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:50.590227 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-755f7f4dcb-pnq46" Jul 09 14:33:50.769580 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:50.769550 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:50.843775 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:50.843700 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:52.278186 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.278149 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:52.338467 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.338439 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:52.456270 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.456244 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:52.456434 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.456315 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:52.462209 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.462186 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:52.493210 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.493182 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:52.694309 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.694283 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:33:52.729807 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.729765 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:52.853953 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.853916 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb"] Jul 09 14:33:52.857159 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.857144 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:52.860358 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.860330 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 14:33:52.860470 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.860370 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 14:33:52.860663 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.860643 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tmd2f\"" Jul 09 14:33:52.860789 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.860771 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 14:33:52.876338 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.876291 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpp42\" (UniqueName: \"kubernetes.io/projected/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-kube-api-access-qpp42\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:52.876338 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.876340 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:52.876662 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.876400 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:52.876662 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.876438 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:52.878094 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.878074 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb"] Jul 09 14:33:52.903395 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.903369 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-czpbd"] Jul 09 14:33:52.905120 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.905095 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:52.906653 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.906639 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:52.908498 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.908480 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 14:33:52.908934 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.908913 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 14:33:52.909030 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.909011 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-psdk7\"" Jul 09 14:33:52.909102 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.909042 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 14:33:52.926595 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.926541 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-czpbd"] Jul 09 14:33:52.932421 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.932402 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kbbm6"] Jul 09 14:33:52.935545 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.935508 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:52.940728 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.940709 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-wccg6\"" Jul 09 14:33:52.940979 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.940846 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 14:33:52.942361 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.942344 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 14:33:52.942462 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.942390 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 14:33:52.976817 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.976765 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:52.976817 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.976806 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:52.976991 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.976838 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8hwj\" (UniqueName: \"kubernetes.io/projected/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-kube-api-access-w8hwj\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:52.976991 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.976914 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-textfile\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:52.976991 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:52.976940 2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 14:33:52.976991 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.976961 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:52.976991 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:52.976987 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-openshift-state-metrics-tls podName:2039d3d2-8f20-44f2-9bc6-fce42b4fdc95 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:53.476969768 +0000 UTC m=+113.678896910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-rhllb" (UID: "2039d3d2-8f20-44f2-9bc6-fce42b4fdc95") : secret "openshift-state-metrics-tls" not found Jul 09 14:33:52.977264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977028 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8627d\" (UniqueName: \"kubernetes.io/projected/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-api-access-8627d\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:52.977264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977053 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-wtmp\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:52.977264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpp42\" (UniqueName: \"kubernetes.io/projected/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-kube-api-access-qpp42\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:52.977264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977135 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:52.977264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977178 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:52.977264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977203 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:52.977264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977227 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:52.977264 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977253 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-sys\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:52.977643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977272 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-root\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:52.977643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977300 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:52.977643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:52.977643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977408 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:52.977643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977442 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-tls\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:52.977643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977483 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-metrics-client-ca\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:52.977643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.977561 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:52.979812 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:52.979792 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:53.000222 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.000198 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpp42\" (UniqueName: \"kubernetes.io/projected/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-kube-api-access-qpp42\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:53.001153 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.001133 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:53.078109 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078079 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.078109 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078108 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.078289 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078125 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.078289 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078142 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.078289 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078159 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-sys\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.078289 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078213 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-root\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.078289 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078271 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.078594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078299 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.078594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078309 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-sys\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.078594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078332 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-tls\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.078594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078336 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-root\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.078594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078357 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-metrics-client-ca\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.078594 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:53.078430 2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 14:33:53.078594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078436 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8hwj\" (UniqueName: \"kubernetes.io/projected/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-kube-api-access-w8hwj\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.078594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078462 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-textfile\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.078594 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:53.078495 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-tls podName:2a9e9d70-7a63-4573-974c-cc73d8bbcff7 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:53.578477588 +0000 UTC m=+113.780404734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-tls") pod "node-exporter-kbbm6" (UID: "2a9e9d70-7a63-4573-974c-cc73d8bbcff7") : secret "node-exporter-tls" not found Jul 09 14:33:53.078594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078553 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.078594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8627d\" (UniqueName: \"kubernetes.io/projected/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-api-access-8627d\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.079221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078618 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-wtmp\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.079221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078755 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-textfile\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.079221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078794 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-wtmp\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.079221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078823 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-accelerators-collector-config\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.079221 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:53.078946 2570 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 14:33:53.079221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.078983 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.079221 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:33:53.079007 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-tls podName:f15d3eb0-6c69-4cea-aa16-bb1dcbb39931 nodeName:}" failed. No retries permitted until 2026-07-09 14:33:53.578990934 +0000 UTC m=+113.780918076 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-czpbd" (UID: "f15d3eb0-6c69-4cea-aa16-bb1dcbb39931") : secret "kube-state-metrics-tls" not found Jul 09 14:33:53.079221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.079068 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.079566 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.079237 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.079566 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.079402 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-metrics-client-ca\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.080818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.080796 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.081325 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.081308 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.088160 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.088131 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8627d\" (UniqueName: \"kubernetes.io/projected/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-api-access-8627d\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.088385 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.088362 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8hwj\" (UniqueName: \"kubernetes.io/projected/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-kube-api-access-w8hwj\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.095239 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.095216 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:53.193880 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.193815 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:53.294023 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.293942 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:53.397618 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.397584 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:53.482194 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.482171 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:53.485052 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.485025 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/2039d3d2-8f20-44f2-9bc6-fce42b4fdc95-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-rhllb\" (UID: \"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:53.499639 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.499617 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:53.583008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.582951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-tls\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.583008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.583000 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.585304 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.585279 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2a9e9d70-7a63-4573-974c-cc73d8bbcff7-node-exporter-tls\") pod \"node-exporter-kbbm6\" (UID: \"2a9e9d70-7a63-4573-974c-cc73d8bbcff7\") " pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.585383 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.585317 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f15d3eb0-6c69-4cea-aa16-bb1dcbb39931-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-czpbd\" (UID: \"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.596095 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.596075 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:53.695276 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.695248 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:53.766279 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.766255 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" Jul 09 14:33:53.803626 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.803571 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:53.815794 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.815399 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" Jul 09 14:33:53.845387 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.845324 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kbbm6" Jul 09 14:33:53.859996 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:53.859959 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a9e9d70_7a63_4573_974c_cc73d8bbcff7.slice/crio-065b7d28db63619075a257945467bdbf6cb051b853ff7754730d8bbc7326e5cb WatchSource:0}: Error finding container 065b7d28db63619075a257945467bdbf6cb051b853ff7754730d8bbc7326e5cb: Status 404 returned error can't find the container with id 065b7d28db63619075a257945467bdbf6cb051b853ff7754730d8bbc7326e5cb Jul 09 14:33:53.901036 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.900996 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:53.912180 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.911978 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb"] Jul 09 14:33:53.916513 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:53.916486 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2039d3d2_8f20_44f2_9bc6_fce42b4fdc95.slice/crio-c01ffd23b49185a4a396f9a9d256bbbe1387405fdc154d005f61edfb4b46a014 WatchSource:0}: Error finding container c01ffd23b49185a4a396f9a9d256bbbe1387405fdc154d005f61edfb4b46a014: Status 404 returned error can't find the container with id c01ffd23b49185a4a396f9a9d256bbbe1387405fdc154d005f61edfb4b46a014 Jul 09 14:33:53.971512 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:53.971486 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-czpbd"] Jul 09 14:33:53.973676 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:53.973647 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15d3eb0_6c69_4cea_aa16_bb1dcbb39931.slice/crio-3368319a96a0b6b4ea55edc4aeba1783f6d4ba49bc0739b3e1c4c3488b79c1ac WatchSource:0}: Error finding container 3368319a96a0b6b4ea55edc4aeba1783f6d4ba49bc0739b3e1c4c3488b79c1ac: Status 404 returned error can't find the container with id 3368319a96a0b6b4ea55edc4aeba1783f6d4ba49bc0739b3e1c4c3488b79c1ac Jul 09 14:33:54.144733 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:54.144647 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:54.701035 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:54.700999 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" event={"ID":"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931","Type":"ContainerStarted","Data":"3368319a96a0b6b4ea55edc4aeba1783f6d4ba49bc0739b3e1c4c3488b79c1ac"} Jul 09 14:33:54.703433 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:54.703300 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" event={"ID":"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95","Type":"ContainerStarted","Data":"7ff31d0e13bc745633d5b9d0191b718b7db2823f04558ceb38cb1756a8c70aa9"} Jul 09 14:33:54.703433 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:54.703366 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" event={"ID":"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95","Type":"ContainerStarted","Data":"67f0723153fa0260d44294326b5b2f32c1d481ea5da769dbecf33d7f112a0765"} Jul 09 14:33:54.703433 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:54.703399 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" event={"ID":"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95","Type":"ContainerStarted","Data":"c01ffd23b49185a4a396f9a9d256bbbe1387405fdc154d005f61edfb4b46a014"} Jul 09 14:33:54.704697 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:54.704678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbbm6" event={"ID":"2a9e9d70-7a63-4573-974c-cc73d8bbcff7","Type":"ContainerStarted","Data":"065b7d28db63619075a257945467bdbf6cb051b853ff7754730d8bbc7326e5cb"} Jul 09 14:33:55.711566 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:55.711444 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" event={"ID":"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931","Type":"ContainerStarted","Data":"52918aa80179cb00f6e3a0a98447bdacf8274d43d9f5dfb54dbd7aa4f4b64f2c"} Jul 09 14:33:55.713832 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:55.713798 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" event={"ID":"2039d3d2-8f20-44f2-9bc6-fce42b4fdc95","Type":"ContainerStarted","Data":"b828d594bc4950ddf0ce9562437d754a3daa4306ee6cb87cc6d83854fa095000"} Jul 09 14:33:55.717342 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:55.716285 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbbm6" event={"ID":"2a9e9d70-7a63-4573-974c-cc73d8bbcff7","Type":"ContainerStarted","Data":"2dcc7742c5884b500720f025f91634a94101fdca8bb31a8564159efab9d96e38"} Jul 09 14:33:55.748712 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:55.748252 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-rhllb" podStartSLOduration=2.23385109 podStartE2EDuration="3.748230645s" totalImagesPullingTime="1.514379555s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:55.747020258 +0000 UTC m=+115.948947423" watchObservedRunningTime="2026-07-09 14:33:55.748230645 +0000 UTC m=+115.950157814" Jul 09 14:33:55.749976 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:55.749907 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:55.844833 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:55.844800 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:56.038025 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:56.037990 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:56.721158 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:56.721119 2570 generic.go:356] "Generic (PLEG): container finished" podID="2a9e9d70-7a63-4573-974c-cc73d8bbcff7" containerID="2dcc7742c5884b500720f025f91634a94101fdca8bb31a8564159efab9d96e38" exitCode=0 Jul 09 14:33:56.721643 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:56.721206 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbbm6" event={"ID":"2a9e9d70-7a63-4573-974c-cc73d8bbcff7","Type":"ContainerDied","Data":"2dcc7742c5884b500720f025f91634a94101fdca8bb31a8564159efab9d96e38"} Jul 09 14:33:56.723422 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:56.723399 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" event={"ID":"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931","Type":"ContainerStarted","Data":"6660a2571d46d9d1704ce75adb3e6bedbf480b707b71e3dcd71f83044d4aebc1"} Jul 09 14:33:56.723546 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:56.723447 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" event={"ID":"f15d3eb0-6c69-4cea-aa16-bb1dcbb39931","Type":"ContainerStarted","Data":"885f70eed8c1d782aacf6fd2e11c87dad82eab20da8a09054876ba11b363069a"} Jul 09 14:33:56.774702 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:56.774656 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-czpbd" podStartSLOduration=3.124967626 podStartE2EDuration="4.774634359s" totalImagesPullingTime="1.649666733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:56.772863435 +0000 UTC m=+116.974790600" watchObservedRunningTime="2026-07-09 14:33:56.774634359 +0000 UTC m=+116.976561524" Jul 09 14:33:57.542133 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:57.542092 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:57.631088 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:57.631056 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:57.720497 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:57.720470 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:57.729968 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:57.729936 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbbm6" event={"ID":"2a9e9d70-7a63-4573-974c-cc73d8bbcff7","Type":"ContainerStarted","Data":"8728e1de58ca2cf305492dbee248455fd2791f9853812fd00470b49c73a6eec0"} Jul 09 14:33:57.730286 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:57.729984 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kbbm6" event={"ID":"2a9e9d70-7a63-4573-974c-cc73d8bbcff7","Type":"ContainerStarted","Data":"7ef87af853678f883190a33365769ab195d2b4d8ec3a43619d323684fc25b085"} Jul 09 14:33:57.753767 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:57.753723 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kbbm6" podStartSLOduration=3.955572036 podStartE2EDuration="5.753708521s" totalImagesPullingTime="1.713361281s" totalInitContainerRuntime="84.775204ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:33:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:33:57.752072428 +0000 UTC m=+117.953999605" watchObservedRunningTime="2026-07-09 14:33:57.753708521 +0000 UTC m=+117.955635684" Jul 09 14:33:57.824477 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:57.824381 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:58.036152 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.036120 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-85484984dd-wxk29"] Jul 09 14:33:58.039391 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.039370 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.042108 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.042080 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 14:33:58.042248 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.042169 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 14:33:58.042351 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.042293 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 14:33:58.042472 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.042407 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-fcj7q\"" Jul 09 14:33:58.042472 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.042408 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 14:33:58.042689 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.042552 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 14:33:58.048715 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.048697 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 14:33:58.056451 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.056429 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85484984dd-wxk29"] Jul 09 14:33:58.117812 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.117763 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8605daa-d39f-44c5-b4fc-17664f4f2930-serving-certs-ca-bundle\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.117812 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.117798 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8605daa-d39f-44c5-b4fc-17664f4f2930-metrics-client-ca\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.118013 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.117825 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-telemeter-client-tls\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.118013 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.117851 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crndq\" (UniqueName: \"kubernetes.io/projected/d8605daa-d39f-44c5-b4fc-17664f4f2930-kube-api-access-crndq\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.118013 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.117952 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-secret-telemeter-client\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.118013 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.117985 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-federate-client-tls\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.118013 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.118004 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8605daa-d39f-44c5-b4fc-17664f4f2930-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.118162 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.118042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.218549 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.218499 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-secret-telemeter-client\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.218678 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.218573 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-federate-client-tls\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.218678 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.218603 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8605daa-d39f-44c5-b4fc-17664f4f2930-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.218678 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.218651 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.218844 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.218684 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8605daa-d39f-44c5-b4fc-17664f4f2930-serving-certs-ca-bundle\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.218844 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.218720 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8605daa-d39f-44c5-b4fc-17664f4f2930-metrics-client-ca\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.218844 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.218753 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-telemeter-client-tls\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.218844 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.218778 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crndq\" (UniqueName: \"kubernetes.io/projected/d8605daa-d39f-44c5-b4fc-17664f4f2930-kube-api-access-crndq\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.219471 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.219444 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8605daa-d39f-44c5-b4fc-17664f4f2930-serving-certs-ca-bundle\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.219617 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.219444 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d8605daa-d39f-44c5-b4fc-17664f4f2930-metrics-client-ca\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.219932 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.219906 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d8605daa-d39f-44c5-b4fc-17664f4f2930-telemeter-trusted-ca-bundle\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.221179 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.221157 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-secret-telemeter-client\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.221666 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.221639 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-telemeter-client-tls\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.221789 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.221771 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-federate-client-tls\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.221846 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.221792 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d8605daa-d39f-44c5-b4fc-17664f4f2930-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.228663 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.228640 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crndq\" (UniqueName: \"kubernetes.io/projected/d8605daa-d39f-44c5-b4fc-17664f4f2930-kube-api-access-crndq\") pod \"telemeter-client-85484984dd-wxk29\" (UID: \"d8605daa-d39f-44c5-b4fc-17664f4f2930\") " pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.349100 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.349072 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" Jul 09 14:33:58.487937 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.487903 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-85484984dd-wxk29"] Jul 09 14:33:58.491054 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:33:58.491027 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8605daa_d39f_44c5_b4fc_17664f4f2930.slice/crio-29ec6d12c2df3260c88f50f3544ced43952c8df9953c256ddaa50b4dabf0a0ad WatchSource:0}: Error finding container 29ec6d12c2df3260c88f50f3544ced43952c8df9953c256ddaa50b4dabf0a0ad: Status 404 returned error can't find the container with id 29ec6d12c2df3260c88f50f3544ced43952c8df9953c256ddaa50b4dabf0a0ad Jul 09 14:33:58.684207 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.684129 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-nl64z" Jul 09 14:33:58.736697 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:58.736652 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" event={"ID":"d8605daa-d39f-44c5-b4fc-17664f4f2930","Type":"ContainerStarted","Data":"29ec6d12c2df3260c88f50f3544ced43952c8df9953c256ddaa50b4dabf0a0ad"} Jul 09 14:33:59.054485 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:59.054448 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:59.513875 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:59.513841 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:59.620326 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:59.620276 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:33:59.719790 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:33:59.719755 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:01.751494 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:01.751448 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" event={"ID":"d8605daa-d39f-44c5-b4fc-17664f4f2930","Type":"ContainerStarted","Data":"388ab717d9ed8da56e730a53bfb0c4883899d8fb5fa6602fabb9ee5b6fa03592"} Jul 09 14:34:02.757425 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:02.757377 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" event={"ID":"d8605daa-d39f-44c5-b4fc-17664f4f2930","Type":"ContainerStarted","Data":"755d9f27f33337e88ce2494c15de6337edaed23036589cb12f2fc1c7b637c482"} Jul 09 14:34:02.757845 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:02.757474 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" event={"ID":"d8605daa-d39f-44c5-b4fc-17664f4f2930","Type":"ContainerStarted","Data":"5acde99f63fdd44dd47e5919c611732b92fbb76ccc982ca79a2c3c2ed2e9b14f"} Jul 09 14:34:02.786383 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:02.786339 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-85484984dd-wxk29" podStartSLOduration=1.47078828 podStartE2EDuration="4.786325066s" totalImagesPullingTime="3.315536786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:33:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:34:02.785472318 +0000 UTC m=+122.987399484" watchObservedRunningTime="2026-07-09 14:34:02.786325066 +0000 UTC m=+122.988252229" Jul 09 14:34:03.138130 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.138032 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:03.239509 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.239475 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:03.455616 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.455588 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-975d968b5-slvpg"] Jul 09 14:34:03.459041 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.459017 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.473012 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.472985 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-975d968b5-slvpg"] Jul 09 14:34:03.565645 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.565624 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-serving-cert\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.565772 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.565651 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-trusted-ca-bundle\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.565772 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.565680 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-oauth-serving-cert\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.565772 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.565727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-oauth-config\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.565772 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.565754 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-console-config\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.565918 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.565820 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-service-ca\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.565918 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.565903 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6mrp\" (UniqueName: \"kubernetes.io/projected/4cc2667b-28b8-4818-af85-c92005c475ca-kube-api-access-z6mrp\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.667093 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.667066 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-serving-cert\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.667204 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.667097 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-trusted-ca-bundle\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.667204 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.667126 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-oauth-serving-cert\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.667204 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.667155 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-oauth-config\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.667204 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.667178 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-console-config\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.667382 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.667360 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-service-ca\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.667477 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.667458 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6mrp\" (UniqueName: \"kubernetes.io/projected/4cc2667b-28b8-4818-af85-c92005c475ca-kube-api-access-z6mrp\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.668074 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.668051 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-oauth-serving-cert\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.668194 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.668076 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-service-ca\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.668194 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.668166 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-console-config\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.668573 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.668553 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-trusted-ca-bundle\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.669774 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.669756 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-serving-cert\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.669908 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.669887 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-oauth-config\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.676486 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.676463 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6mrp\" (UniqueName: \"kubernetes.io/projected/4cc2667b-28b8-4818-af85-c92005c475ca-kube-api-access-z6mrp\") pod \"console-975d968b5-slvpg\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.767819 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.767761 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:03.901050 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:03.901016 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-975d968b5-slvpg"] Jul 09 14:34:03.904218 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:34:03.904194 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cc2667b_28b8_4818_af85_c92005c475ca.slice/crio-ca2caa1c5c7565b0b5bd3decbd87da478ba692bb97077684edfef6e691aa51c2 WatchSource:0}: Error finding container ca2caa1c5c7565b0b5bd3decbd87da478ba692bb97077684edfef6e691aa51c2: Status 404 returned error can't find the container with id ca2caa1c5c7565b0b5bd3decbd87da478ba692bb97077684edfef6e691aa51c2 Jul 09 14:34:04.768790 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:04.768753 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-975d968b5-slvpg" event={"ID":"4cc2667b-28b8-4818-af85-c92005c475ca","Type":"ContainerStarted","Data":"767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37"} Jul 09 14:34:04.769144 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:04.768802 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-975d968b5-slvpg" event={"ID":"4cc2667b-28b8-4818-af85-c92005c475ca","Type":"ContainerStarted","Data":"ca2caa1c5c7565b0b5bd3decbd87da478ba692bb97077684edfef6e691aa51c2"} Jul 09 14:34:04.789938 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:04.789893 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-975d968b5-slvpg" podStartSLOduration=1.789877854 podStartE2EDuration="1.789877854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:34:04.787835086 +0000 UTC m=+124.989762249" watchObservedRunningTime="2026-07-09 14:34:04.789877854 +0000 UTC m=+124.991805018" Jul 09 14:34:07.270642 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:07.270586 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:07.347185 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:07.347148 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:07.847057 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:07.847026 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:08.657841 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:08.657806 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:10.019863 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:10.019814 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:34:10.022314 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:10.022294 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec8f4eb3-372d-4095-98fc-1fe2c8483150-metrics-certs\") pod \"network-metrics-daemon-cxzs4\" (UID: \"ec8f4eb3-372d-4095-98fc-1fe2c8483150\") " pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:34:10.253453 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:10.253421 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-txwkz\"" Jul 09 14:34:10.261389 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:10.261368 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cxzs4" Jul 09 14:34:10.392994 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:10.392963 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cxzs4"] Jul 09 14:34:10.395761 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:34:10.395727 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8f4eb3_372d_4095_98fc_1fe2c8483150.slice/crio-2cee17293159a588ba807750f4d4aac6880018f47582e00a7ac8216c2c42968f WatchSource:0}: Error finding container 2cee17293159a588ba807750f4d4aac6880018f47582e00a7ac8216c2c42968f: Status 404 returned error can't find the container with id 2cee17293159a588ba807750f4d4aac6880018f47582e00a7ac8216c2c42968f Jul 09 14:34:10.793034 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:10.792998 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxzs4" event={"ID":"ec8f4eb3-372d-4095-98fc-1fe2c8483150","Type":"ContainerStarted","Data":"2cee17293159a588ba807750f4d4aac6880018f47582e00a7ac8216c2c42968f"} Jul 09 14:34:11.799122 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:11.799092 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxzs4" event={"ID":"ec8f4eb3-372d-4095-98fc-1fe2c8483150","Type":"ContainerStarted","Data":"64d3cc27cc96538c735c91ea3dd8118a7fadd8a5b0f312faddc27a9225f5985e"} Jul 09 14:34:11.799505 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:11.799143 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cxzs4" event={"ID":"ec8f4eb3-372d-4095-98fc-1fe2c8483150","Type":"ContainerStarted","Data":"7c0503874cb727a964e3867f7cb7e887af8f04e7cbe4122ffc166199f96e4a6d"} Jul 09 14:34:11.818424 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:11.818374 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cxzs4" podStartSLOduration=130.644380647 podStartE2EDuration="2m11.818360107s" totalImagesPullingTime="1.17397946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:34:11.81696211 +0000 UTC m=+132.018889274" watchObservedRunningTime="2026-07-09 14:34:11.818360107 +0000 UTC m=+132.020287407" Jul 09 14:34:11.922346 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:11.922278 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:11.995411 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:11.995388 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:12.808805 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:12.808776 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:12.909807 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:12.909766 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:13.768289 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:13.768254 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:13.768558 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:13.768309 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:13.772813 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:13.772788 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:13.810127 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:13.810097 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:34:13.861705 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:13.861666 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dfccb8697-rcqv9"] Jul 09 14:34:14.077994 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:14.077918 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:14.159751 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:14.159712 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:16.879987 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:16.879954 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:16.959098 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:16.959069 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:22.273409 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:22.273355 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:22.343150 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:22.343103 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:35.115902 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:35.115861 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:35.187604 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:35.187566 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:38.883878 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:38.883826 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dfccb8697-rcqv9" podUID="2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" containerName="console" containerID="cri-o://a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df" gracePeriod=15 Jul 09 14:34:39.132098 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.132077 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:34:39.267286 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.267257 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvh24\" (UniqueName: \"kubernetes.io/projected/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-kube-api-access-rvh24\") pod \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " Jul 09 14:34:39.267459 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.267325 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-oauth-serving-cert\") pod \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " Jul 09 14:34:39.267459 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.267347 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-config\") pod \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " Jul 09 14:34:39.267459 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.267368 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-service-ca\") pod \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " Jul 09 14:34:39.267637 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.267456 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-trusted-ca-bundle\") pod \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " Jul 09 14:34:39.267637 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.267574 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-serving-cert\") pod \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " Jul 09 14:34:39.267637 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.267621 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-oauth-config\") pod \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\" (UID: \"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51\") " Jul 09 14:34:39.267917 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.267850 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-config" (OuterVolumeSpecName: "console-config") pod "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" (UID: "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:34:39.267917 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.267864 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-service-ca" (OuterVolumeSpecName: "service-ca") pod "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" (UID: "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:34:39.268086 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.267965 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" (UID: "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:34:39.268086 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.268028 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" (UID: "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:34:39.269771 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.269748 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" (UID: "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:34:39.269840 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.269789 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-kube-api-access-rvh24" (OuterVolumeSpecName: "kube-api-access-rvh24") pod "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" (UID: "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51"). InnerVolumeSpecName "kube-api-access-rvh24". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:34:39.269920 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.269903 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" (UID: "2376b7b9-dc32-40a6-bcc9-f8f59ab09a51"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:34:39.368649 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.368624 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-serving-cert\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:34:39.368649 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.368645 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-oauth-config\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:34:39.368781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.368655 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvh24\" (UniqueName: \"kubernetes.io/projected/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-kube-api-access-rvh24\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:34:39.368781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.368664 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-oauth-serving-cert\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:34:39.368781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.368672 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-console-config\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:34:39.368781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.368679 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-service-ca\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:34:39.368781 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.368687 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51-trusted-ca-bundle\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:34:39.904422 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.904382 2570 generic.go:356] "Generic (PLEG): container finished" podID="2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" containerID="a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df" exitCode=0 Jul 09 14:34:39.904889 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.904427 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dfccb8697-rcqv9" Jul 09 14:34:39.904889 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.904472 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfccb8697-rcqv9" event={"ID":"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51","Type":"ContainerDied","Data":"a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df"} Jul 09 14:34:39.904889 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.904540 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dfccb8697-rcqv9" event={"ID":"2376b7b9-dc32-40a6-bcc9-f8f59ab09a51","Type":"ContainerDied","Data":"17fb239863e622fb7a26036a8a61985ee25762e845fd299e12b9feaf274046bd"} Jul 09 14:34:39.904889 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.904568 2570 scope.go:117] "RemoveContainer" containerID="a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df" Jul 09 14:34:39.906099 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.906017 2570 generic.go:356] "Generic (PLEG): container finished" podID="7d5894b9-5035-4464-8f52-42cf46cc95c4" containerID="b0e46dce1ee5ad5b4149db0f38f3cb11eb494781df71022c9fc6bfb6dff61b04" exitCode=0 Jul 09 14:34:39.906206 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.906085 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" event={"ID":"7d5894b9-5035-4464-8f52-42cf46cc95c4","Type":"ContainerDied","Data":"b0e46dce1ee5ad5b4149db0f38f3cb11eb494781df71022c9fc6bfb6dff61b04"} Jul 09 14:34:39.906511 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.906496 2570 scope.go:117] "RemoveContainer" containerID="b0e46dce1ee5ad5b4149db0f38f3cb11eb494781df71022c9fc6bfb6dff61b04" Jul 09 14:34:39.914972 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.914956 2570 scope.go:117] "RemoveContainer" containerID="a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df" Jul 09 14:34:39.915229 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:34:39.915210 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df\": container with ID starting with a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df not found: ID does not exist" containerID="a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df" Jul 09 14:34:39.915275 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.915238 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df"} err="failed to get container status \"a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df\": rpc error: code = NotFound desc = could not find container \"a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df\": container with ID starting with a137ed40433624d5c92036099c9d9ac1bf30de3bb2ace4c841b893ffd01f05df not found: ID does not exist" Jul 09 14:34:39.944832 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.944801 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dfccb8697-rcqv9"] Jul 09 14:34:39.949871 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:39.949845 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dfccb8697-rcqv9"] Jul 09 14:34:40.239997 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:40.239970 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" path="/var/lib/kubelet/pods/2376b7b9-dc32-40a6-bcc9-f8f59ab09a51/volumes" Jul 09 14:34:40.911751 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:40.911710 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-mlmrr" event={"ID":"7d5894b9-5035-4464-8f52-42cf46cc95c4","Type":"ContainerStarted","Data":"60379d887c267fbedb1c7e56131126b64105076ebbc47a5ab1586d301205c8c6"} Jul 09 14:34:41.036081 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:41.036047 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:41.140477 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:41.140441 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:42.336444 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:42.336412 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:34:53.292486 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:34:53.292397 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:08.925379 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:08.925333 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:09.007397 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:09.007364 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:14.384384 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.384347 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54cb7fbccc-b5h94"] Jul 09 14:35:14.384876 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.384693 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" containerName="console" Jul 09 14:35:14.384876 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.384705 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" containerName="console" Jul 09 14:35:14.384876 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.384757 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2376b7b9-dc32-40a6-bcc9-f8f59ab09a51" containerName="console" Jul 09 14:35:14.389333 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.389308 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.400978 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.400945 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54cb7fbccc-b5h94"] Jul 09 14:35:14.450079 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.450045 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-oauth-serving-cert\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.450228 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.450114 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-service-ca\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.450228 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.450163 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7shj\" (UniqueName: \"kubernetes.io/projected/5678a510-57b6-476c-a54f-6a839679cf25-kube-api-access-g7shj\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.450228 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.450184 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-trusted-ca-bundle\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.450366 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.450246 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-oauth-config\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.450366 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.450325 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-serving-cert\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.450366 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.450354 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-console-config\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.450993 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.450968 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:14.551416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.551389 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-service-ca\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.551543 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.551437 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7shj\" (UniqueName: \"kubernetes.io/projected/5678a510-57b6-476c-a54f-6a839679cf25-kube-api-access-g7shj\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.551543 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.551470 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-trusted-ca-bundle\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.551543 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.551495 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-oauth-config\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.551723 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.551562 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-serving-cert\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.551723 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.551608 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-console-config\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.551723 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.551644 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-oauth-serving-cert\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.552224 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.552191 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-service-ca\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.552333 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.552312 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-oauth-serving-cert\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.552396 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.552384 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-trusted-ca-bundle\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.552575 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.552548 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:14.552683 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.552665 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-console-config\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.554837 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.554812 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-oauth-config\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.554930 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.554895 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-serving-cert\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.559081 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.559060 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7shj\" (UniqueName: \"kubernetes.io/projected/5678a510-57b6-476c-a54f-6a839679cf25-kube-api-access-g7shj\") pod \"console-54cb7fbccc-b5h94\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.703361 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.703328 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:14.838578 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:14.838431 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54cb7fbccc-b5h94"] Jul 09 14:35:14.841144 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:35:14.841115 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5678a510_57b6_476c_a54f_6a839679cf25.slice/crio-03149121422ea1f501411229d95a8fceef7c3eb9d3b2847940b43fe571530e51 WatchSource:0}: Error finding container 03149121422ea1f501411229d95a8fceef7c3eb9d3b2847940b43fe571530e51: Status 404 returned error can't find the container with id 03149121422ea1f501411229d95a8fceef7c3eb9d3b2847940b43fe571530e51 Jul 09 14:35:15.046625 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:15.046542 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cb7fbccc-b5h94" event={"ID":"5678a510-57b6-476c-a54f-6a839679cf25","Type":"ContainerStarted","Data":"768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07"} Jul 09 14:35:15.046625 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:15.046595 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cb7fbccc-b5h94" event={"ID":"5678a510-57b6-476c-a54f-6a839679cf25","Type":"ContainerStarted","Data":"03149121422ea1f501411229d95a8fceef7c3eb9d3b2847940b43fe571530e51"} Jul 09 14:35:15.065714 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:15.065667 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54cb7fbccc-b5h94" podStartSLOduration=1.06565137 podStartE2EDuration="1.06565137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:35:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:35:15.065024729 +0000 UTC m=+195.266951895" watchObservedRunningTime="2026-07-09 14:35:15.06565137 +0000 UTC m=+195.267578534" Jul 09 14:35:20.797176 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:20.797136 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:20.867658 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:20.867612 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:24.704200 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:24.704161 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:24.704635 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:24.704234 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:24.709050 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:24.709030 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:25.086016 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:25.085936 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:35:25.131943 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:25.131903 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-975d968b5-slvpg"] Jul 09 14:35:25.232062 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:25.232032 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:25.333142 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:25.333113 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:26.503314 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:26.503281 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:27.667241 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:27.667207 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:42.726657 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:42.726617 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:35:50.159368 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.159308 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-975d968b5-slvpg" podUID="4cc2667b-28b8-4818-af85-c92005c475ca" containerName="console" containerID="cri-o://767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37" gracePeriod=15 Jul 09 14:35:50.399733 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.399708 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:35:50.440702 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.440668 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-oauth-config\") pod \"4cc2667b-28b8-4818-af85-c92005c475ca\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " Jul 09 14:35:50.440702 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.440698 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-service-ca\") pod \"4cc2667b-28b8-4818-af85-c92005c475ca\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " Jul 09 14:35:50.440905 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.440721 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-oauth-serving-cert\") pod \"4cc2667b-28b8-4818-af85-c92005c475ca\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " Jul 09 14:35:50.440905 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.440739 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-console-config\") pod \"4cc2667b-28b8-4818-af85-c92005c475ca\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " Jul 09 14:35:50.440905 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.440800 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6mrp\" (UniqueName: \"kubernetes.io/projected/4cc2667b-28b8-4818-af85-c92005c475ca-kube-api-access-z6mrp\") pod \"4cc2667b-28b8-4818-af85-c92005c475ca\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " Jul 09 14:35:50.440905 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.440850 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-trusted-ca-bundle\") pod \"4cc2667b-28b8-4818-af85-c92005c475ca\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " Jul 09 14:35:50.440905 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.440876 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-serving-cert\") pod \"4cc2667b-28b8-4818-af85-c92005c475ca\" (UID: \"4cc2667b-28b8-4818-af85-c92005c475ca\") " Jul 09 14:35:50.441169 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.441130 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4cc2667b-28b8-4818-af85-c92005c475ca" (UID: "4cc2667b-28b8-4818-af85-c92005c475ca"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:35:50.441169 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.441138 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-service-ca" (OuterVolumeSpecName: "service-ca") pod "4cc2667b-28b8-4818-af85-c92005c475ca" (UID: "4cc2667b-28b8-4818-af85-c92005c475ca"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:35:50.441294 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.441268 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-console-config" (OuterVolumeSpecName: "console-config") pod "4cc2667b-28b8-4818-af85-c92005c475ca" (UID: "4cc2667b-28b8-4818-af85-c92005c475ca"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:35:50.441593 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.441570 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4cc2667b-28b8-4818-af85-c92005c475ca" (UID: "4cc2667b-28b8-4818-af85-c92005c475ca"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:35:50.443131 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.443113 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4cc2667b-28b8-4818-af85-c92005c475ca" (UID: "4cc2667b-28b8-4818-af85-c92005c475ca"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:35:50.443305 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.443288 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cc2667b-28b8-4818-af85-c92005c475ca-kube-api-access-z6mrp" (OuterVolumeSpecName: "kube-api-access-z6mrp") pod "4cc2667b-28b8-4818-af85-c92005c475ca" (UID: "4cc2667b-28b8-4818-af85-c92005c475ca"). InnerVolumeSpecName "kube-api-access-z6mrp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:35:50.443360 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.443302 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4cc2667b-28b8-4818-af85-c92005c475ca" (UID: "4cc2667b-28b8-4818-af85-c92005c475ca"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:35:50.542056 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.542037 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-oauth-config\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:35:50.542056 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.542055 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-service-ca\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:35:50.542185 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.542065 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-oauth-serving-cert\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:35:50.542185 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.542074 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-console-config\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:35:50.542185 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.542081 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6mrp\" (UniqueName: \"kubernetes.io/projected/4cc2667b-28b8-4818-af85-c92005c475ca-kube-api-access-z6mrp\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:35:50.542185 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.542089 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4cc2667b-28b8-4818-af85-c92005c475ca-trusted-ca-bundle\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:35:50.542185 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:50.542098 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4cc2667b-28b8-4818-af85-c92005c475ca-console-serving-cert\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:35:51.177207 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:51.177171 2570 generic.go:356] "Generic (PLEG): container finished" podID="4cc2667b-28b8-4818-af85-c92005c475ca" containerID="767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37" exitCode=0 Jul 09 14:35:51.177672 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:51.177221 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-975d968b5-slvpg" Jul 09 14:35:51.177672 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:51.177226 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-975d968b5-slvpg" event={"ID":"4cc2667b-28b8-4818-af85-c92005c475ca","Type":"ContainerDied","Data":"767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37"} Jul 09 14:35:51.177672 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:51.177328 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-975d968b5-slvpg" event={"ID":"4cc2667b-28b8-4818-af85-c92005c475ca","Type":"ContainerDied","Data":"ca2caa1c5c7565b0b5bd3decbd87da478ba692bb97077684edfef6e691aa51c2"} Jul 09 14:35:51.177672 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:51.177350 2570 scope.go:117] "RemoveContainer" containerID="767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37" Jul 09 14:35:51.185923 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:51.185906 2570 scope.go:117] "RemoveContainer" containerID="767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37" Jul 09 14:35:51.186187 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:35:51.186167 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37\": container with ID starting with 767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37 not found: ID does not exist" containerID="767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37" Jul 09 14:35:51.186232 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:51.186196 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37"} err="failed to get container status \"767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37\": rpc error: code = NotFound desc = could not find container \"767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37\": container with ID starting with 767e29b004a7b9383973b4346cf74abcd23a931de607a371d52ff263bfee2e37 not found: ID does not exist" Jul 09 14:35:51.197634 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:51.197609 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-975d968b5-slvpg"] Jul 09 14:35:51.203423 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:51.203404 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-975d968b5-slvpg"] Jul 09 14:35:52.238036 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:35:52.237993 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cc2667b-28b8-4818-af85-c92005c475ca" path="/var/lib/kubelet/pods/4cc2667b-28b8-4818-af85-c92005c475ca/volumes" Jul 09 14:36:11.163141 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:11.163097 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:11.229231 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:11.229199 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:18.936677 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:18.936637 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:19.048692 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:19.048654 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:35.675799 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:35.675702 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:36.089253 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:36.089215 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:46.051907 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:46.051870 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:47.432927 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:47.432885 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:49.671924 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:49.671880 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:49.769687 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:49.769658 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:51.382065 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:51.382009 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:51.506541 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:51.506492 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:51.916946 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:51.916915 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:52.046278 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:52.046247 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:54.237770 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:54.237733 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:54.488571 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:54.488481 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:55.557633 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.557602 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb"] Jul 09 14:36:55.557987 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.557906 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cc2667b-28b8-4818-af85-c92005c475ca" containerName="console" Jul 09 14:36:55.557987 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.557916 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cc2667b-28b8-4818-af85-c92005c475ca" containerName="console" Jul 09 14:36:55.557987 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.557972 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cc2667b-28b8-4818-af85-c92005c475ca" containerName="console" Jul 09 14:36:55.560858 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.560842 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb" Jul 09 14:36:55.563272 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.563251 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 14:36:55.563962 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.563945 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-znd7b\"" Jul 09 14:36:55.564061 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.563943 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 14:36:55.569743 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.569721 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb"] Jul 09 14:36:55.656211 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.656176 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/324625c1-a5fb-4056-b5c4-1f4f8b94657f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7kkvb\" (UID: \"324625c1-a5fb-4056-b5c4-1f4f8b94657f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb" Jul 09 14:36:55.656373 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.656215 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-458ns\" (UniqueName: \"kubernetes.io/projected/324625c1-a5fb-4056-b5c4-1f4f8b94657f-kube-api-access-458ns\") pod \"cert-manager-cainjector-559cdd8c87-7kkvb\" (UID: \"324625c1-a5fb-4056-b5c4-1f4f8b94657f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb" Jul 09 14:36:55.756988 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.756953 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/324625c1-a5fb-4056-b5c4-1f4f8b94657f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7kkvb\" (UID: \"324625c1-a5fb-4056-b5c4-1f4f8b94657f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb" Jul 09 14:36:55.756988 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.756985 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-458ns\" (UniqueName: \"kubernetes.io/projected/324625c1-a5fb-4056-b5c4-1f4f8b94657f-kube-api-access-458ns\") pod \"cert-manager-cainjector-559cdd8c87-7kkvb\" (UID: \"324625c1-a5fb-4056-b5c4-1f4f8b94657f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb" Jul 09 14:36:55.765435 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.765406 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-458ns\" (UniqueName: \"kubernetes.io/projected/324625c1-a5fb-4056-b5c4-1f4f8b94657f-kube-api-access-458ns\") pod \"cert-manager-cainjector-559cdd8c87-7kkvb\" (UID: \"324625c1-a5fb-4056-b5c4-1f4f8b94657f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb" Jul 09 14:36:55.765435 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.765415 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/324625c1-a5fb-4056-b5c4-1f4f8b94657f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-7kkvb\" (UID: \"324625c1-a5fb-4056-b5c4-1f4f8b94657f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb" Jul 09 14:36:55.870344 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.870283 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb" Jul 09 14:36:55.995434 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:55.995401 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb"] Jul 09 14:36:55.998228 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:36:55.998199 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod324625c1_a5fb_4056_b5c4_1f4f8b94657f.slice/crio-e207f11ed4cf96370ea69003a723b5ff732988dec82a8fb1d6f609c4bc167459 WatchSource:0}: Error finding container e207f11ed4cf96370ea69003a723b5ff732988dec82a8fb1d6f609c4bc167459: Status 404 returned error can't find the container with id e207f11ed4cf96370ea69003a723b5ff732988dec82a8fb1d6f609c4bc167459 Jul 09 14:36:56.414777 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:56.414744 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb" event={"ID":"324625c1-a5fb-4056-b5c4-1f4f8b94657f","Type":"ContainerStarted","Data":"e207f11ed4cf96370ea69003a723b5ff732988dec82a8fb1d6f609c4bc167459"} Jul 09 14:36:56.646776 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:56.646742 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:56.747762 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:56.747716 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:57.301557 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:57.301495 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:36:59.429925 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:59.429894 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb" event={"ID":"324625c1-a5fb-4056-b5c4-1f4f8b94657f","Type":"ContainerStarted","Data":"4f023024a2d26d0cc1d761391ba88298b0cd516c8ccc0181ac35c48fb1dc5e76"} Jul 09 14:36:59.450792 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:36:59.450737 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-7kkvb" podStartSLOduration=1.247088449 podStartE2EDuration="4.45072094s" totalImagesPullingTime="3.203632491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:36:59.449126951 +0000 UTC m=+299.651054115" watchObservedRunningTime="2026-07-09 14:36:59.45072094 +0000 UTC m=+299.652648104" Jul 09 14:37:00.100379 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:00.100343 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vphpl_ce1628fd-5991-4d14-b958-9f1d28e671be/console-operator/1.log" Jul 09 14:37:00.102208 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:00.102184 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vphpl_ce1628fd-5991-4d14-b958-9f1d28e671be/console-operator/1.log" Jul 09 14:37:00.104006 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:00.103981 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vn2j9_0e2ccbba-82ab-40ec-ab03-121c974af538/ovn-acl-logging/0.log" Jul 09 14:37:00.109092 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:00.109073 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vn2j9_0e2ccbba-82ab-40ec-ab03-121c974af538/ovn-acl-logging/0.log" Jul 09 14:37:00.115166 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:00.115150 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 14:37:01.864424 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:01.864384 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:02.294178 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.294147 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m2n2c"] Jul 09 14:37:02.297150 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.297132 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m2n2c" Jul 09 14:37:02.299776 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.299761 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-w8bm9\"" Jul 09 14:37:02.307633 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.307605 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrptk\" (UniqueName: \"kubernetes.io/projected/22761c61-913c-4e18-9b54-656c4084898a-kube-api-access-qrptk\") pod \"cert-manager-55b4d954d5-m2n2c\" (UID: \"22761c61-913c-4e18-9b54-656c4084898a\") " pod="cert-manager/cert-manager-55b4d954d5-m2n2c" Jul 09 14:37:02.307774 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.307741 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22761c61-913c-4e18-9b54-656c4084898a-bound-sa-token\") pod \"cert-manager-55b4d954d5-m2n2c\" (UID: \"22761c61-913c-4e18-9b54-656c4084898a\") " pod="cert-manager/cert-manager-55b4d954d5-m2n2c" Jul 09 14:37:02.308624 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.308607 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m2n2c"] Jul 09 14:37:02.408798 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.408769 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22761c61-913c-4e18-9b54-656c4084898a-bound-sa-token\") pod \"cert-manager-55b4d954d5-m2n2c\" (UID: \"22761c61-913c-4e18-9b54-656c4084898a\") " pod="cert-manager/cert-manager-55b4d954d5-m2n2c" Jul 09 14:37:02.408970 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.408822 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrptk\" (UniqueName: \"kubernetes.io/projected/22761c61-913c-4e18-9b54-656c4084898a-kube-api-access-qrptk\") pod \"cert-manager-55b4d954d5-m2n2c\" (UID: \"22761c61-913c-4e18-9b54-656c4084898a\") " pod="cert-manager/cert-manager-55b4d954d5-m2n2c" Jul 09 14:37:02.422113 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.422085 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22761c61-913c-4e18-9b54-656c4084898a-bound-sa-token\") pod \"cert-manager-55b4d954d5-m2n2c\" (UID: \"22761c61-913c-4e18-9b54-656c4084898a\") " pod="cert-manager/cert-manager-55b4d954d5-m2n2c" Jul 09 14:37:02.422594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.422574 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrptk\" (UniqueName: \"kubernetes.io/projected/22761c61-913c-4e18-9b54-656c4084898a-kube-api-access-qrptk\") pod \"cert-manager-55b4d954d5-m2n2c\" (UID: \"22761c61-913c-4e18-9b54-656c4084898a\") " pod="cert-manager/cert-manager-55b4d954d5-m2n2c" Jul 09 14:37:02.468239 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.468213 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:02.564148 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.564080 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:02.606290 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.606233 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-m2n2c" Jul 09 14:37:02.736717 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:02.736691 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-m2n2c"] Jul 09 14:37:02.739151 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:37:02.739115 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22761c61_913c_4e18_9b54_656c4084898a.slice/crio-44993e77f7f78a9be61b4fe94577cf54390db88f777f5bbfc760d0c1e5452f5c WatchSource:0}: Error finding container 44993e77f7f78a9be61b4fe94577cf54390db88f777f5bbfc760d0c1e5452f5c: Status 404 returned error can't find the container with id 44993e77f7f78a9be61b4fe94577cf54390db88f777f5bbfc760d0c1e5452f5c Jul 09 14:37:03.445083 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:03.445046 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m2n2c" event={"ID":"22761c61-913c-4e18-9b54-656c4084898a","Type":"ContainerStarted","Data":"2636be77831fafe85d42ad48430a929bebfbed50b6aefbed208deb27c377c7bb"} Jul 09 14:37:03.445422 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:03.445092 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-m2n2c" event={"ID":"22761c61-913c-4e18-9b54-656c4084898a","Type":"ContainerStarted","Data":"44993e77f7f78a9be61b4fe94577cf54390db88f777f5bbfc760d0c1e5452f5c"} Jul 09 14:37:03.462829 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:03.462782 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-m2n2c" podStartSLOduration=1.462766286 podStartE2EDuration="1.462766286s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:37:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:37:03.46116974 +0000 UTC m=+303.663096942" watchObservedRunningTime="2026-07-09 14:37:03.462766286 +0000 UTC m=+303.664693449" Jul 09 14:37:03.514850 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:03.514821 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:09.200230 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:09.200191 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:09.303222 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:09.303184 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:10.851389 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:10.851329 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:27.146070 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:27.146033 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:28.418091 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.418058 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9"] Jul 09 14:37:28.421479 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.421462 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.424445 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.424425 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 14:37:28.424445 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.424437 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 14:37:28.424598 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.424453 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kkz68\"" Jul 09 14:37:28.424642 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.424615 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 14:37:28.425110 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.425095 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 14:37:28.456262 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.456229 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9"] Jul 09 14:37:28.525460 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.525427 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bhfq\" (UniqueName: \"kubernetes.io/projected/777e35d7-a56e-4117-a49d-b5b5ee8aa470-kube-api-access-2bhfq\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.525634 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.525562 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/777e35d7-a56e-4117-a49d-b5b5ee8aa470-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.525634 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.525593 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/777e35d7-a56e-4117-a49d-b5b5ee8aa470-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.525751 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.525651 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/777e35d7-a56e-4117-a49d-b5b5ee8aa470-tmp\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.525751 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.525698 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/777e35d7-a56e-4117-a49d-b5b5ee8aa470-manifests\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.626702 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.626674 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/777e35d7-a56e-4117-a49d-b5b5ee8aa470-manifests\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.626876 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.626719 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bhfq\" (UniqueName: \"kubernetes.io/projected/777e35d7-a56e-4117-a49d-b5b5ee8aa470-kube-api-access-2bhfq\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.626876 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.626768 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/777e35d7-a56e-4117-a49d-b5b5ee8aa470-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.626876 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.626783 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/777e35d7-a56e-4117-a49d-b5b5ee8aa470-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.626876 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.626812 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/777e35d7-a56e-4117-a49d-b5b5ee8aa470-tmp\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.627160 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.627133 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/777e35d7-a56e-4117-a49d-b5b5ee8aa470-manifests\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.629233 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.629212 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/777e35d7-a56e-4117-a49d-b5b5ee8aa470-tmp\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.629456 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.629439 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/777e35d7-a56e-4117-a49d-b5b5ee8aa470-webhook-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.629499 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.629440 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/777e35d7-a56e-4117-a49d-b5b5ee8aa470-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.635648 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.635625 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bhfq\" (UniqueName: \"kubernetes.io/projected/777e35d7-a56e-4117-a49d-b5b5ee8aa470-kube-api-access-2bhfq\") pod \"opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9\" (UID: \"777e35d7-a56e-4117-a49d-b5b5ee8aa470\") " pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.731665 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.731638 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:28.897484 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.897453 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9"] Jul 09 14:37:28.901816 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:37:28.901787 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod777e35d7_a56e_4117_a49d_b5b5ee8aa470.slice/crio-b7fe4fd66cdff1fa86d4534782458f383f092335cc4da358a77675c855889e95 WatchSource:0}: Error finding container b7fe4fd66cdff1fa86d4534782458f383f092335cc4da358a77675c855889e95: Status 404 returned error can't find the container with id b7fe4fd66cdff1fa86d4534782458f383f092335cc4da358a77675c855889e95 Jul 09 14:37:28.903766 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:28.903748 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:37:29.401023 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:29.400981 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:29.546461 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:29.546425 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" event={"ID":"777e35d7-a56e-4117-a49d-b5b5ee8aa470","Type":"ContainerStarted","Data":"b7fe4fd66cdff1fa86d4534782458f383f092335cc4da358a77675c855889e95"} Jul 09 14:37:32.563399 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:32.563363 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" event={"ID":"777e35d7-a56e-4117-a49d-b5b5ee8aa470","Type":"ContainerStarted","Data":"21b5f696a52c25b3cd2c781f03b79c2c68287bf7d69bce80fc90beffc06a96d4"} Jul 09 14:37:33.569357 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:33.569319 2570 generic.go:356] "Generic (PLEG): container finished" podID="777e35d7-a56e-4117-a49d-b5b5ee8aa470" containerID="21b5f696a52c25b3cd2c781f03b79c2c68287bf7d69bce80fc90beffc06a96d4" exitCode=0 Jul 09 14:37:33.569749 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:33.569397 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" event={"ID":"777e35d7-a56e-4117-a49d-b5b5ee8aa470","Type":"ContainerDied","Data":"21b5f696a52c25b3cd2c781f03b79c2c68287bf7d69bce80fc90beffc06a96d4"} Jul 09 14:37:34.576002 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:34.575964 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" event={"ID":"777e35d7-a56e-4117-a49d-b5b5ee8aa470","Type":"ContainerStarted","Data":"4d9ff867b0992aeb5595dec479ce99c389bd03b87dbfccc698c3ab84c8ba1114"} Jul 09 14:37:34.576434 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:34.576121 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:40.176592 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:40.176554 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:40.272797 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:40.272762 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:40.423684 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:40.423643 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:41.156141 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:41.156101 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:42.655364 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:42.655328 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:42.756618 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:42.756574 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:45.582390 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:45.582362 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" Jul 09 14:37:45.605108 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:45.605059 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9" podStartSLOduration=13.258066338999999 podStartE2EDuration="17.605042274s" totalImagesPullingTime="3.254340629s" totalInitContainerRuntime="1.092635306s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:37:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:37:34.602401788 +0000 UTC m=+334.804328971" watchObservedRunningTime="2026-07-09 14:37:45.605042274 +0000 UTC m=+345.806969437" Jul 09 14:37:48.209914 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:48.209881 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:48.344573 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:48.344508 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:54.027076 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.026974 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:54.061740 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.061701 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj"] Jul 09 14:37:54.064978 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.064961 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" Jul 09 14:37:54.068175 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.068153 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 14:37:54.068298 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.068157 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 14:37:54.068728 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.068702 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 14:37:54.069695 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.069678 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 14:37:54.092660 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.092633 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj"] Jul 09 14:37:54.138777 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.138738 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c-tls-certs\") pod \"kube-auth-proxy-7f576c6fff-46kfj\" (UID: \"6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c\") " pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" Jul 09 14:37:54.138777 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.138779 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r9xm\" (UniqueName: \"kubernetes.io/projected/6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c-kube-api-access-7r9xm\") pod \"kube-auth-proxy-7f576c6fff-46kfj\" (UID: \"6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c\") " pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" Jul 09 14:37:54.138981 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.138810 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c-tmp\") pod \"kube-auth-proxy-7f576c6fff-46kfj\" (UID: \"6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c\") " pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" Jul 09 14:37:54.218509 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.218476 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:54.240154 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.240117 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c-tls-certs\") pod \"kube-auth-proxy-7f576c6fff-46kfj\" (UID: \"6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c\") " pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" Jul 09 14:37:54.240343 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.240168 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r9xm\" (UniqueName: \"kubernetes.io/projected/6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c-kube-api-access-7r9xm\") pod \"kube-auth-proxy-7f576c6fff-46kfj\" (UID: \"6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c\") " pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" Jul 09 14:37:54.240343 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.240218 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c-tmp\") pod \"kube-auth-proxy-7f576c6fff-46kfj\" (UID: \"6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c\") " pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" Jul 09 14:37:54.242811 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.242785 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c-tmp\") pod \"kube-auth-proxy-7f576c6fff-46kfj\" (UID: \"6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c\") " pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" Jul 09 14:37:54.243105 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.243087 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c-tls-certs\") pod \"kube-auth-proxy-7f576c6fff-46kfj\" (UID: \"6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c\") " pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" Jul 09 14:37:54.254457 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.254432 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r9xm\" (UniqueName: \"kubernetes.io/projected/6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c-kube-api-access-7r9xm\") pod \"kube-auth-proxy-7f576c6fff-46kfj\" (UID: \"6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c\") " pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" Jul 09 14:37:54.375968 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.375881 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" Jul 09 14:37:54.452739 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.452711 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2k5tz"] Jul 09 14:37:54.456092 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.456072 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" Jul 09 14:37:54.460070 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.460043 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-4kfj6\"" Jul 09 14:37:54.460158 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.460084 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 09 14:37:54.473068 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.473039 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2k5tz"] Jul 09 14:37:54.500488 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.500440 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:54.541838 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.541785 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhhwv\" (UniqueName: \"kubernetes.io/projected/42d3cfd0-af4d-4d99-b12d-e8a02c6e1670-kube-api-access-fhhwv\") pod \"odh-model-controller-7998c67dc4-2k5tz\" (UID: \"42d3cfd0-af4d-4d99-b12d-e8a02c6e1670\") " pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" Jul 09 14:37:54.542035 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.541872 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42d3cfd0-af4d-4d99-b12d-e8a02c6e1670-cert\") pod \"odh-model-controller-7998c67dc4-2k5tz\" (UID: \"42d3cfd0-af4d-4d99-b12d-e8a02c6e1670\") " pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" Jul 09 14:37:54.545021 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.544996 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj"] Jul 09 14:37:54.546970 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:37:54.546944 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a22bd20_ecf2_4b8f_b5d5_27ba32a38c7c.slice/crio-3650159f16af440381ade790b7dcece4266c5abfcb60b619748a6a673118c049 WatchSource:0}: Error finding container 3650159f16af440381ade790b7dcece4266c5abfcb60b619748a6a673118c049: Status 404 returned error can't find the container with id 3650159f16af440381ade790b7dcece4266c5abfcb60b619748a6a673118c049 Jul 09 14:37:54.622537 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.622497 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:54.642636 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.642575 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42d3cfd0-af4d-4d99-b12d-e8a02c6e1670-cert\") pod \"odh-model-controller-7998c67dc4-2k5tz\" (UID: \"42d3cfd0-af4d-4d99-b12d-e8a02c6e1670\") " pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" Jul 09 14:37:54.642751 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.642640 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhhwv\" (UniqueName: \"kubernetes.io/projected/42d3cfd0-af4d-4d99-b12d-e8a02c6e1670-kube-api-access-fhhwv\") pod \"odh-model-controller-7998c67dc4-2k5tz\" (UID: \"42d3cfd0-af4d-4d99-b12d-e8a02c6e1670\") " pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" Jul 09 14:37:54.642751 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:37:54.642733 2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 09 14:37:54.642860 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:37:54.642804 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/42d3cfd0-af4d-4d99-b12d-e8a02c6e1670-cert podName:42d3cfd0-af4d-4d99-b12d-e8a02c6e1670 nodeName:}" failed. No retries permitted until 2026-07-09 14:37:55.142784687 +0000 UTC m=+355.344711842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/42d3cfd0-af4d-4d99-b12d-e8a02c6e1670-cert") pod "odh-model-controller-7998c67dc4-2k5tz" (UID: "42d3cfd0-af4d-4d99-b12d-e8a02c6e1670") : secret "odh-model-controller-webhook-cert" not found Jul 09 14:37:54.658297 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.658270 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" event={"ID":"6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c","Type":"ContainerStarted","Data":"3650159f16af440381ade790b7dcece4266c5abfcb60b619748a6a673118c049"} Jul 09 14:37:54.693725 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.693690 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhhwv\" (UniqueName: \"kubernetes.io/projected/42d3cfd0-af4d-4d99-b12d-e8a02c6e1670-kube-api-access-fhhwv\") pod \"odh-model-controller-7998c67dc4-2k5tz\" (UID: \"42d3cfd0-af4d-4d99-b12d-e8a02c6e1670\") " pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" Jul 09 14:37:54.936953 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:54.936916 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:55.148006 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.147972 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42d3cfd0-af4d-4d99-b12d-e8a02c6e1670-cert\") pod \"odh-model-controller-7998c67dc4-2k5tz\" (UID: \"42d3cfd0-af4d-4d99-b12d-e8a02c6e1670\") " pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" Jul 09 14:37:55.150725 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.150693 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42d3cfd0-af4d-4d99-b12d-e8a02c6e1670-cert\") pod \"odh-model-controller-7998c67dc4-2k5tz\" (UID: \"42d3cfd0-af4d-4d99-b12d-e8a02c6e1670\") " pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" Jul 09 14:37:55.366839 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.366758 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" Jul 09 14:37:55.546372 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.546338 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-2k5tz"] Jul 09 14:37:55.548621 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:37:55.548589 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d3cfd0_af4d_4d99_b12d_e8a02c6e1670.slice/crio-c8b396ee72c6ab5bddf3d880ca0d83a0cf2f4a78138a657adfb342497cf7150f WatchSource:0}: Error finding container c8b396ee72c6ab5bddf3d880ca0d83a0cf2f4a78138a657adfb342497cf7150f: Status 404 returned error can't find the container with id c8b396ee72c6ab5bddf3d880ca0d83a0cf2f4a78138a657adfb342497cf7150f Jul 09 14:37:55.665037 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.664951 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" event={"ID":"42d3cfd0-af4d-4d99-b12d-e8a02c6e1670","Type":"ContainerStarted","Data":"c8b396ee72c6ab5bddf3d880ca0d83a0cf2f4a78138a657adfb342497cf7150f"} Jul 09 14:37:55.774652 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.774612 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5lglm"] Jul 09 14:37:55.778714 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.778689 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:55.779614 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.779590 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" Jul 09 14:37:55.782754 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.782547 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 14:37:55.782754 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.782555 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8m7jk\"" Jul 09 14:37:55.802681 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.802645 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5lglm"] Jul 09 14:37:55.853680 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.853653 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e6e606-8fdf-44dc-8760-5e2b20569333-tls-certs\") pod \"model-serving-api-54d89bd5fc-5lglm\" (UID: \"67e6e606-8fdf-44dc-8760-5e2b20569333\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" Jul 09 14:37:55.853822 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.853702 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5f56\" (UniqueName: \"kubernetes.io/projected/67e6e606-8fdf-44dc-8760-5e2b20569333-kube-api-access-b5f56\") pod \"model-serving-api-54d89bd5fc-5lglm\" (UID: \"67e6e606-8fdf-44dc-8760-5e2b20569333\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" Jul 09 14:37:55.954985 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.954882 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e6e606-8fdf-44dc-8760-5e2b20569333-tls-certs\") pod \"model-serving-api-54d89bd5fc-5lglm\" (UID: \"67e6e606-8fdf-44dc-8760-5e2b20569333\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" Jul 09 14:37:55.955143 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.955031 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5f56\" (UniqueName: \"kubernetes.io/projected/67e6e606-8fdf-44dc-8760-5e2b20569333-kube-api-access-b5f56\") pod \"model-serving-api-54d89bd5fc-5lglm\" (UID: \"67e6e606-8fdf-44dc-8760-5e2b20569333\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" Jul 09 14:37:55.955143 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:37:55.955042 2570 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 09 14:37:55.955230 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:37:55.955153 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67e6e606-8fdf-44dc-8760-5e2b20569333-tls-certs podName:67e6e606-8fdf-44dc-8760-5e2b20569333 nodeName:}" failed. No retries permitted until 2026-07-09 14:37:56.455129407 +0000 UTC m=+356.657056555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/67e6e606-8fdf-44dc-8760-5e2b20569333-tls-certs") pod "model-serving-api-54d89bd5fc-5lglm" (UID: "67e6e606-8fdf-44dc-8760-5e2b20569333") : secret "model-serving-api-tls" not found Jul 09 14:37:55.968738 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:55.968708 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5f56\" (UniqueName: \"kubernetes.io/projected/67e6e606-8fdf-44dc-8760-5e2b20569333-kube-api-access-b5f56\") pod \"model-serving-api-54d89bd5fc-5lglm\" (UID: \"67e6e606-8fdf-44dc-8760-5e2b20569333\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" Jul 09 14:37:56.170249 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.170216 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5"] Jul 09 14:37:56.172147 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.172115 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:56.173828 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.173794 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.177168 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.176937 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 14:37:56.177168 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.177010 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 14:37:56.177168 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.177071 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 14:37:56.177337 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.177275 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 14:37:56.177337 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.177280 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2rmd6\"" Jul 09 14:37:56.200393 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.200367 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5"] Jul 09 14:37:56.257203 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.257119 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-668q6\" (UniqueName: \"kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-kube-api-access-668q6\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.257349 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.257232 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.257615 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.257587 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.257726 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.257655 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-cacerts\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.257726 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.257683 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.257836 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.257736 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/037b154c-dbca-41d4-906d-db7386e62292-local-certs\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.257836 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.257765 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-istio-token\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.285143 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.285079 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:56.358663 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.358627 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.358818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.358685 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.358818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.358724 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-cacerts\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.358818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.358750 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.358818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.358781 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/037b154c-dbca-41d4-906d-db7386e62292-local-certs\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.358818 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.358810 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-istio-token\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.359078 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.358885 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-668q6\" (UniqueName: \"kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-kube-api-access-668q6\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.359432 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.359392 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.361232 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.361200 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/037b154c-dbca-41d4-906d-db7386e62292-local-certs\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.361232 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.361221 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.361594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.361576 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-cacerts\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.361693 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.361672 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.392187 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.392156 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-668q6\" (UniqueName: \"kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-kube-api-access-668q6\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.394877 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.394851 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-istio-token\") pod \"istiod-openshift-gateway-7574459656-9d4w5\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.447734 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.447699 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:56.459729 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.459703 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e6e606-8fdf-44dc-8760-5e2b20569333-tls-certs\") pod \"model-serving-api-54d89bd5fc-5lglm\" (UID: \"67e6e606-8fdf-44dc-8760-5e2b20569333\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" Jul 09 14:37:56.462371 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.462344 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67e6e606-8fdf-44dc-8760-5e2b20569333-tls-certs\") pod \"model-serving-api-54d89bd5fc-5lglm\" (UID: \"67e6e606-8fdf-44dc-8760-5e2b20569333\") " pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" Jul 09 14:37:56.486440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.486415 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:37:56.660648 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.660557 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5"] Jul 09 14:37:56.662798 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:37:56.662766 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod037b154c_dbca_41d4_906d_db7386e62292.slice/crio-01d9cd26135a484e315754cb21fc000fde807838eac798dc858feddef33046b6 WatchSource:0}: Error finding container 01d9cd26135a484e315754cb21fc000fde807838eac798dc858feddef33046b6: Status 404 returned error can't find the container with id 01d9cd26135a484e315754cb21fc000fde807838eac798dc858feddef33046b6 Jul 09 14:37:56.674073 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.674031 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" event={"ID":"037b154c-dbca-41d4-906d-db7386e62292","Type":"ContainerStarted","Data":"01d9cd26135a484e315754cb21fc000fde807838eac798dc858feddef33046b6"} Jul 09 14:37:56.692083 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.692061 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" Jul 09 14:37:56.872301 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:56.872206 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5lglm"] Jul 09 14:37:56.875877 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:37:56.875808 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67e6e606_8fdf_44dc_8760_5e2b20569333.slice/crio-375302078a3fd6a7fb077afbb2adeb100ec093ee19825352fbd72ce41b059df7 WatchSource:0}: Error finding container 375302078a3fd6a7fb077afbb2adeb100ec093ee19825352fbd72ce41b059df7: Status 404 returned error can't find the container with id 375302078a3fd6a7fb077afbb2adeb100ec093ee19825352fbd72ce41b059df7 Jul 09 14:37:57.446865 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:57.446771 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:37:57.683313 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:57.683274 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" event={"ID":"67e6e606-8fdf-44dc-8760-5e2b20569333","Type":"ContainerStarted","Data":"375302078a3fd6a7fb077afbb2adeb100ec093ee19825352fbd72ce41b059df7"} Jul 09 14:37:59.696383 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:59.696336 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" event={"ID":"42d3cfd0-af4d-4d99-b12d-e8a02c6e1670","Type":"ContainerStarted","Data":"8d387c22912123c2296faaecfb89a00b8d78fdec9644332e4f2a9e41db23af05"} Jul 09 14:37:59.696922 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:59.696616 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" Jul 09 14:37:59.698132 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:59.698110 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" event={"ID":"6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c","Type":"ContainerStarted","Data":"f64a94da5694fd09135d0899974df0e525cb6916cf8be9fcb30deefb35acd6e4"} Jul 09 14:37:59.729358 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:59.729298 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7f576c6fff-46kfj" podStartSLOduration=0.911737008 podStartE2EDuration="5.729276681s" totalImagesPullingTime="4.817539673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:37:59.728639286 +0000 UTC m=+359.930566478" watchObservedRunningTime="2026-07-09 14:37:59.729276681 +0000 UTC m=+359.931203846" Jul 09 14:37:59.731201 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:37:59.731156 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" podStartSLOduration=1.869216647 podStartE2EDuration="5.731144761s" totalImagesPullingTime="3.861928114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:37:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:37:59.714490752 +0000 UTC m=+359.916417936" watchObservedRunningTime="2026-07-09 14:37:59.731144761 +0000 UTC m=+359.933071947" Jul 09 14:38:01.284108 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:01.284070 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 14:38:01.284375 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:01.284166 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 14:38:01.711461 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:01.711417 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" event={"ID":"037b154c-dbca-41d4-906d-db7386e62292","Type":"ContainerStarted","Data":"f3a0308293da8860528138bb61fb47ad8aeae624238f0a6731270693a4db6029"} Jul 09 14:38:01.711641 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:01.711596 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:38:01.713062 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:01.713032 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" event={"ID":"67e6e606-8fdf-44dc-8760-5e2b20569333","Type":"ContainerStarted","Data":"57b87f61ec60d2758fb9f94dfc1d7773383139ea6f0fbd38822fd50c82fc6200"} Jul 09 14:38:01.713205 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:01.713154 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" Jul 09 14:38:01.733721 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:01.733678 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" podStartSLOduration=1.11575918 podStartE2EDuration="5.733665922s" totalImagesPullingTime="4.617906742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:38:01.731848668 +0000 UTC m=+361.933775852" watchObservedRunningTime="2026-07-09 14:38:01.733665922 +0000 UTC m=+361.935593085" Jul 09 14:38:02.165537 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:02.165415 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:02.270056 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:02.270010 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:02.617734 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:02.617654 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:02.719416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:02.719388 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:38:02.742337 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:02.742290 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" podStartSLOduration=3.336030021 podStartE2EDuration="7.742274564s" totalImagesPullingTime="4.406244543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:37:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:38:01.753172674 +0000 UTC m=+361.955099839" watchObservedRunningTime="2026-07-09 14:38:02.742274564 +0000 UTC m=+362.944201728" Jul 09 14:38:02.746492 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:02.746465 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:02.946384 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:02.946354 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:06.627424 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.627388 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:06.871118 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.871077 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd"] Jul 09 14:38:06.879917 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.879857 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg"] Jul 09 14:38:06.880030 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.879982 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" Jul 09 14:38:06.882913 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.882895 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" Jul 09 14:38:06.889488 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.889469 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-vj8cj\"" Jul 09 14:38:06.891376 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.891357 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 09 14:38:06.893789 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.893769 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-n7zf9\"" Jul 09 14:38:06.896887 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.896873 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 14:38:06.920188 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.920166 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd"] Jul 09 14:38:06.933050 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.933022 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:06.951784 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.951761 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg"] Jul 09 14:38:06.973966 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.973939 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lppnw\" (UniqueName: \"kubernetes.io/projected/ead04426-20a8-4e4b-8b18-0af3523a27d9-kube-api-access-lppnw\") pod \"kserve-controller-manager-d6f4b65b8-7jkvd\" (UID: \"ead04426-20a8-4e4b-8b18-0af3523a27d9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" Jul 09 14:38:06.974062 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.973983 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4zmz\" (UniqueName: \"kubernetes.io/projected/85b52d60-844e-4614-81b7-219375a5b765-kube-api-access-l4zmz\") pod \"llmisvc-controller-manager-777c6bd7d5-xwkwg\" (UID: \"85b52d60-844e-4614-81b7-219375a5b765\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" Jul 09 14:38:06.974062 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.974037 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85b52d60-844e-4614-81b7-219375a5b765-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xwkwg\" (UID: \"85b52d60-844e-4614-81b7-219375a5b765\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" Jul 09 14:38:06.974128 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:06.974084 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ead04426-20a8-4e4b-8b18-0af3523a27d9-cert\") pod \"kserve-controller-manager-d6f4b65b8-7jkvd\" (UID: \"ead04426-20a8-4e4b-8b18-0af3523a27d9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" Jul 09 14:38:07.075001 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.074973 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4zmz\" (UniqueName: \"kubernetes.io/projected/85b52d60-844e-4614-81b7-219375a5b765-kube-api-access-l4zmz\") pod \"llmisvc-controller-manager-777c6bd7d5-xwkwg\" (UID: \"85b52d60-844e-4614-81b7-219375a5b765\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" Jul 09 14:38:07.075184 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.075022 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85b52d60-844e-4614-81b7-219375a5b765-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xwkwg\" (UID: \"85b52d60-844e-4614-81b7-219375a5b765\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" Jul 09 14:38:07.075184 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.075074 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ead04426-20a8-4e4b-8b18-0af3523a27d9-cert\") pod \"kserve-controller-manager-d6f4b65b8-7jkvd\" (UID: \"ead04426-20a8-4e4b-8b18-0af3523a27d9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" Jul 09 14:38:07.075184 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.075119 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lppnw\" (UniqueName: \"kubernetes.io/projected/ead04426-20a8-4e4b-8b18-0af3523a27d9-kube-api-access-lppnw\") pod \"kserve-controller-manager-d6f4b65b8-7jkvd\" (UID: \"ead04426-20a8-4e4b-8b18-0af3523a27d9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" Jul 09 14:38:07.075345 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:38:07.075189 2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 09 14:38:07.075345 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:38:07.075261 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b52d60-844e-4614-81b7-219375a5b765-cert podName:85b52d60-844e-4614-81b7-219375a5b765 nodeName:}" failed. No retries permitted until 2026-07-09 14:38:07.575241021 +0000 UTC m=+367.777168179 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/85b52d60-844e-4614-81b7-219375a5b765-cert") pod "llmisvc-controller-manager-777c6bd7d5-xwkwg" (UID: "85b52d60-844e-4614-81b7-219375a5b765") : secret "llmisvc-webhook-server-cert" not found Jul 09 14:38:07.077594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.077566 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ead04426-20a8-4e4b-8b18-0af3523a27d9-cert\") pod \"kserve-controller-manager-d6f4b65b8-7jkvd\" (UID: \"ead04426-20a8-4e4b-8b18-0af3523a27d9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" Jul 09 14:38:07.088325 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.088304 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lppnw\" (UniqueName: \"kubernetes.io/projected/ead04426-20a8-4e4b-8b18-0af3523a27d9-kube-api-access-lppnw\") pod \"kserve-controller-manager-d6f4b65b8-7jkvd\" (UID: \"ead04426-20a8-4e4b-8b18-0af3523a27d9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" Jul 09 14:38:07.089567 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.089548 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4zmz\" (UniqueName: \"kubernetes.io/projected/85b52d60-844e-4614-81b7-219375a5b765-kube-api-access-l4zmz\") pod \"llmisvc-controller-manager-777c6bd7d5-xwkwg\" (UID: \"85b52d60-844e-4614-81b7-219375a5b765\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" Jul 09 14:38:07.102395 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.102374 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:07.191056 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.191033 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" Jul 09 14:38:07.211415 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.211365 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:07.381130 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.381104 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd"] Jul 09 14:38:07.382053 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:38:07.382033 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead04426_20a8_4e4b_8b18_0af3523a27d9.slice/crio-7554fef3e0408361f7edad2afb61d5714fa910768053cb059b488c9b1f15c62e WatchSource:0}: Error finding container 7554fef3e0408361f7edad2afb61d5714fa910768053cb059b488c9b1f15c62e: Status 404 returned error can't find the container with id 7554fef3e0408361f7edad2afb61d5714fa910768053cb059b488c9b1f15c62e Jul 09 14:38:07.511976 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.511887 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5"] Jul 09 14:38:07.512135 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.512113 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" podUID="037b154c-dbca-41d4-906d-db7386e62292" containerName="discovery" containerID="cri-o://f3a0308293da8860528138bb61fb47ad8aeae624238f0a6731270693a4db6029" gracePeriod=30 Jul 09 14:38:07.581291 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.581264 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85b52d60-844e-4614-81b7-219375a5b765-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xwkwg\" (UID: \"85b52d60-844e-4614-81b7-219375a5b765\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" Jul 09 14:38:07.583804 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.583778 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/85b52d60-844e-4614-81b7-219375a5b765-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-xwkwg\" (UID: \"85b52d60-844e-4614-81b7-219375a5b765\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" Jul 09 14:38:07.752702 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.752670 2570 generic.go:356] "Generic (PLEG): container finished" podID="037b154c-dbca-41d4-906d-db7386e62292" containerID="f3a0308293da8860528138bb61fb47ad8aeae624238f0a6731270693a4db6029" exitCode=0 Jul 09 14:38:07.753110 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.752787 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" event={"ID":"037b154c-dbca-41d4-906d-db7386e62292","Type":"ContainerDied","Data":"f3a0308293da8860528138bb61fb47ad8aeae624238f0a6731270693a4db6029"} Jul 09 14:38:07.755221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.755193 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" event={"ID":"ead04426-20a8-4e4b-8b18-0af3523a27d9","Type":"ContainerStarted","Data":"7554fef3e0408361f7edad2afb61d5714fa910768053cb059b488c9b1f15c62e"} Jul 09 14:38:07.762642 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.762304 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:38:07.796582 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.796547 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" Jul 09 14:38:07.885737 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.885709 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-istio-token\") pod \"037b154c-dbca-41d4-906d-db7386e62292\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " Jul 09 14:38:07.885910 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.885789 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-ca-configmap\") pod \"037b154c-dbca-41d4-906d-db7386e62292\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " Jul 09 14:38:07.885910 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.885839 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-kubeconfig\") pod \"037b154c-dbca-41d4-906d-db7386e62292\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " Jul 09 14:38:07.885910 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.885873 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-668q6\" (UniqueName: \"kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-kube-api-access-668q6\") pod \"037b154c-dbca-41d4-906d-db7386e62292\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " Jul 09 14:38:07.886070 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.885993 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-dns-cert\") pod \"037b154c-dbca-41d4-906d-db7386e62292\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " Jul 09 14:38:07.886123 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.886073 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/037b154c-dbca-41d4-906d-db7386e62292-local-certs\") pod \"037b154c-dbca-41d4-906d-db7386e62292\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " Jul 09 14:38:07.886123 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.886110 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-cacerts\") pod \"037b154c-dbca-41d4-906d-db7386e62292\" (UID: \"037b154c-dbca-41d4-906d-db7386e62292\") " Jul 09 14:38:07.886228 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.886195 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "037b154c-dbca-41d4-906d-db7386e62292" (UID: "037b154c-dbca-41d4-906d-db7386e62292"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:38:07.886408 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.886380 2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-ca-configmap\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:38:07.888962 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.888917 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "037b154c-dbca-41d4-906d-db7386e62292" (UID: "037b154c-dbca-41d4-906d-db7386e62292"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:38:07.889180 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.889047 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-istio-token" (OuterVolumeSpecName: "istio-token") pod "037b154c-dbca-41d4-906d-db7386e62292" (UID: "037b154c-dbca-41d4-906d-db7386e62292"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:38:07.889436 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.889376 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/037b154c-dbca-41d4-906d-db7386e62292-local-certs" (OuterVolumeSpecName: "local-certs") pod "037b154c-dbca-41d4-906d-db7386e62292" (UID: "037b154c-dbca-41d4-906d-db7386e62292"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:38:07.889645 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.889432 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-kube-api-access-668q6" (OuterVolumeSpecName: "kube-api-access-668q6") pod "037b154c-dbca-41d4-906d-db7386e62292" (UID: "037b154c-dbca-41d4-906d-db7386e62292"). InnerVolumeSpecName "kube-api-access-668q6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:38:07.890060 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.890021 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-cacerts" (OuterVolumeSpecName: "cacerts") pod "037b154c-dbca-41d4-906d-db7386e62292" (UID: "037b154c-dbca-41d4-906d-db7386e62292"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:38:07.890060 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.890045 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "037b154c-dbca-41d4-906d-db7386e62292" (UID: "037b154c-dbca-41d4-906d-db7386e62292"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:38:07.980960 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.980931 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg"] Jul 09 14:38:07.983741 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:38:07.983711 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod85b52d60_844e_4614_81b7_219375a5b765.slice/crio-0f57c7a4e9c37dc96be916f695eb01bf32989e5be0a14ff1aeb85923cb45424a WatchSource:0}: Error finding container 0f57c7a4e9c37dc96be916f695eb01bf32989e5be0a14ff1aeb85923cb45424a: Status 404 returned error can't find the container with id 0f57c7a4e9c37dc96be916f695eb01bf32989e5be0a14ff1aeb85923cb45424a Jul 09 14:38:07.987253 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.987230 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-istio-token\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:38:07.987363 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.987283 2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-kubeconfig\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:38:07.987363 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.987298 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-668q6\" (UniqueName: \"kubernetes.io/projected/037b154c-dbca-41d4-906d-db7386e62292-kube-api-access-668q6\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:38:07.987363 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.987314 2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-istio-csr-dns-cert\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:38:07.987363 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.987326 2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/037b154c-dbca-41d4-906d-db7386e62292-local-certs\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:38:07.987363 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:07.987340 2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/037b154c-dbca-41d4-906d-db7386e62292-cacerts\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:38:08.131049 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:08.131003 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:08.297336 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:08.297300 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:08.560784 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:08.560750 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:08.761591 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:08.761554 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" event={"ID":"037b154c-dbca-41d4-906d-db7386e62292","Type":"ContainerDied","Data":"01d9cd26135a484e315754cb21fc000fde807838eac798dc858feddef33046b6"} Jul 09 14:38:08.762008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:08.761570 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5" Jul 09 14:38:08.762008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:08.761646 2570 scope.go:117] "RemoveContainer" containerID="f3a0308293da8860528138bb61fb47ad8aeae624238f0a6731270693a4db6029" Jul 09 14:38:08.763055 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:08.763026 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" event={"ID":"85b52d60-844e-4614-81b7-219375a5b765","Type":"ContainerStarted","Data":"0f57c7a4e9c37dc96be916f695eb01bf32989e5be0a14ff1aeb85923cb45424a"} Jul 09 14:38:08.813595 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:08.813532 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5"] Jul 09 14:38:08.821876 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:08.821855 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9d4w5"] Jul 09 14:38:10.240673 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:10.240640 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="037b154c-dbca-41d4-906d-db7386e62292" path="/var/lib/kubelet/pods/037b154c-dbca-41d4-906d-db7386e62292/volumes" Jul 09 14:38:10.708008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:10.707977 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-2k5tz" Jul 09 14:38:10.778498 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:10.778458 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" event={"ID":"ead04426-20a8-4e4b-8b18-0af3523a27d9","Type":"ContainerStarted","Data":"e5bbc7b8b98091c910b6430e403e9488bd5c799a85bd7e46835d5805bc18b89e"} Jul 09 14:38:10.778887 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:10.778830 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" Jul 09 14:38:10.834785 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:10.834731 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" podStartSLOduration=2.016005918 podStartE2EDuration="4.834710196s" totalImagesPullingTime="2.818704278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:38:10.833662475 +0000 UTC m=+371.035589640" watchObservedRunningTime="2026-07-09 14:38:10.834710196 +0000 UTC m=+371.036637359" Jul 09 14:38:11.786667 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:11.786634 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" event={"ID":"85b52d60-844e-4614-81b7-219375a5b765","Type":"ContainerStarted","Data":"71badba57a585b5c2e352549e1d93fb56682ee4893b08e8f112069e8c293bcaa"} Jul 09 14:38:11.818726 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:11.818679 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" podStartSLOduration=2.214216871 podStartE2EDuration="5.818662141s" totalImagesPullingTime="3.60444527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:38:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:38:11.817593757 +0000 UTC m=+372.019520921" watchObservedRunningTime="2026-07-09 14:38:11.818662141 +0000 UTC m=+372.020589304" Jul 09 14:38:12.721655 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:12.721628 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5lglm" Jul 09 14:38:12.791996 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:12.791965 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" Jul 09 14:38:41.793293 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:41.793261 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-7jkvd" Jul 09 14:38:43.799211 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:43.799183 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-xwkwg" Jul 09 14:38:49.875698 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:49.875631 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:49.954017 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:49.953978 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mps44"] Jul 09 14:38:49.954401 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:49.954384 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="037b154c-dbca-41d4-906d-db7386e62292" containerName="discovery" Jul 09 14:38:49.954488 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:49.954405 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="037b154c-dbca-41d4-906d-db7386e62292" containerName="discovery" Jul 09 14:38:49.954566 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:49.954507 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="037b154c-dbca-41d4-906d-db7386e62292" containerName="discovery" Jul 09 14:38:49.967764 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:49.967736 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mps44" Jul 09 14:38:49.971754 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:49.971726 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-stj7h\"" Jul 09 14:38:49.972615 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:49.972560 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 14:38:49.973974 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:49.973956 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 14:38:49.974583 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:49.974558 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mps44"] Jul 09 14:38:49.987056 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:49.987030 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:50.034324 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.034296 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4vbf\" (UniqueName: \"kubernetes.io/projected/d26f6255-f452-45e0-bd5e-074996bf6201-kube-api-access-l4vbf\") pod \"kuadrant-operator-catalog-mps44\" (UID: \"d26f6255-f452-45e0-bd5e-074996bf6201\") " pod="kuadrant-system/kuadrant-operator-catalog-mps44" Jul 09 14:38:50.090939 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.090908 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:50.135195 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.135129 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4vbf\" (UniqueName: \"kubernetes.io/projected/d26f6255-f452-45e0-bd5e-074996bf6201-kube-api-access-l4vbf\") pod \"kuadrant-operator-catalog-mps44\" (UID: \"d26f6255-f452-45e0-bd5e-074996bf6201\") " pod="kuadrant-system/kuadrant-operator-catalog-mps44" Jul 09 14:38:50.144444 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.144411 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4vbf\" (UniqueName: \"kubernetes.io/projected/d26f6255-f452-45e0-bd5e-074996bf6201-kube-api-access-l4vbf\") pod \"kuadrant-operator-catalog-mps44\" (UID: \"d26f6255-f452-45e0-bd5e-074996bf6201\") " pod="kuadrant-system/kuadrant-operator-catalog-mps44" Jul 09 14:38:50.283443 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.283416 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mps44" Jul 09 14:38:50.304936 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.304885 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mps44"] Jul 09 14:38:50.430451 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.430426 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mps44"] Jul 09 14:38:50.433248 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:38:50.433216 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26f6255_f452_45e0_bd5e_074996bf6201.slice/crio-b0cd6dce41d3e3688487e12a188a8247855c2b6a556b92fbea4f8fbad1bf15a8 WatchSource:0}: Error finding container b0cd6dce41d3e3688487e12a188a8247855c2b6a556b92fbea4f8fbad1bf15a8: Status 404 returned error can't find the container with id b0cd6dce41d3e3688487e12a188a8247855c2b6a556b92fbea4f8fbad1bf15a8 Jul 09 14:38:50.521766 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.521741 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mpkrr"] Jul 09 14:38:50.526277 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.526261 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" Jul 09 14:38:50.538678 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.538657 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mpkrr"] Jul 09 14:38:50.640480 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.640451 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ghjp\" (UniqueName: \"kubernetes.io/projected/ff464735-eee9-414d-bc51-c24c72face2d-kube-api-access-7ghjp\") pod \"kuadrant-operator-catalog-mpkrr\" (UID: \"ff464735-eee9-414d-bc51-c24c72face2d\") " pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" Jul 09 14:38:50.741981 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.741944 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ghjp\" (UniqueName: \"kubernetes.io/projected/ff464735-eee9-414d-bc51-c24c72face2d-kube-api-access-7ghjp\") pod \"kuadrant-operator-catalog-mpkrr\" (UID: \"ff464735-eee9-414d-bc51-c24c72face2d\") " pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" Jul 09 14:38:50.751655 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.751625 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ghjp\" (UniqueName: \"kubernetes.io/projected/ff464735-eee9-414d-bc51-c24c72face2d-kube-api-access-7ghjp\") pod \"kuadrant-operator-catalog-mpkrr\" (UID: \"ff464735-eee9-414d-bc51-c24c72face2d\") " pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" Jul 09 14:38:50.755602 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.755580 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:50.835675 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.835651 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" Jul 09 14:38:50.953088 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.953035 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:38:50.965667 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.965641 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mps44" event={"ID":"d26f6255-f452-45e0-bd5e-074996bf6201","Type":"ContainerStarted","Data":"b0cd6dce41d3e3688487e12a188a8247855c2b6a556b92fbea4f8fbad1bf15a8"} Jul 09 14:38:50.970851 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:50.970821 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mpkrr"] Jul 09 14:38:50.973405 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:38:50.973385 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff464735_eee9_414d_bc51_c24c72face2d.slice/crio-89e2021c0249e4d0e1e6f107933b5592ca9191020d8590741ef8646dca229d75 WatchSource:0}: Error finding container 89e2021c0249e4d0e1e6f107933b5592ca9191020d8590741ef8646dca229d75: Status 404 returned error can't find the container with id 89e2021c0249e4d0e1e6f107933b5592ca9191020d8590741ef8646dca229d75 Jul 09 14:38:51.976052 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:51.976012 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" event={"ID":"ff464735-eee9-414d-bc51-c24c72face2d","Type":"ContainerStarted","Data":"89e2021c0249e4d0e1e6f107933b5592ca9191020d8590741ef8646dca229d75"} Jul 09 14:38:53.988087 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:53.988040 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" event={"ID":"ff464735-eee9-414d-bc51-c24c72face2d","Type":"ContainerStarted","Data":"a81b9c8af78746fe09a08dfa6981e74a5d25db72df9a0647ec1e0e68028e7190"} Jul 09 14:38:53.989625 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:53.989603 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mps44" event={"ID":"d26f6255-f452-45e0-bd5e-074996bf6201","Type":"ContainerStarted","Data":"90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a"} Jul 09 14:38:53.989726 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:53.989659 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-mps44" podUID="d26f6255-f452-45e0-bd5e-074996bf6201" containerName="registry-server" containerID="cri-o://90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a" gracePeriod=2 Jul 09 14:38:54.008182 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:54.008138 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" podStartSLOduration=1.757430994 podStartE2EDuration="4.008122041s" totalImagesPullingTime="2.250691047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:38:54.00639155 +0000 UTC m=+414.208318713" watchObservedRunningTime="2026-07-09 14:38:54.008122041 +0000 UTC m=+414.210049204" Jul 09 14:38:54.024779 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:54.024733 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-mps44" podStartSLOduration=2.239122622 podStartE2EDuration="5.02471896s" totalImagesPullingTime="2.785596338s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:38:54.023601035 +0000 UTC m=+414.225528212" watchObservedRunningTime="2026-07-09 14:38:54.02471896 +0000 UTC m=+414.226646123" Jul 09 14:38:54.248258 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:54.248206 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mps44" Jul 09 14:38:54.377072 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:54.377033 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4vbf\" (UniqueName: \"kubernetes.io/projected/d26f6255-f452-45e0-bd5e-074996bf6201-kube-api-access-l4vbf\") pod \"d26f6255-f452-45e0-bd5e-074996bf6201\" (UID: \"d26f6255-f452-45e0-bd5e-074996bf6201\") " Jul 09 14:38:54.379393 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:54.379364 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d26f6255-f452-45e0-bd5e-074996bf6201-kube-api-access-l4vbf" (OuterVolumeSpecName: "kube-api-access-l4vbf") pod "d26f6255-f452-45e0-bd5e-074996bf6201" (UID: "d26f6255-f452-45e0-bd5e-074996bf6201"). InnerVolumeSpecName "kube-api-access-l4vbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:38:54.477692 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:54.477654 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4vbf\" (UniqueName: \"kubernetes.io/projected/d26f6255-f452-45e0-bd5e-074996bf6201-kube-api-access-l4vbf\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:38:54.995767 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:54.995734 2570 generic.go:356] "Generic (PLEG): container finished" podID="d26f6255-f452-45e0-bd5e-074996bf6201" containerID="90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a" exitCode=0 Jul 09 14:38:54.996174 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:54.995778 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-mps44" Jul 09 14:38:54.996174 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:54.995825 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mps44" event={"ID":"d26f6255-f452-45e0-bd5e-074996bf6201","Type":"ContainerDied","Data":"90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a"} Jul 09 14:38:54.996174 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:54.995871 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-mps44" event={"ID":"d26f6255-f452-45e0-bd5e-074996bf6201","Type":"ContainerDied","Data":"b0cd6dce41d3e3688487e12a188a8247855c2b6a556b92fbea4f8fbad1bf15a8"} Jul 09 14:38:54.996174 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:54.995895 2570 scope.go:117] "RemoveContainer" containerID="90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a" Jul 09 14:38:55.005395 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:55.005375 2570 scope.go:117] "RemoveContainer" containerID="90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a" Jul 09 14:38:55.005756 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:38:55.005738 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a\": container with ID starting with 90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a not found: ID does not exist" containerID="90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a" Jul 09 14:38:55.005839 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:55.005764 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a"} err="failed to get container status \"90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a\": rpc error: code = NotFound desc = could not find container \"90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a\": container with ID starting with 90b1905d7d2b07e81006c3cc240b8b825dc289f5b4a4f4375df8b4d8634c8c9a not found: ID does not exist" Jul 09 14:38:55.021743 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:55.021723 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mps44"] Jul 09 14:38:55.030416 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:55.030398 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-mps44"] Jul 09 14:38:56.241006 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:38:56.240969 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d26f6255-f452-45e0-bd5e-074996bf6201" path="/var/lib/kubelet/pods/d26f6255-f452-45e0-bd5e-074996bf6201/volumes" Jul 09 14:39:00.835901 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:00.835874 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" Jul 09 14:39:00.836286 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:00.835925 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" Jul 09 14:39:00.860662 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:00.860637 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" Jul 09 14:39:01.045636 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:01.045602 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-mpkrr" Jul 09 14:39:09.571465 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.571424 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b575d98fc-ff2pk"] Jul 09 14:39:09.571857 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.571796 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d26f6255-f452-45e0-bd5e-074996bf6201" containerName="registry-server" Jul 09 14:39:09.571857 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.571808 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d26f6255-f452-45e0-bd5e-074996bf6201" containerName="registry-server" Jul 09 14:39:09.571930 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.571872 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d26f6255-f452-45e0-bd5e-074996bf6201" containerName="registry-server" Jul 09 14:39:09.576244 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.576223 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.630821 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.630792 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b575d98fc-ff2pk"] Jul 09 14:39:09.675571 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.675536 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:09.709592 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.709565 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6aba061-e47b-45e2-9851-6c106ade860b-console-serving-cert\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.709714 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.709632 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-console-config\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.709714 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.709657 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-trusted-ca-bundle\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.709714 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.709675 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6aba061-e47b-45e2-9851-6c106ade860b-console-oauth-config\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.709810 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.709722 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfd5v\" (UniqueName: \"kubernetes.io/projected/f6aba061-e47b-45e2-9851-6c106ade860b-kube-api-access-wfd5v\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.709810 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.709749 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-oauth-serving-cert\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.709810 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.709773 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-service-ca\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.798340 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.798303 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:09.810581 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.810554 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfd5v\" (UniqueName: \"kubernetes.io/projected/f6aba061-e47b-45e2-9851-6c106ade860b-kube-api-access-wfd5v\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.810731 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.810593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-oauth-serving-cert\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.810731 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.810619 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-service-ca\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.810731 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.810639 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6aba061-e47b-45e2-9851-6c106ade860b-console-serving-cert\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.810731 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.810690 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-console-config\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.810957 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.810779 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-trusted-ca-bundle\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.810957 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.810820 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6aba061-e47b-45e2-9851-6c106ade860b-console-oauth-config\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.811435 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.811403 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-oauth-serving-cert\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.811552 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.811482 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-service-ca\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.811616 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.811552 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-console-config\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.811654 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.811636 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f6aba061-e47b-45e2-9851-6c106ade860b-trusted-ca-bundle\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.813565 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.813543 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f6aba061-e47b-45e2-9851-6c106ade860b-console-oauth-config\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.813682 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.813664 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f6aba061-e47b-45e2-9851-6c106ade860b-console-serving-cert\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.828871 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.828823 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfd5v\" (UniqueName: \"kubernetes.io/projected/f6aba061-e47b-45e2-9851-6c106ade860b-kube-api-access-wfd5v\") pod \"console-7b575d98fc-ff2pk\" (UID: \"f6aba061-e47b-45e2-9851-6c106ade860b\") " pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.885865 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.885828 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:09.932134 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:09.932048 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:10.024944 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:10.024920 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b575d98fc-ff2pk"] Jul 09 14:39:10.026923 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:39:10.026892 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6aba061_e47b_45e2_9851_6c106ade860b.slice/crio-3d110fc6e457b1cc50f4a1b1c5641031fbe0f5a5762762240e0d26104c63a11c WatchSource:0}: Error finding container 3d110fc6e457b1cc50f4a1b1c5641031fbe0f5a5762762240e0d26104c63a11c: Status 404 returned error can't find the container with id 3d110fc6e457b1cc50f4a1b1c5641031fbe0f5a5762762240e0d26104c63a11c Jul 09 14:39:10.063460 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:10.063426 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b575d98fc-ff2pk" event={"ID":"f6aba061-e47b-45e2-9851-6c106ade860b","Type":"ContainerStarted","Data":"3d110fc6e457b1cc50f4a1b1c5641031fbe0f5a5762762240e0d26104c63a11c"} Jul 09 14:39:10.318251 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:10.318208 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:10.422312 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:10.422210 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:11.069583 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:11.069552 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b575d98fc-ff2pk" event={"ID":"f6aba061-e47b-45e2-9851-6c106ade860b","Type":"ContainerStarted","Data":"4a9ab6a2c1aa4db16a6ef014d7110348269c54eb7f190d1b2ca52be8c8c33ee9"} Jul 09 14:39:11.108106 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:11.108055 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b575d98fc-ff2pk" podStartSLOduration=2.108039566 podStartE2EDuration="2.108039566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:39:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:39:11.106986997 +0000 UTC m=+431.308914174" watchObservedRunningTime="2026-07-09 14:39:11.108039566 +0000 UTC m=+431.309966791" Jul 09 14:39:19.296986 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:19.296942 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:19.885931 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:19.885889 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:19.886106 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:19.885958 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:19.890612 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:19.890592 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:20.007251 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:20.007223 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:20.120302 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:20.120277 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b575d98fc-ff2pk" Jul 09 14:39:20.199389 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:20.199344 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54cb7fbccc-b5h94"] Jul 09 14:39:20.443969 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:20.443930 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:20.608124 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:20.608034 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:20.763835 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:20.763752 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:23.430715 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:23.430677 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs"] Jul 09 14:39:23.433770 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:23.433754 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs" Jul 09 14:39:23.436386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:23.436370 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-zww85\"" Jul 09 14:39:23.452616 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:23.452588 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs"] Jul 09 14:39:23.531674 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:23.531643 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2zqf\" (UniqueName: \"kubernetes.io/projected/03f3e15e-64d8-4a72-a9e1-afc80390d783-kube-api-access-g2zqf\") pod \"authorino-operator-75cc8d5cb7-bx7zs\" (UID: \"03f3e15e-64d8-4a72-a9e1-afc80390d783\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs" Jul 09 14:39:23.632578 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:23.632542 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2zqf\" (UniqueName: \"kubernetes.io/projected/03f3e15e-64d8-4a72-a9e1-afc80390d783-kube-api-access-g2zqf\") pod \"authorino-operator-75cc8d5cb7-bx7zs\" (UID: \"03f3e15e-64d8-4a72-a9e1-afc80390d783\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs" Jul 09 14:39:23.651926 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:23.651905 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2zqf\" (UniqueName: \"kubernetes.io/projected/03f3e15e-64d8-4a72-a9e1-afc80390d783-kube-api-access-g2zqf\") pod \"authorino-operator-75cc8d5cb7-bx7zs\" (UID: \"03f3e15e-64d8-4a72-a9e1-afc80390d783\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs" Jul 09 14:39:23.744445 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:23.744422 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs" Jul 09 14:39:23.874756 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:23.874667 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs"] Jul 09 14:39:23.877248 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:39:23.877221 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03f3e15e_64d8_4a72_a9e1_afc80390d783.slice/crio-dd68c86a7a38208c08760f6eed1831cff6f6ddbe22b1facd017d1e99f1522c91 WatchSource:0}: Error finding container dd68c86a7a38208c08760f6eed1831cff6f6ddbe22b1facd017d1e99f1522c91: Status 404 returned error can't find the container with id dd68c86a7a38208c08760f6eed1831cff6f6ddbe22b1facd017d1e99f1522c91 Jul 09 14:39:24.134301 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:24.134215 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs" event={"ID":"03f3e15e-64d8-4a72-a9e1-afc80390d783","Type":"ContainerStarted","Data":"dd68c86a7a38208c08760f6eed1831cff6f6ddbe22b1facd017d1e99f1522c91"} Jul 09 14:39:24.252651 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:24.252618 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:26.088498 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:26.088461 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:26.191739 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:26.191688 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:27.153034 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:27.153002 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs" event={"ID":"03f3e15e-64d8-4a72-a9e1-afc80390d783","Type":"ContainerStarted","Data":"b73ac396694fbe0988adc243a1976acf05f7e3b2e03fe797298084f055a243eb"} Jul 09 14:39:27.153421 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:27.153076 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs" Jul 09 14:39:27.174640 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:27.174596 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs" podStartSLOduration=1.8445697760000002 podStartE2EDuration="4.174581443s" totalImagesPullingTime="2.330011667s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:39:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:39:27.173069541 +0000 UTC m=+447.374996706" watchObservedRunningTime="2026-07-09 14:39:27.174581443 +0000 UTC m=+447.376508608" Jul 09 14:39:28.529027 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.528995 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt"] Jul 09 14:39:28.535917 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.535898 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:28.539800 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.539782 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-l58dr\"" Jul 09 14:39:28.570931 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.570907 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt"] Jul 09 14:39:28.582712 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.582687 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:28.585768 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.585749 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf17b12a-1b7e-4c3c-a790-337e902ba931-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" (UID: \"cf17b12a-1b7e-4c3c-a790-337e902ba931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:28.585857 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.585788 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv7th\" (UniqueName: \"kubernetes.io/projected/cf17b12a-1b7e-4c3c-a790-337e902ba931-kube-api-access-mv7th\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" (UID: \"cf17b12a-1b7e-4c3c-a790-337e902ba931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:28.687179 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.687149 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf17b12a-1b7e-4c3c-a790-337e902ba931-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" (UID: \"cf17b12a-1b7e-4c3c-a790-337e902ba931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:28.687345 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.687194 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv7th\" (UniqueName: \"kubernetes.io/projected/cf17b12a-1b7e-4c3c-a790-337e902ba931-kube-api-access-mv7th\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" (UID: \"cf17b12a-1b7e-4c3c-a790-337e902ba931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:28.687572 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.687549 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf17b12a-1b7e-4c3c-a790-337e902ba931-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" (UID: \"cf17b12a-1b7e-4c3c-a790-337e902ba931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:28.719806 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.719776 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv7th\" (UniqueName: \"kubernetes.io/projected/cf17b12a-1b7e-4c3c-a790-337e902ba931-kube-api-access-mv7th\") pod \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" (UID: \"cf17b12a-1b7e-4c3c-a790-337e902ba931\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:28.845820 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.845732 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:28.990680 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:28.990588 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt"] Jul 09 14:39:28.993101 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:39:28.993062 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf17b12a_1b7e_4c3c_a790_337e902ba931.slice/crio-eb64787734a6e6de45f17de7ed2e6733c0bc348768fb85398452cf1d73223f37 WatchSource:0}: Error finding container eb64787734a6e6de45f17de7ed2e6733c0bc348768fb85398452cf1d73223f37: Status 404 returned error can't find the container with id eb64787734a6e6de45f17de7ed2e6733c0bc348768fb85398452cf1d73223f37 Jul 09 14:39:29.164308 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:29.164219 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" event={"ID":"cf17b12a-1b7e-4c3c-a790-337e902ba931","Type":"ContainerStarted","Data":"eb64787734a6e6de45f17de7ed2e6733c0bc348768fb85398452cf1d73223f37"} Jul 09 14:39:29.418322 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:29.418243 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:30.270143 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:30.270101 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:31.189530 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:31.189477 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw"] Jul 09 14:39:31.192987 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:31.192963 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:39:31.196169 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:31.196147 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-cvkwk\"" Jul 09 14:39:31.203871 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:31.203849 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw"] Jul 09 14:39:31.310400 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:31.310364 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-764zf\" (UniqueName: \"kubernetes.io/projected/750878d5-83b7-4018-8611-c46fb2e8f291-kube-api-access-764zf\") pod \"limitador-operator-controller-manager-859d7b78bd-2khkw\" (UID: \"750878d5-83b7-4018-8611-c46fb2e8f291\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:39:31.411116 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:31.411083 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-764zf\" (UniqueName: \"kubernetes.io/projected/750878d5-83b7-4018-8611-c46fb2e8f291-kube-api-access-764zf\") pod \"limitador-operator-controller-manager-859d7b78bd-2khkw\" (UID: \"750878d5-83b7-4018-8611-c46fb2e8f291\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:39:31.421116 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:31.421092 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-764zf\" (UniqueName: \"kubernetes.io/projected/750878d5-83b7-4018-8611-c46fb2e8f291-kube-api-access-764zf\") pod \"limitador-operator-controller-manager-859d7b78bd-2khkw\" (UID: \"750878d5-83b7-4018-8611-c46fb2e8f291\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:39:31.505168 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:31.505081 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:39:31.663265 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:31.663231 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw"] Jul 09 14:39:31.666398 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:39:31.666361 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750878d5_83b7_4018_8611_c46fb2e8f291.slice/crio-251854e7c93cd2f639d32b648533cd6ff4e4b3d863108b3e105852c1acdc5994 WatchSource:0}: Error finding container 251854e7c93cd2f639d32b648533cd6ff4e4b3d863108b3e105852c1acdc5994: Status 404 returned error can't find the container with id 251854e7c93cd2f639d32b648533cd6ff4e4b3d863108b3e105852c1acdc5994 Jul 09 14:39:31.858798 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:31.858712 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:32.184261 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:32.184188 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" event={"ID":"750878d5-83b7-4018-8611-c46fb2e8f291","Type":"ContainerStarted","Data":"251854e7c93cd2f639d32b648533cd6ff4e4b3d863108b3e105852c1acdc5994"} Jul 09 14:39:32.690591 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:32.690551 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:33.531244 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:33.531203 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6"] Jul 09 14:39:33.534340 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:33.534317 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6" Jul 09 14:39:33.536909 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:33.536879 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-qz8tl\"" Jul 09 14:39:33.537344 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:33.537322 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 09 14:39:33.551174 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:33.551147 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6"] Jul 09 14:39:33.631605 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:33.631573 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llsx6\" (UniqueName: \"kubernetes.io/projected/ec94d167-03a4-4492-947f-b6b6a270cf8f-kube-api-access-llsx6\") pod \"dns-operator-controller-manager-864dd78c4c-rvxr6\" (UID: \"ec94d167-03a4-4492-947f-b6b6a270cf8f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6" Jul 09 14:39:33.732590 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:33.732540 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llsx6\" (UniqueName: \"kubernetes.io/projected/ec94d167-03a4-4492-947f-b6b6a270cf8f-kube-api-access-llsx6\") pod \"dns-operator-controller-manager-864dd78c4c-rvxr6\" (UID: \"ec94d167-03a4-4492-947f-b6b6a270cf8f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6" Jul 09 14:39:33.745024 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:33.744989 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llsx6\" (UniqueName: \"kubernetes.io/projected/ec94d167-03a4-4492-947f-b6b6a270cf8f-kube-api-access-llsx6\") pod \"dns-operator-controller-manager-864dd78c4c-rvxr6\" (UID: \"ec94d167-03a4-4492-947f-b6b6a270cf8f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6" Jul 09 14:39:33.846834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:33.846751 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6" Jul 09 14:39:34.819644 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:34.819444 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:34.871954 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:34.871931 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6"] Jul 09 14:39:34.875345 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:39:34.875318 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec94d167_03a4_4492_947f_b6b6a270cf8f.slice/crio-6c0880ad05c2208c3c819fff9b469780a7989a65240d33d7ec527e7ed1b42465 WatchSource:0}: Error finding container 6c0880ad05c2208c3c819fff9b469780a7989a65240d33d7ec527e7ed1b42465: Status 404 returned error can't find the container with id 6c0880ad05c2208c3c819fff9b469780a7989a65240d33d7ec527e7ed1b42465 Jul 09 14:39:34.951157 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:34.951121 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:35.190512 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:35.190471 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:35.203661 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:35.203631 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" event={"ID":"750878d5-83b7-4018-8611-c46fb2e8f291","Type":"ContainerStarted","Data":"7b689cbadb16f152a63c40bc31efc662efbbf82f30c86a8fc51aef1a0196b096"} Jul 09 14:39:35.203822 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:35.203807 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:39:35.205348 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:35.205322 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" event={"ID":"cf17b12a-1b7e-4c3c-a790-337e902ba931","Type":"ContainerStarted","Data":"d86d2616f4954fbcc05795e8963f8a3736ccbd9202fcc305d25fd4483284544d"} Jul 09 14:39:35.205472 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:35.205380 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:35.206581 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:35.206564 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6" event={"ID":"ec94d167-03a4-4492-947f-b6b6a270cf8f","Type":"ContainerStarted","Data":"6c0880ad05c2208c3c819fff9b469780a7989a65240d33d7ec527e7ed1b42465"} Jul 09 14:39:35.224733 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:35.224697 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" podStartSLOduration=1.182345586 podStartE2EDuration="4.224680831s" totalImagesPullingTime="3.042335245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:39:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:39:35.22363084 +0000 UTC m=+455.425558006" watchObservedRunningTime="2026-07-09 14:39:35.224680831 +0000 UTC m=+455.426607993" Jul 09 14:39:35.245086 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:35.245035 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" podStartSLOduration=1.454641173 podStartE2EDuration="7.245018668s" totalImagesPullingTime="5.790377495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:39:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:39:35.243793882 +0000 UTC m=+455.445721046" watchObservedRunningTime="2026-07-09 14:39:35.245018668 +0000 UTC m=+455.446945833" Jul 09 14:39:35.291601 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:35.291577 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:37.218577 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.218539 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6" event={"ID":"ec94d167-03a4-4492-947f-b6b6a270cf8f","Type":"ContainerStarted","Data":"089c735f0cb8c68bba79055ca767ca20ea9f0f167d79237e0f3273ef2fbfaf7d"} Jul 09 14:39:37.218972 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.218692 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6" Jul 09 14:39:37.237480 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.237437 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6" podStartSLOduration=2.2873762109999998 podStartE2EDuration="4.237424431s" totalImagesPullingTime="1.95004822s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:39:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:39:37.236384942 +0000 UTC m=+457.438312130" watchObservedRunningTime="2026-07-09 14:39:37.237424431 +0000 UTC m=+457.439351591" Jul 09 14:39:37.904631 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.904596 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8"] Jul 09 14:39:37.908147 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.908126 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:37.911078 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.911053 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 09 14:39:37.911196 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.911091 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 09 14:39:37.911196 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.911182 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-5bptl\"" Jul 09 14:39:37.921353 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.921326 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8"] Jul 09 14:39:37.936808 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.936774 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:37.971759 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.971735 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18f1096a-2430-4567-88a8-ae1f8314f75a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d72h8\" (UID: \"18f1096a-2430-4567-88a8-ae1f8314f75a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:37.971876 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.971792 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2nt7\" (UniqueName: \"kubernetes.io/projected/18f1096a-2430-4567-88a8-ae1f8314f75a-kube-api-access-t2nt7\") pod \"kuadrant-console-plugin-66b5774985-d72h8\" (UID: \"18f1096a-2430-4567-88a8-ae1f8314f75a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:37.971876 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:37.971859 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18f1096a-2430-4567-88a8-ae1f8314f75a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d72h8\" (UID: \"18f1096a-2430-4567-88a8-ae1f8314f75a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:38.073145 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.073114 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2nt7\" (UniqueName: \"kubernetes.io/projected/18f1096a-2430-4567-88a8-ae1f8314f75a-kube-api-access-t2nt7\") pod \"kuadrant-console-plugin-66b5774985-d72h8\" (UID: \"18f1096a-2430-4567-88a8-ae1f8314f75a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:38.073290 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.073177 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18f1096a-2430-4567-88a8-ae1f8314f75a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d72h8\" (UID: \"18f1096a-2430-4567-88a8-ae1f8314f75a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:38.073290 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.073216 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18f1096a-2430-4567-88a8-ae1f8314f75a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d72h8\" (UID: \"18f1096a-2430-4567-88a8-ae1f8314f75a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:38.073357 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:39:38.073321 2570 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 09 14:39:38.073440 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:39:38.073429 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f1096a-2430-4567-88a8-ae1f8314f75a-plugin-serving-cert podName:18f1096a-2430-4567-88a8-ae1f8314f75a nodeName:}" failed. No retries permitted until 2026-07-09 14:39:38.573399611 +0000 UTC m=+458.775326762 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/18f1096a-2430-4567-88a8-ae1f8314f75a-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-d72h8" (UID: "18f1096a-2430-4567-88a8-ae1f8314f75a") : secret "plugin-serving-cert" not found Jul 09 14:39:38.073853 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.073836 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/18f1096a-2430-4567-88a8-ae1f8314f75a-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-d72h8\" (UID: \"18f1096a-2430-4567-88a8-ae1f8314f75a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:38.101088 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.101062 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2nt7\" (UniqueName: \"kubernetes.io/projected/18f1096a-2430-4567-88a8-ae1f8314f75a-kube-api-access-t2nt7\") pod \"kuadrant-console-plugin-66b5774985-d72h8\" (UID: \"18f1096a-2430-4567-88a8-ae1f8314f75a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:38.161313 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.161254 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-bx7zs" Jul 09 14:39:38.299857 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.299825 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:38.577310 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.577278 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18f1096a-2430-4567-88a8-ae1f8314f75a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d72h8\" (UID: \"18f1096a-2430-4567-88a8-ae1f8314f75a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:38.580044 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.580014 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/18f1096a-2430-4567-88a8-ae1f8314f75a-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-d72h8\" (UID: \"18f1096a-2430-4567-88a8-ae1f8314f75a\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:38.607268 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.607230 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:38.725715 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.725690 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:38.817774 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.817741 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" Jul 09 14:39:38.975079 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:38.975057 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8"] Jul 09 14:39:38.977011 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:39:38.976982 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod18f1096a_2430_4567_88a8_ae1f8314f75a.slice/crio-6e5e290b36729b9e215bf3f2eb4d5a5d80c450f274ceb3bf15eceb2a2bdec3d3 WatchSource:0}: Error finding container 6e5e290b36729b9e215bf3f2eb4d5a5d80c450f274ceb3bf15eceb2a2bdec3d3: Status 404 returned error can't find the container with id 6e5e290b36729b9e215bf3f2eb4d5a5d80c450f274ceb3bf15eceb2a2bdec3d3 Jul 09 14:39:39.231149 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:39.231115 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" event={"ID":"18f1096a-2430-4567-88a8-ae1f8314f75a","Type":"ContainerStarted","Data":"6e5e290b36729b9e215bf3f2eb4d5a5d80c450f274ceb3bf15eceb2a2bdec3d3"} Jul 09 14:39:45.224383 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.224334 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-54cb7fbccc-b5h94" podUID="5678a510-57b6-476c-a54f-6a839679cf25" containerName="console" containerID="cri-o://768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07" gracePeriod=15 Jul 09 14:39:45.501245 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.501217 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:39:45.647832 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.647797 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-oauth-serving-cert\") pod \"5678a510-57b6-476c-a54f-6a839679cf25\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " Jul 09 14:39:45.648017 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.647858 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g7shj\" (UniqueName: \"kubernetes.io/projected/5678a510-57b6-476c-a54f-6a839679cf25-kube-api-access-g7shj\") pod \"5678a510-57b6-476c-a54f-6a839679cf25\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " Jul 09 14:39:45.648017 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.647892 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-console-config\") pod \"5678a510-57b6-476c-a54f-6a839679cf25\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " Jul 09 14:39:45.648017 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.647919 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-oauth-config\") pod \"5678a510-57b6-476c-a54f-6a839679cf25\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " Jul 09 14:39:45.648017 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.647966 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-trusted-ca-bundle\") pod \"5678a510-57b6-476c-a54f-6a839679cf25\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " Jul 09 14:39:45.648017 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.647994 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-serving-cert\") pod \"5678a510-57b6-476c-a54f-6a839679cf25\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " Jul 09 14:39:45.648288 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.648043 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-service-ca\") pod \"5678a510-57b6-476c-a54f-6a839679cf25\" (UID: \"5678a510-57b6-476c-a54f-6a839679cf25\") " Jul 09 14:39:45.648288 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.648191 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5678a510-57b6-476c-a54f-6a839679cf25" (UID: "5678a510-57b6-476c-a54f-6a839679cf25"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:39:45.648579 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.648426 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-console-config" (OuterVolumeSpecName: "console-config") pod "5678a510-57b6-476c-a54f-6a839679cf25" (UID: "5678a510-57b6-476c-a54f-6a839679cf25"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:39:45.648579 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.648446 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-oauth-serving-cert\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:39:45.648579 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.648483 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5678a510-57b6-476c-a54f-6a839679cf25" (UID: "5678a510-57b6-476c-a54f-6a839679cf25"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:39:45.648935 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.648912 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-service-ca" (OuterVolumeSpecName: "service-ca") pod "5678a510-57b6-476c-a54f-6a839679cf25" (UID: "5678a510-57b6-476c-a54f-6a839679cf25"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:39:45.650652 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.650616 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5678a510-57b6-476c-a54f-6a839679cf25" (UID: "5678a510-57b6-476c-a54f-6a839679cf25"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:39:45.650652 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.650632 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5678a510-57b6-476c-a54f-6a839679cf25-kube-api-access-g7shj" (OuterVolumeSpecName: "kube-api-access-g7shj") pod "5678a510-57b6-476c-a54f-6a839679cf25" (UID: "5678a510-57b6-476c-a54f-6a839679cf25"). InnerVolumeSpecName "kube-api-access-g7shj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:39:45.650789 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.650761 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5678a510-57b6-476c-a54f-6a839679cf25" (UID: "5678a510-57b6-476c-a54f-6a839679cf25"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:39:45.749051 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.748970 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g7shj\" (UniqueName: \"kubernetes.io/projected/5678a510-57b6-476c-a54f-6a839679cf25-kube-api-access-g7shj\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:39:45.749051 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.749008 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-console-config\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:39:45.749051 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.749025 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-oauth-config\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:39:45.749051 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.749039 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-trusted-ca-bundle\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:39:45.749051 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.749053 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5678a510-57b6-476c-a54f-6a839679cf25-console-serving-cert\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:39:45.749346 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:45.749066 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5678a510-57b6-476c-a54f-6a839679cf25-service-ca\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:39:46.214844 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.214815 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:46.215019 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.214885 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:39:46.224430 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.224400 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:46.274123 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.274088 2570 generic.go:356] "Generic (PLEG): container finished" podID="5678a510-57b6-476c-a54f-6a839679cf25" containerID="768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07" exitCode=0 Jul 09 14:39:46.274267 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.274255 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cb7fbccc-b5h94" event={"ID":"5678a510-57b6-476c-a54f-6a839679cf25","Type":"ContainerDied","Data":"768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07"} Jul 09 14:39:46.274338 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.274295 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54cb7fbccc-b5h94" event={"ID":"5678a510-57b6-476c-a54f-6a839679cf25","Type":"ContainerDied","Data":"03149121422ea1f501411229d95a8fceef7c3eb9d3b2847940b43fe571530e51"} Jul 09 14:39:46.274338 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.274322 2570 scope.go:117] "RemoveContainer" containerID="768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07" Jul 09 14:39:46.274475 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.274462 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54cb7fbccc-b5h94" Jul 09 14:39:46.286720 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.286679 2570 scope.go:117] "RemoveContainer" containerID="768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07" Jul 09 14:39:46.287015 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:39:46.286978 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07\": container with ID starting with 768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07 not found: ID does not exist" containerID="768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07" Jul 09 14:39:46.287116 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.287011 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07"} err="failed to get container status \"768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07\": rpc error: code = NotFound desc = could not find container \"768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07\": container with ID starting with 768353ce71bd0a6a40fde1109ceb05cfc3d386e1a9894cbf4c2a94836d9fce07 not found: ID does not exist" Jul 09 14:39:46.312905 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.312871 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54cb7fbccc-b5h94"] Jul 09 14:39:46.324234 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.324207 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54cb7fbccc-b5h94"] Jul 09 14:39:46.338346 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:46.338312 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:48.228015 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.227976 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-rvxr6" Jul 09 14:39:48.241184 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.241157 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5678a510-57b6-476c-a54f-6a839679cf25" path="/var/lib/kubelet/pods/5678a510-57b6-476c-a54f-6a839679cf25/volumes" Jul 09 14:39:48.450717 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.450684 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt"] Jul 09 14:39:48.450996 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.450933 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" containerName="manager" containerID="cri-o://d86d2616f4954fbcc05795e8963f8a3736ccbd9202fcc305d25fd4483284544d" gracePeriod=2 Jul 09 14:39:48.454328 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:39:48.454282 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:48.454992 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.454945 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt"] Jul 09 14:39:48.484335 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.484273 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw"] Jul 09 14:39:48.484645 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.484494 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" podUID="750878d5-83b7-4018-8611-c46fb2e8f291" containerName="manager" containerID="cri-o://7b689cbadb16f152a63c40bc31efc662efbbf82f30c86a8fc51aef1a0196b096" gracePeriod=2 Jul 09 14:39:48.497093 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:39:48.497065 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:48.530390 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.530324 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw"] Jul 09 14:39:48.532771 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.532736 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm"] Jul 09 14:39:48.533437 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.533414 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" containerName="manager" Jul 09 14:39:48.533559 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.533440 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" containerName="manager" Jul 09 14:39:48.533559 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.533466 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="750878d5-83b7-4018-8611-c46fb2e8f291" containerName="manager" Jul 09 14:39:48.533559 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.533475 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="750878d5-83b7-4018-8611-c46fb2e8f291" containerName="manager" Jul 09 14:39:48.533559 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.533501 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5678a510-57b6-476c-a54f-6a839679cf25" containerName="console" Jul 09 14:39:48.533559 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.533508 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5678a510-57b6-476c-a54f-6a839679cf25" containerName="console" Jul 09 14:39:48.533748 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.533616 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5678a510-57b6-476c-a54f-6a839679cf25" containerName="console" Jul 09 14:39:48.533748 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.533626 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" containerName="manager" Jul 09 14:39:48.533748 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.533636 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="750878d5-83b7-4018-8611-c46fb2e8f291" containerName="manager" Jul 09 14:39:48.538330 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.538308 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:39:48.565887 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.565858 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq"] Jul 09 14:39:48.579040 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.579005 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm"] Jul 09 14:39:48.579166 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.579138 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq" Jul 09 14:39:48.600462 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.600431 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq"] Jul 09 14:39:48.627306 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:39:48.627270 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:48.632232 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:39:48.632195 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2khkw\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="750878d5-83b7-4018-8611-c46fb2e8f291" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:39:48.634748 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:39:48.634706 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:48.638134 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:39:48.638107 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2khkw\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="750878d5-83b7-4018-8611-c46fb2e8f291" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:39:48.676008 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.675960 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpfqj\" (UniqueName: \"kubernetes.io/projected/86f95f92-cafa-44b7-8677-1edfa29bb8d6-kube-api-access-gpfqj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmdpm\" (UID: \"86f95f92-cafa-44b7-8677-1edfa29bb8d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:39:48.676160 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.676066 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp5r6\" (UniqueName: \"kubernetes.io/projected/1ad3c82c-6ddb-49f0-a865-bcde435e42e1-kube-api-access-tp5r6\") pod \"limitador-operator-controller-manager-859d7b78bd-f92kq\" (UID: \"1ad3c82c-6ddb-49f0-a865-bcde435e42e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq" Jul 09 14:39:48.676230 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.676183 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86f95f92-cafa-44b7-8677-1edfa29bb8d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmdpm\" (UID: \"86f95f92-cafa-44b7-8677-1edfa29bb8d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:39:48.777437 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.777349 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86f95f92-cafa-44b7-8677-1edfa29bb8d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmdpm\" (UID: \"86f95f92-cafa-44b7-8677-1edfa29bb8d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:39:48.777437 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.777395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpfqj\" (UniqueName: \"kubernetes.io/projected/86f95f92-cafa-44b7-8677-1edfa29bb8d6-kube-api-access-gpfqj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmdpm\" (UID: \"86f95f92-cafa-44b7-8677-1edfa29bb8d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:39:48.777667 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.777449 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp5r6\" (UniqueName: \"kubernetes.io/projected/1ad3c82c-6ddb-49f0-a865-bcde435e42e1-kube-api-access-tp5r6\") pod \"limitador-operator-controller-manager-859d7b78bd-f92kq\" (UID: \"1ad3c82c-6ddb-49f0-a865-bcde435e42e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq" Jul 09 14:39:48.777874 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.777853 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86f95f92-cafa-44b7-8677-1edfa29bb8d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmdpm\" (UID: \"86f95f92-cafa-44b7-8677-1edfa29bb8d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:39:48.789719 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.789691 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp5r6\" (UniqueName: \"kubernetes.io/projected/1ad3c82c-6ddb-49f0-a865-bcde435e42e1-kube-api-access-tp5r6\") pod \"limitador-operator-controller-manager-859d7b78bd-f92kq\" (UID: \"1ad3c82c-6ddb-49f0-a865-bcde435e42e1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq" Jul 09 14:39:48.796337 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.796313 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpfqj\" (UniqueName: \"kubernetes.io/projected/86f95f92-cafa-44b7-8677-1edfa29bb8d6-kube-api-access-gpfqj\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lmdpm\" (UID: \"86f95f92-cafa-44b7-8677-1edfa29bb8d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:39:48.799169 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.799093 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:48.883837 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.883781 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:39:48.895226 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.895201 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq" Jul 09 14:39:48.920942 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:48.920869 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:50.239316 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:39:50.239272 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:39:50.247787 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:39:50.247750 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2khkw\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="750878d5-83b7-4018-8611-c46fb2e8f291" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:39:54.421744 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:54.421703 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:54.521695 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:54.521655 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:55.049788 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:55.049749 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:55.149975 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:55.149935 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:58.618625 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:58.618586 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:39:58.717719 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:39:58.717688 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:01.376654 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.376490 2570 generic.go:356] "Generic (PLEG): container finished" podID="750878d5-83b7-4018-8611-c46fb2e8f291" containerID="7b689cbadb16f152a63c40bc31efc662efbbf82f30c86a8fc51aef1a0196b096" exitCode=0 Jul 09 14:40:01.382742 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.382713 2570 generic.go:356] "Generic (PLEG): container finished" podID="cf17b12a-1b7e-4c3c-a790-337e902ba931" containerID="d86d2616f4954fbcc05795e8963f8a3736ccbd9202fcc305d25fd4483284544d" exitCode=0 Jul 09 14:40:01.481969 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.481818 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm"] Jul 09 14:40:01.483738 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.483711 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:40:01.485937 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:40:01.485910 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86f95f92_cafa_44b7_8677_1edfa29bb8d6.slice/crio-df3f67555f25ae31b66b5e9942f21527f353a86c209f02570e942e3eafdbc82d WatchSource:0}: Error finding container df3f67555f25ae31b66b5e9942f21527f353a86c209f02570e942e3eafdbc82d: Status 404 returned error can't find the container with id df3f67555f25ae31b66b5e9942f21527f353a86c209f02570e942e3eafdbc82d Jul 09 14:40:01.486563 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:40:01.486533 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2khkw\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="750878d5-83b7-4018-8611-c46fb2e8f291" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:40:01.488408 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.488390 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:40:01.490700 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:40:01.490671 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:40:01.492758 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:40:01.492732 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2khkw\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="750878d5-83b7-4018-8611-c46fb2e8f291" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:40:01.503122 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.502036 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf17b12a-1b7e-4c3c-a790-337e902ba931-extensions-socket-volume\") pod \"cf17b12a-1b7e-4c3c-a790-337e902ba931\" (UID: \"cf17b12a-1b7e-4c3c-a790-337e902ba931\") " Jul 09 14:40:01.503122 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.502152 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv7th\" (UniqueName: \"kubernetes.io/projected/cf17b12a-1b7e-4c3c-a790-337e902ba931-kube-api-access-mv7th\") pod \"cf17b12a-1b7e-4c3c-a790-337e902ba931\" (UID: \"cf17b12a-1b7e-4c3c-a790-337e902ba931\") " Jul 09 14:40:01.503122 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.502183 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-764zf\" (UniqueName: \"kubernetes.io/projected/750878d5-83b7-4018-8611-c46fb2e8f291-kube-api-access-764zf\") pod \"750878d5-83b7-4018-8611-c46fb2e8f291\" (UID: \"750878d5-83b7-4018-8611-c46fb2e8f291\") " Jul 09 14:40:01.505970 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.505940 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf17b12a-1b7e-4c3c-a790-337e902ba931-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cf17b12a-1b7e-4c3c-a790-337e902ba931" (UID: "cf17b12a-1b7e-4c3c-a790-337e902ba931"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:40:01.507768 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.507741 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq"] Jul 09 14:40:01.508217 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.508181 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf17b12a-1b7e-4c3c-a790-337e902ba931-kube-api-access-mv7th" (OuterVolumeSpecName: "kube-api-access-mv7th") pod "cf17b12a-1b7e-4c3c-a790-337e902ba931" (UID: "cf17b12a-1b7e-4c3c-a790-337e902ba931"). InnerVolumeSpecName "kube-api-access-mv7th". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:40:01.508326 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.508300 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/750878d5-83b7-4018-8611-c46fb2e8f291-kube-api-access-764zf" (OuterVolumeSpecName: "kube-api-access-764zf") pod "750878d5-83b7-4018-8611-c46fb2e8f291" (UID: "750878d5-83b7-4018-8611-c46fb2e8f291"). InnerVolumeSpecName "kube-api-access-764zf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:40:01.510105 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:40:01.510076 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad3c82c_6ddb_49f0_a865_bcde435e42e1.slice/crio-cd5a04dee57eec0ca4468c386ec5ec5c8d4fcaea42763931db34519e8d60018b WatchSource:0}: Error finding container cd5a04dee57eec0ca4468c386ec5ec5c8d4fcaea42763931db34519e8d60018b: Status 404 returned error can't find the container with id cd5a04dee57eec0ca4468c386ec5ec5c8d4fcaea42763931db34519e8d60018b Jul 09 14:40:01.603274 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.603246 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv7th\" (UniqueName: \"kubernetes.io/projected/cf17b12a-1b7e-4c3c-a790-337e902ba931-kube-api-access-mv7th\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:40:01.603274 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.603272 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-764zf\" (UniqueName: \"kubernetes.io/projected/750878d5-83b7-4018-8611-c46fb2e8f291-kube-api-access-764zf\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:40:01.603274 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:01.603281 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cf17b12a-1b7e-4c3c-a790-337e902ba931-extensions-socket-volume\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:40:02.240347 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.240311 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="750878d5-83b7-4018-8611-c46fb2e8f291" path="/var/lib/kubelet/pods/750878d5-83b7-4018-8611-c46fb2e8f291/volumes" Jul 09 14:40:02.240715 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.240700 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" path="/var/lib/kubelet/pods/cf17b12a-1b7e-4c3c-a790-337e902ba931/volumes" Jul 09 14:40:02.390473 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.390434 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" event={"ID":"18f1096a-2430-4567-88a8-ae1f8314f75a","Type":"ContainerStarted","Data":"3727129563f42787822d935c661283f4b2139c23968438e7a27a8c0f795ce495"} Jul 09 14:40:02.392084 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.392058 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" event={"ID":"86f95f92-cafa-44b7-8677-1edfa29bb8d6","Type":"ContainerStarted","Data":"1831880cbfc373c762120e71cf9149b8e5a2bbe24e9ac0d9e840af7d0d96dfb7"} Jul 09 14:40:02.392227 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.392107 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" event={"ID":"86f95f92-cafa-44b7-8677-1edfa29bb8d6","Type":"ContainerStarted","Data":"df3f67555f25ae31b66b5e9942f21527f353a86c209f02570e942e3eafdbc82d"} Jul 09 14:40:02.392227 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.392147 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:40:02.393849 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.393823 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq" event={"ID":"1ad3c82c-6ddb-49f0-a865-bcde435e42e1","Type":"ContainerStarted","Data":"f911a5ee14b17aa45278ab887e289bdfcb51454fe3bbb58e1386a077d54353f1"} Jul 09 14:40:02.394022 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.393865 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq" event={"ID":"1ad3c82c-6ddb-49f0-a865-bcde435e42e1","Type":"ContainerStarted","Data":"cd5a04dee57eec0ca4468c386ec5ec5c8d4fcaea42763931db34519e8d60018b"} Jul 09 14:40:02.394022 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.393891 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq" Jul 09 14:40:02.395096 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.395074 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:40:02.395218 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.395096 2570 scope.go:117] "RemoveContainer" containerID="7b689cbadb16f152a63c40bc31efc662efbbf82f30c86a8fc51aef1a0196b096" Jul 09 14:40:02.397154 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.397134 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:40:02.403718 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.403703 2570 scope.go:117] "RemoveContainer" containerID="d86d2616f4954fbcc05795e8963f8a3736ccbd9202fcc305d25fd4483284544d" Jul 09 14:40:02.408432 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.408391 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-d72h8" podStartSLOduration=2.969460442 podStartE2EDuration="25.408377415s" totalImagesPullingTime="22.438916973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:39:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:02.406995023 +0000 UTC m=+482.608922186" watchObservedRunningTime="2026-07-09 14:40:02.408377415 +0000 UTC m=+482.610304578" Jul 09 14:40:02.439753 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.439698 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" podStartSLOduration=14.439685082 podStartE2EDuration="14.439685082s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:02.438728085 +0000 UTC m=+482.640655273" watchObservedRunningTime="2026-07-09 14:40:02.439685082 +0000 UTC m=+482.641612246" Jul 09 14:40:02.440955 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:40:02.440927 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-sxqmt\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="cf17b12a-1b7e-4c3c-a790-337e902ba931" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-sxqmt" Jul 09 14:40:02.442721 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:40:02.442698 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-2khkw\" is forbidden: User \"system:node:ip-10-0-140-220.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-220.ec2.internal' and this object" podUID="750878d5-83b7-4018-8611-c46fb2e8f291" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2khkw" Jul 09 14:40:02.470622 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:02.470585 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq" podStartSLOduration=14.470572339 podStartE2EDuration="14.470572339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:02.470027729 +0000 UTC m=+482.671954894" watchObservedRunningTime="2026-07-09 14:40:02.470572339 +0000 UTC m=+482.672499503" Jul 09 14:40:06.029472 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:06.029431 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:06.126493 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:06.126452 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:07.290657 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.290623 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm"] Jul 09 14:40:07.291063 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.290785 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" podUID="86f95f92-cafa-44b7-8677-1edfa29bb8d6" containerName="manager" containerID="cri-o://1831880cbfc373c762120e71cf9149b8e5a2bbe24e9ac0d9e840af7d0d96dfb7" gracePeriod=10 Jul 09 14:40:07.292592 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.292569 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:40:07.425599 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.425568 2570 generic.go:356] "Generic (PLEG): container finished" podID="86f95f92-cafa-44b7-8677-1edfa29bb8d6" containerID="1831880cbfc373c762120e71cf9149b8e5a2bbe24e9ac0d9e840af7d0d96dfb7" exitCode=0 Jul 09 14:40:07.425723 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.425642 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" event={"ID":"86f95f92-cafa-44b7-8677-1edfa29bb8d6","Type":"ContainerDied","Data":"1831880cbfc373c762120e71cf9149b8e5a2bbe24e9ac0d9e840af7d0d96dfb7"} Jul 09 14:40:07.536812 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.536783 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:40:07.654961 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.654890 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86f95f92-cafa-44b7-8677-1edfa29bb8d6-extensions-socket-volume\") pod \"86f95f92-cafa-44b7-8677-1edfa29bb8d6\" (UID: \"86f95f92-cafa-44b7-8677-1edfa29bb8d6\") " Jul 09 14:40:07.654961 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.654926 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpfqj\" (UniqueName: \"kubernetes.io/projected/86f95f92-cafa-44b7-8677-1edfa29bb8d6-kube-api-access-gpfqj\") pod \"86f95f92-cafa-44b7-8677-1edfa29bb8d6\" (UID: \"86f95f92-cafa-44b7-8677-1edfa29bb8d6\") " Jul 09 14:40:07.655371 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.655315 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86f95f92-cafa-44b7-8677-1edfa29bb8d6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "86f95f92-cafa-44b7-8677-1edfa29bb8d6" (UID: "86f95f92-cafa-44b7-8677-1edfa29bb8d6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:40:07.657192 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.657175 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86f95f92-cafa-44b7-8677-1edfa29bb8d6-kube-api-access-gpfqj" (OuterVolumeSpecName: "kube-api-access-gpfqj") pod "86f95f92-cafa-44b7-8677-1edfa29bb8d6" (UID: "86f95f92-cafa-44b7-8677-1edfa29bb8d6"). InnerVolumeSpecName "kube-api-access-gpfqj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:40:07.756394 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.756354 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/86f95f92-cafa-44b7-8677-1edfa29bb8d6-extensions-socket-volume\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:40:07.756394 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:07.756388 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpfqj\" (UniqueName: \"kubernetes.io/projected/86f95f92-cafa-44b7-8677-1edfa29bb8d6-kube-api-access-gpfqj\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:40:08.431858 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:08.431824 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" event={"ID":"86f95f92-cafa-44b7-8677-1edfa29bb8d6","Type":"ContainerDied","Data":"df3f67555f25ae31b66b5e9942f21527f353a86c209f02570e942e3eafdbc82d"} Jul 09 14:40:08.431858 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:08.431843 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm" Jul 09 14:40:08.432323 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:08.431885 2570 scope.go:117] "RemoveContainer" containerID="1831880cbfc373c762120e71cf9149b8e5a2bbe24e9ac0d9e840af7d0d96dfb7" Jul 09 14:40:08.475642 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:08.475614 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm"] Jul 09 14:40:08.492139 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:08.492114 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lmdpm"] Jul 09 14:40:08.653352 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:08.653272 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:08.749205 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:08.749171 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:10.241125 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:10.241087 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86f95f92-cafa-44b7-8677-1edfa29bb8d6" path="/var/lib/kubelet/pods/86f95f92-cafa-44b7-8677-1edfa29bb8d6/volumes" Jul 09 14:40:13.406595 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:13.406563 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-f92kq" Jul 09 14:40:23.881104 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:23.881067 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7"] Jul 09 14:40:23.881822 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:23.881776 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86f95f92-cafa-44b7-8677-1edfa29bb8d6" containerName="manager" Jul 09 14:40:23.881822 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:23.881798 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="86f95f92-cafa-44b7-8677-1edfa29bb8d6" containerName="manager" Jul 09 14:40:23.881962 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:23.881890 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="86f95f92-cafa-44b7-8677-1edfa29bb8d6" containerName="manager" Jul 09 14:40:23.929892 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:23.929854 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:23.931710 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:23.931692 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7"] Jul 09 14:40:23.931800 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:23.931788 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:23.934213 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:23.934189 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fm5m7\"" Jul 09 14:40:23.934605 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:23.934586 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 14:40:24.001852 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.001813 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.002014 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.001861 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.002014 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.001891 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrhvp\" (UniqueName: \"kubernetes.io/projected/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-kube-api-access-zrhvp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.002014 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.001921 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.002014 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.001946 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.002156 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.002006 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.002156 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.002070 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.002156 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.002143 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.002275 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.002175 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.047711 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.047662 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:24.102914 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.102878 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.102914 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.102912 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.103137 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.102934 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrhvp\" (UniqueName: \"kubernetes.io/projected/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-kube-api-access-zrhvp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.103137 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.102953 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.103218 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.103199 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.103259 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.103245 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.103303 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.103280 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.103351 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.103329 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.103398 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.103340 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.103432 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.103399 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.103474 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.103440 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.103513 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.103484 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.103829 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.103805 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.104083 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.103995 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.105672 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.105651 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.105921 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.105902 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.111450 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.111427 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.111613 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.111596 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrhvp\" (UniqueName: \"kubernetes.io/projected/1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec-kube-api-access-zrhvp\") pod \"maas-default-gateway-openshift-default-5896d4dd49-spgl7\" (UID: \"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.146394 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.146306 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:24.242546 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.242504 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:24.428616 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.428533 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7"] Jul 09 14:40:24.431769 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:40:24.431725 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea7d098_e4f0_4e3b_a0c9_b4e5a21152ec.slice/crio-e7d41b6f12b60cb76d8c73300a2bbc2509063f0ac0f9c8ef19c1d347156cc7bf WatchSource:0}: Error finding container e7d41b6f12b60cb76d8c73300a2bbc2509063f0ac0f9c8ef19c1d347156cc7bf: Status 404 returned error can't find the container with id e7d41b6f12b60cb76d8c73300a2bbc2509063f0ac0f9c8ef19c1d347156cc7bf Jul 09 14:40:24.509030 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:24.508997 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" event={"ID":"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec","Type":"ContainerStarted","Data":"e7d41b6f12b60cb76d8c73300a2bbc2509063f0ac0f9c8ef19c1d347156cc7bf"} Jul 09 14:40:29.027684 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:29.027637 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 14:40:29.028214 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:29.027734 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 14:40:29.028214 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:29.027779 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 09 14:40:29.538681 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:29.538643 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" event={"ID":"1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec","Type":"ContainerStarted","Data":"3498f75baf552e1a0cbd642ab4ab07edb25cf77ae14d7c05b460059620142f57"} Jul 09 14:40:29.558593 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:29.558493 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" podStartSLOduration=1.965182452 podStartE2EDuration="6.55847686s" totalImagesPullingTime="4.593294408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:29.557581372 +0000 UTC m=+509.759508558" watchObservedRunningTime="2026-07-09 14:40:29.55847686 +0000 UTC m=+509.760404024" Jul 09 14:40:30.243239 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.243205 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:30.248323 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.248297 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:30.543613 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.543538 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:30.544645 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.544629 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-spgl7" Jul 09 14:40:30.632482 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.632454 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-256hx"] Jul 09 14:40:30.672021 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.671988 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:30.772999 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.772966 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:30.818262 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.818182 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-256hx"] Jul 09 14:40:30.818262 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.818216 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-256hx"] Jul 09 14:40:30.818453 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.818317 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:30.821745 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.821724 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 14:40:30.839620 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.839593 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:30.966226 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.966194 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w49z4\" (UniqueName: \"kubernetes.io/projected/e5ed75de-19cd-4d14-8531-9b685d84fa69-kube-api-access-w49z4\") pod \"limitador-limitador-64c94fd64f-256hx\" (UID: \"e5ed75de-19cd-4d14-8531-9b685d84fa69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:30.966391 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:30.966247 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5ed75de-19cd-4d14-8531-9b685d84fa69-config-file\") pod \"limitador-limitador-64c94fd64f-256hx\" (UID: \"e5ed75de-19cd-4d14-8531-9b685d84fa69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:31.066279 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.066247 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mvpxs"] Jul 09 14:40:31.067540 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.067478 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w49z4\" (UniqueName: \"kubernetes.io/projected/e5ed75de-19cd-4d14-8531-9b685d84fa69-kube-api-access-w49z4\") pod \"limitador-limitador-64c94fd64f-256hx\" (UID: \"e5ed75de-19cd-4d14-8531-9b685d84fa69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:31.067691 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.067589 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5ed75de-19cd-4d14-8531-9b685d84fa69-config-file\") pod \"limitador-limitador-64c94fd64f-256hx\" (UID: \"e5ed75de-19cd-4d14-8531-9b685d84fa69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:31.068425 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.068376 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5ed75de-19cd-4d14-8531-9b685d84fa69-config-file\") pod \"limitador-limitador-64c94fd64f-256hx\" (UID: \"e5ed75de-19cd-4d14-8531-9b685d84fa69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:31.077564 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.077535 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w49z4\" (UniqueName: \"kubernetes.io/projected/e5ed75de-19cd-4d14-8531-9b685d84fa69-kube-api-access-w49z4\") pod \"limitador-limitador-64c94fd64f-256hx\" (UID: \"e5ed75de-19cd-4d14-8531-9b685d84fa69\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:31.087814 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.087791 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mvpxs"] Jul 09 14:40:31.087917 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.087886 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" Jul 09 14:40:31.098864 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.098842 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mvpxs"] Jul 09 14:40:31.129541 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.129497 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:31.168639 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.168610 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzkcv\" (UniqueName: \"kubernetes.io/projected/692251a4-adad-4cad-9f03-70e7981a69dd-kube-api-access-qzkcv\") pod \"limitador-limitador-54d6d988d5-mvpxs\" (UID: \"692251a4-adad-4cad-9f03-70e7981a69dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" Jul 09 14:40:31.168779 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.168652 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/692251a4-adad-4cad-9f03-70e7981a69dd-config-file\") pod \"limitador-limitador-54d6d988d5-mvpxs\" (UID: \"692251a4-adad-4cad-9f03-70e7981a69dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" Jul 09 14:40:31.269658 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.269628 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzkcv\" (UniqueName: \"kubernetes.io/projected/692251a4-adad-4cad-9f03-70e7981a69dd-kube-api-access-qzkcv\") pod \"limitador-limitador-54d6d988d5-mvpxs\" (UID: \"692251a4-adad-4cad-9f03-70e7981a69dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" Jul 09 14:40:31.270025 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.269671 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/692251a4-adad-4cad-9f03-70e7981a69dd-config-file\") pod \"limitador-limitador-54d6d988d5-mvpxs\" (UID: \"692251a4-adad-4cad-9f03-70e7981a69dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" Jul 09 14:40:31.270372 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.270351 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/692251a4-adad-4cad-9f03-70e7981a69dd-config-file\") pod \"limitador-limitador-54d6d988d5-mvpxs\" (UID: \"692251a4-adad-4cad-9f03-70e7981a69dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" Jul 09 14:40:31.279593 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.279567 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzkcv\" (UniqueName: \"kubernetes.io/projected/692251a4-adad-4cad-9f03-70e7981a69dd-kube-api-access-qzkcv\") pod \"limitador-limitador-54d6d988d5-mvpxs\" (UID: \"692251a4-adad-4cad-9f03-70e7981a69dd\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" Jul 09 14:40:31.280778 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.280756 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-256hx"] Jul 09 14:40:31.283171 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:40:31.283148 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5ed75de_19cd_4d14_8531_9b685d84fa69.slice/crio-b5079e867316ee7ec813577c2894889e614a1a9361f61ce61607d1706f542301 WatchSource:0}: Error finding container b5079e867316ee7ec813577c2894889e614a1a9361f61ce61607d1706f542301: Status 404 returned error can't find the container with id b5079e867316ee7ec813577c2894889e614a1a9361f61ce61607d1706f542301 Jul 09 14:40:31.402647 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.402576 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" Jul 09 14:40:31.551753 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.551720 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" event={"ID":"e5ed75de-19cd-4d14-8531-9b685d84fa69","Type":"ContainerStarted","Data":"b5079e867316ee7ec813577c2894889e614a1a9361f61ce61607d1706f542301"} Jul 09 14:40:31.606383 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.606346 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mvpxs"] Jul 09 14:40:31.609689 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:40:31.609661 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod692251a4_adad_4cad_9f03_70e7981a69dd.slice/crio-33af12597e2f5ee9f4a6e9af03d92641a0994889e33b7b49e9ce7cf693b9d314 WatchSource:0}: Error finding container 33af12597e2f5ee9f4a6e9af03d92641a0994889e33b7b49e9ce7cf693b9d314: Status 404 returned error can't find the container with id 33af12597e2f5ee9f4a6e9af03d92641a0994889e33b7b49e9ce7cf693b9d314 Jul 09 14:40:31.813199 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.813166 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:31.878729 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:31.878683 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:32.564121 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:32.564084 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" event={"ID":"692251a4-adad-4cad-9f03-70e7981a69dd","Type":"ContainerStarted","Data":"33af12597e2f5ee9f4a6e9af03d92641a0994889e33b7b49e9ce7cf693b9d314"} Jul 09 14:40:35.582407 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:35.582360 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" event={"ID":"692251a4-adad-4cad-9f03-70e7981a69dd","Type":"ContainerStarted","Data":"4800aa97d1a5609685efc5e0d34358d3e04605ecbba4524493282602bf789fdf"} Jul 09 14:40:35.582844 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:35.582511 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" Jul 09 14:40:35.583922 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:35.583898 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" event={"ID":"e5ed75de-19cd-4d14-8531-9b685d84fa69","Type":"ContainerStarted","Data":"434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024"} Jul 09 14:40:35.584027 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:35.583995 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:35.600395 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:35.600324 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" podStartSLOduration=1.665574594 podStartE2EDuration="4.60031099s" totalImagesPullingTime="2.934736396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:35.597720684 +0000 UTC m=+515.799647846" watchObservedRunningTime="2026-07-09 14:40:35.60031099 +0000 UTC m=+515.802238154" Jul 09 14:40:35.616296 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:35.616255 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" podStartSLOduration=2.343819533 podStartE2EDuration="5.616239888s" totalImagesPullingTime="3.272420355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:35.615987157 +0000 UTC m=+515.817914322" watchObservedRunningTime="2026-07-09 14:40:35.616239888 +0000 UTC m=+515.818167054" Jul 09 14:40:46.593824 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:46.593795 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:46.594199 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:46.593879 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mvpxs" Jul 09 14:40:46.653288 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:46.653254 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-256hx"] Jul 09 14:40:46.653481 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:46.653445 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" podUID="e5ed75de-19cd-4d14-8531-9b685d84fa69" containerName="limitador" containerID="cri-o://434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024" gracePeriod=30 Jul 09 14:40:47.206066 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.206041 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:47.307302 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.307216 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5ed75de-19cd-4d14-8531-9b685d84fa69-config-file\") pod \"e5ed75de-19cd-4d14-8531-9b685d84fa69\" (UID: \"e5ed75de-19cd-4d14-8531-9b685d84fa69\") " Jul 09 14:40:47.307302 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.307280 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w49z4\" (UniqueName: \"kubernetes.io/projected/e5ed75de-19cd-4d14-8531-9b685d84fa69-kube-api-access-w49z4\") pod \"e5ed75de-19cd-4d14-8531-9b685d84fa69\" (UID: \"e5ed75de-19cd-4d14-8531-9b685d84fa69\") " Jul 09 14:40:47.307628 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.307603 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e5ed75de-19cd-4d14-8531-9b685d84fa69-config-file" (OuterVolumeSpecName: "config-file") pod "e5ed75de-19cd-4d14-8531-9b685d84fa69" (UID: "e5ed75de-19cd-4d14-8531-9b685d84fa69"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:40:47.309471 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.309444 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5ed75de-19cd-4d14-8531-9b685d84fa69-kube-api-access-w49z4" (OuterVolumeSpecName: "kube-api-access-w49z4") pod "e5ed75de-19cd-4d14-8531-9b685d84fa69" (UID: "e5ed75de-19cd-4d14-8531-9b685d84fa69"). InnerVolumeSpecName "kube-api-access-w49z4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:40:47.408629 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.408598 2570 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e5ed75de-19cd-4d14-8531-9b685d84fa69-config-file\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:40:47.408629 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.408623 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w49z4\" (UniqueName: \"kubernetes.io/projected/e5ed75de-19cd-4d14-8531-9b685d84fa69-kube-api-access-w49z4\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:40:47.656841 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.656746 2570 generic.go:356] "Generic (PLEG): container finished" podID="e5ed75de-19cd-4d14-8531-9b685d84fa69" containerID="434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024" exitCode=0 Jul 09 14:40:47.656841 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.656791 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" Jul 09 14:40:47.657339 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.656833 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" event={"ID":"e5ed75de-19cd-4d14-8531-9b685d84fa69","Type":"ContainerDied","Data":"434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024"} Jul 09 14:40:47.657339 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.656915 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-256hx" event={"ID":"e5ed75de-19cd-4d14-8531-9b685d84fa69","Type":"ContainerDied","Data":"b5079e867316ee7ec813577c2894889e614a1a9361f61ce61607d1706f542301"} Jul 09 14:40:47.657339 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.656951 2570 scope.go:117] "RemoveContainer" containerID="434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024" Jul 09 14:40:47.666868 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.666849 2570 scope.go:117] "RemoveContainer" containerID="434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024" Jul 09 14:40:47.667185 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:40:47.667169 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024\": container with ID starting with 434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024 not found: ID does not exist" containerID="434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024" Jul 09 14:40:47.667231 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.667193 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024"} err="failed to get container status \"434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024\": rpc error: code = NotFound desc = could not find container \"434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024\": container with ID starting with 434b683732e79af80bdc985d1d2e92fbbcd30f577bdc5e3db9577f95bb55a024 not found: ID does not exist" Jul 09 14:40:47.679936 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.679908 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-256hx"] Jul 09 14:40:47.684013 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:47.683986 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-256hx"] Jul 09 14:40:48.239278 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:48.239244 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5ed75de-19cd-4d14-8531-9b685d84fa69" path="/var/lib/kubelet/pods/e5ed75de-19cd-4d14-8531-9b685d84fa69/volumes" Jul 09 14:40:51.893810 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:51.893722 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:51.994411 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:51.994371 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:52.385282 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.385250 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll"] Jul 09 14:40:52.385864 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.385837 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5ed75de-19cd-4d14-8531-9b685d84fa69" containerName="limitador" Jul 09 14:40:52.385864 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.385864 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5ed75de-19cd-4d14-8531-9b685d84fa69" containerName="limitador" Jul 09 14:40:52.386093 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.385964 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5ed75de-19cd-4d14-8531-9b685d84fa69" containerName="limitador" Jul 09 14:40:52.390288 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.390267 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" Jul 09 14:40:52.393392 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.392967 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-jcksz\"" Jul 09 14:40:52.393392 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.392979 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 14:40:52.393392 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.393247 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 09 14:40:52.393903 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.393880 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 14:40:52.399777 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.399752 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll"] Jul 09 14:40:52.425872 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.425845 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:40:52.456077 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.456047 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s27kb\" (UniqueName: \"kubernetes.io/projected/bbbb59f9-33d9-4b47-aa09-ad70faa42bbb-kube-api-access-s27kb\") pod \"postgres-69fb4594cf-hb8ll\" (UID: \"bbbb59f9-33d9-4b47-aa09-ad70faa42bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" Jul 09 14:40:52.456187 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.456085 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bbbb59f9-33d9-4b47-aa09-ad70faa42bbb-data\") pod \"postgres-69fb4594cf-hb8ll\" (UID: \"bbbb59f9-33d9-4b47-aa09-ad70faa42bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" Jul 09 14:40:52.557295 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.557257 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s27kb\" (UniqueName: \"kubernetes.io/projected/bbbb59f9-33d9-4b47-aa09-ad70faa42bbb-kube-api-access-s27kb\") pod \"postgres-69fb4594cf-hb8ll\" (UID: \"bbbb59f9-33d9-4b47-aa09-ad70faa42bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" Jul 09 14:40:52.557465 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.557311 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bbbb59f9-33d9-4b47-aa09-ad70faa42bbb-data\") pod \"postgres-69fb4594cf-hb8ll\" (UID: \"bbbb59f9-33d9-4b47-aa09-ad70faa42bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" Jul 09 14:40:52.557762 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.557742 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/bbbb59f9-33d9-4b47-aa09-ad70faa42bbb-data\") pod \"postgres-69fb4594cf-hb8ll\" (UID: \"bbbb59f9-33d9-4b47-aa09-ad70faa42bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" Jul 09 14:40:52.566122 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.566097 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s27kb\" (UniqueName: \"kubernetes.io/projected/bbbb59f9-33d9-4b47-aa09-ad70faa42bbb-kube-api-access-s27kb\") pod \"postgres-69fb4594cf-hb8ll\" (UID: \"bbbb59f9-33d9-4b47-aa09-ad70faa42bbb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" Jul 09 14:40:52.704248 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.704227 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" Jul 09 14:40:52.836051 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:52.836014 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll"] Jul 09 14:40:52.838621 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:40:52.838587 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbb59f9_33d9_4b47_aa09_ad70faa42bbb.slice/crio-9c6c317bcc95b2523404e505151efefe111631ab69d25d55d496260a45d7fd2f WatchSource:0}: Error finding container 9c6c317bcc95b2523404e505151efefe111631ab69d25d55d496260a45d7fd2f: Status 404 returned error can't find the container with id 9c6c317bcc95b2523404e505151efefe111631ab69d25d55d496260a45d7fd2f Jul 09 14:40:53.690922 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:53.690877 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" event={"ID":"bbbb59f9-33d9-4b47-aa09-ad70faa42bbb","Type":"ContainerStarted","Data":"9c6c317bcc95b2523404e505151efefe111631ab69d25d55d496260a45d7fd2f"} Jul 09 14:40:57.716180 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:57.716142 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" event={"ID":"bbbb59f9-33d9-4b47-aa09-ad70faa42bbb","Type":"ContainerStarted","Data":"fa070632829ff4fc0ee956aecdf2d41f658157cd9351faef13c917bf9947b3b4"} Jul 09 14:40:57.716641 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:57.716211 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" Jul 09 14:40:57.732311 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:40:57.732262 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" podStartSLOduration=1.144501305 podStartE2EDuration="5.732246349s" totalImagesPullingTime="4.587745044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:40:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:40:57.731488561 +0000 UTC m=+537.933415725" watchObservedRunningTime="2026-07-09 14:40:57.732246349 +0000 UTC m=+537.934173531" Jul 09 14:41:03.751287 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:03.751254 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-hb8ll" Jul 09 14:41:04.239655 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.239624 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:04.424300 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.424269 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:04.639731 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.639646 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-79fccfb5cc-jvrph"] Jul 09 14:41:04.645817 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.645789 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79fccfb5cc-jvrph" Jul 09 14:41:04.648437 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.648413 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9ngc9\"" Jul 09 14:41:04.651164 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.651145 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-79fccfb5cc-jvrph"] Jul 09 14:41:04.720627 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.720596 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79fccfb5cc-jvrph"] Jul 09 14:41:04.720909 ip-10-0-140-220 kubenswrapper[2570]: E0709 14:41:04.720879 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-qz8ww], unattached volumes=[], failed to process volumes=[kube-api-access-qz8ww]: context canceled" pod="kuadrant-system/authorino-79fccfb5cc-jvrph" podUID="925a8e44-349c-4965-8ccb-54b17ea06179" Jul 09 14:41:04.751198 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.751171 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79fccfb5cc-jvrph" Jul 09 14:41:04.760198 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.760176 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79fccfb5cc-jvrph" Jul 09 14:41:04.779428 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.779397 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz8ww\" (UniqueName: \"kubernetes.io/projected/925a8e44-349c-4965-8ccb-54b17ea06179-kube-api-access-qz8ww\") pod \"authorino-79fccfb5cc-jvrph\" (UID: \"925a8e44-349c-4965-8ccb-54b17ea06179\") " pod="kuadrant-system/authorino-79fccfb5cc-jvrph" Jul 09 14:41:04.880600 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.880565 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz8ww\" (UniqueName: \"kubernetes.io/projected/925a8e44-349c-4965-8ccb-54b17ea06179-kube-api-access-qz8ww\") pod \"authorino-79fccfb5cc-jvrph\" (UID: \"925a8e44-349c-4965-8ccb-54b17ea06179\") " pod="kuadrant-system/authorino-79fccfb5cc-jvrph" Jul 09 14:41:04.889507 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.889480 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz8ww\" (UniqueName: \"kubernetes.io/projected/925a8e44-349c-4965-8ccb-54b17ea06179-kube-api-access-qz8ww\") pod \"authorino-79fccfb5cc-jvrph\" (UID: \"925a8e44-349c-4965-8ccb-54b17ea06179\") " pod="kuadrant-system/authorino-79fccfb5cc-jvrph" Jul 09 14:41:04.981584 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.981548 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz8ww\" (UniqueName: \"kubernetes.io/projected/925a8e44-349c-4965-8ccb-54b17ea06179-kube-api-access-qz8ww\") pod \"925a8e44-349c-4965-8ccb-54b17ea06179\" (UID: \"925a8e44-349c-4965-8ccb-54b17ea06179\") " Jul 09 14:41:04.983802 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:04.983772 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/925a8e44-349c-4965-8ccb-54b17ea06179-kube-api-access-qz8ww" (OuterVolumeSpecName: "kube-api-access-qz8ww") pod "925a8e44-349c-4965-8ccb-54b17ea06179" (UID: "925a8e44-349c-4965-8ccb-54b17ea06179"). InnerVolumeSpecName "kube-api-access-qz8ww". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:41:05.082807 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:05.082779 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz8ww\" (UniqueName: \"kubernetes.io/projected/925a8e44-349c-4965-8ccb-54b17ea06179-kube-api-access-qz8ww\") on node \"ip-10-0-140-220.ec2.internal\" DevicePath \"\"" Jul 09 14:41:05.760539 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:05.758266 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-79fccfb5cc-jvrph" Jul 09 14:41:05.790984 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:05.790951 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-79fccfb5cc-jvrph"] Jul 09 14:41:05.794981 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:05.794957 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-79fccfb5cc-jvrph"] Jul 09 14:41:06.240183 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:06.240154 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="925a8e44-349c-4965-8ccb-54b17ea06179" path="/var/lib/kubelet/pods/925a8e44-349c-4965-8ccb-54b17ea06179/volumes" Jul 09 14:41:14.588924 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:14.588893 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7jkvd_ead04426-20a8-4e4b-8b18-0af3523a27d9/manager/0.log" Jul 09 14:41:14.704963 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:14.704930 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xwkwg_85b52d60-844e-4614-81b7-219375a5b765/manager/0.log" Jul 09 14:41:14.818587 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:14.818562 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5lglm_67e6e606-8fdf-44dc-8760-5e2b20569333/server/0.log" Jul 09 14:41:14.947808 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:14.947774 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2k5tz_42d3cfd0-af4d-4d99-b12d-e8a02c6e1670/manager/0.log" Jul 09 14:41:15.071370 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:15.071346 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9_777e35d7-a56e-4117-a49d-b5b5ee8aa470/copy-manifests/0.log" Jul 09 14:41:15.090621 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:15.090584 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9_777e35d7-a56e-4117-a49d-b5b5ee8aa470/manager/0.log" Jul 09 14:41:15.730162 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:15.730128 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-hb8ll_bbbb59f9-33d9-4b47-aa09-ad70faa42bbb/postgres/0.log" Jul 09 14:41:17.167619 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:17.167590 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bx7zs_03f3e15e-64d8-4a72-a9e1-afc80390d783/manager/0.log" Jul 09 14:41:17.290955 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:17.290919 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rvxr6_ec94d167-03a4-4492-947f-b6b6a270cf8f/manager/0.log" Jul 09 14:41:17.403188 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:17.403160 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-d72h8_18f1096a-2430-4567-88a8-ae1f8314f75a/kuadrant-console-plugin/0.log" Jul 09 14:41:17.517358 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:17.517326 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mpkrr_ff464735-eee9-414d-bc51-c24c72face2d/registry-server/0.log" Jul 09 14:41:17.767427 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:17.767348 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mvpxs_692251a4-adad-4cad-9f03-70e7981a69dd/limitador/0.log" Jul 09 14:41:17.884998 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:17.884971 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f92kq_1ad3c82c-6ddb-49f0-a865-bcde435e42e1/manager/0.log" Jul 09 14:41:18.503435 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:18.503396 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f576c6fff-46kfj_6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c/kube-auth-proxy/0.log" Jul 09 14:41:18.733799 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:18.733769 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-spgl7_1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec/istio-proxy/0.log" Jul 09 14:41:22.712107 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.712072 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-47plb/must-gather-n96xr"] Jul 09 14:41:22.716053 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.716030 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47plb/must-gather-n96xr" Jul 09 14:41:22.719235 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.719217 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47plb\"/\"kube-root-ca.crt\"" Jul 09 14:41:22.719361 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.719251 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47plb\"/\"openshift-service-ca.crt\"" Jul 09 14:41:22.719361 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.719223 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-47plb\"/\"default-dockercfg-5zln7\"" Jul 09 14:41:22.722754 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.722731 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:22.726820 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.726800 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47plb/must-gather-n96xr"] Jul 09 14:41:22.822350 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.822310 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:22.841885 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.841859 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j976n\" (UniqueName: \"kubernetes.io/projected/e805f018-994d-418a-8dce-3f6ad713ecc9-kube-api-access-j976n\") pod \"must-gather-n96xr\" (UID: \"e805f018-994d-418a-8dce-3f6ad713ecc9\") " pod="openshift-must-gather-47plb/must-gather-n96xr" Jul 09 14:41:22.841991 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.841978 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e805f018-994d-418a-8dce-3f6ad713ecc9-must-gather-output\") pod \"must-gather-n96xr\" (UID: \"e805f018-994d-418a-8dce-3f6ad713ecc9\") " pod="openshift-must-gather-47plb/must-gather-n96xr" Jul 09 14:41:22.942386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.942355 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e805f018-994d-418a-8dce-3f6ad713ecc9-must-gather-output\") pod \"must-gather-n96xr\" (UID: \"e805f018-994d-418a-8dce-3f6ad713ecc9\") " pod="openshift-must-gather-47plb/must-gather-n96xr" Jul 09 14:41:22.942512 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.942404 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j976n\" (UniqueName: \"kubernetes.io/projected/e805f018-994d-418a-8dce-3f6ad713ecc9-kube-api-access-j976n\") pod \"must-gather-n96xr\" (UID: \"e805f018-994d-418a-8dce-3f6ad713ecc9\") " pod="openshift-must-gather-47plb/must-gather-n96xr" Jul 09 14:41:22.942730 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.942712 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e805f018-994d-418a-8dce-3f6ad713ecc9-must-gather-output\") pod \"must-gather-n96xr\" (UID: \"e805f018-994d-418a-8dce-3f6ad713ecc9\") " pod="openshift-must-gather-47plb/must-gather-n96xr" Jul 09 14:41:22.951148 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:22.951126 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j976n\" (UniqueName: \"kubernetes.io/projected/e805f018-994d-418a-8dce-3f6ad713ecc9-kube-api-access-j976n\") pod \"must-gather-n96xr\" (UID: \"e805f018-994d-418a-8dce-3f6ad713ecc9\") " pod="openshift-must-gather-47plb/must-gather-n96xr" Jul 09 14:41:23.026507 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:23.026449 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47plb/must-gather-n96xr" Jul 09 14:41:23.163472 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:23.163442 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47plb/must-gather-n96xr"] Jul 09 14:41:23.166001 ip-10-0-140-220 kubenswrapper[2570]: W0709 14:41:23.165972 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode805f018_994d_418a_8dce_3f6ad713ecc9.slice/crio-f759d2d8545fb7a1fb89f30b23d4fc7db552f574a110912215cdffacce056044 WatchSource:0}: Error finding container f759d2d8545fb7a1fb89f30b23d4fc7db552f574a110912215cdffacce056044: Status 404 returned error can't find the container with id f759d2d8545fb7a1fb89f30b23d4fc7db552f574a110912215cdffacce056044 Jul 09 14:41:23.852149 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:23.852113 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47plb/must-gather-n96xr" event={"ID":"e805f018-994d-418a-8dce-3f6ad713ecc9","Type":"ContainerStarted","Data":"f759d2d8545fb7a1fb89f30b23d4fc7db552f574a110912215cdffacce056044"} Jul 09 14:41:24.864385 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:24.863546 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47plb/must-gather-n96xr" event={"ID":"e805f018-994d-418a-8dce-3f6ad713ecc9","Type":"ContainerStarted","Data":"29393030ac5c8164d5df5a3d00ede22063e5629ff72d38a06a231d12dd21f097"} Jul 09 14:41:24.864385 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:24.863602 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47plb/must-gather-n96xr" event={"ID":"e805f018-994d-418a-8dce-3f6ad713ecc9","Type":"ContainerStarted","Data":"33ee9f67c1ea2e6a682c98475ab7c941dfa01b819f732f2903fd69d3fd53b68a"} Jul 09 14:41:24.880726 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:24.880664 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-47plb/must-gather-n96xr" podStartSLOduration=1.9589118669999999 podStartE2EDuration="2.8806441s" totalImagesPullingTime="921.732233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:41:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:41:24.878988132 +0000 UTC m=+565.080915297" watchObservedRunningTime="2026-07-09 14:41:24.8806441 +0000 UTC m=+565.082571267" Jul 09 14:41:25.646473 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:25.646441 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-84t2b_cbd60921-6ec5-48e9-9b52-cdcf119ce07e/global-pull-secret-syncer/0.log" Jul 09 14:41:25.775160 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:25.775128 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" Jul 09 14:41:25.895941 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:25.895910 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-220.ec2.internal_a0465a62b10ff46565ba4cbcd0da6470/haproxy/0.log" Jul 09 14:41:26.203237 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:26.203198 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:30.942998 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:30.942960 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-bx7zs_03f3e15e-64d8-4a72-a9e1-afc80390d783/manager/0.log" Jul 09 14:41:30.993533 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:30.993484 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-rvxr6_ec94d167-03a4-4492-947f-b6b6a270cf8f/manager/0.log" Jul 09 14:41:31.022614 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:31.022576 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-d72h8_18f1096a-2430-4567-88a8-ae1f8314f75a/kuadrant-console-plugin/0.log" Jul 09 14:41:31.051395 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:31.051360 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-mpkrr_ff464735-eee9-414d-bc51-c24c72face2d/registry-server/0.log" Jul 09 14:41:31.109929 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:31.109895 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mvpxs_692251a4-adad-4cad-9f03-70e7981a69dd/limitador/0.log" Jul 09 14:41:31.150717 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:31.150682 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-f92kq_1ad3c82c-6ddb-49f0-a865-bcde435e42e1/manager/0.log" Jul 09 14:41:33.093281 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.093247 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-5ksp8_ae68db00-049e-481a-9113-1e3db992ddec/cluster-monitoring-operator/0.log" Jul 09 14:41:33.132876 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.132847 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-czpbd_f15d3eb0-6c69-4cea-aa16-bb1dcbb39931/kube-state-metrics/0.log" Jul 09 14:41:33.160869 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.160842 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-czpbd_f15d3eb0-6c69-4cea-aa16-bb1dcbb39931/kube-rbac-proxy-main/0.log" Jul 09 14:41:33.183935 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.183902 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-czpbd_f15d3eb0-6c69-4cea-aa16-bb1dcbb39931/kube-rbac-proxy-self/0.log" Jul 09 14:41:33.419600 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.419492 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbbm6_2a9e9d70-7a63-4573-974c-cc73d8bbcff7/node-exporter/0.log" Jul 09 14:41:33.441942 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.441898 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbbm6_2a9e9d70-7a63-4573-974c-cc73d8bbcff7/kube-rbac-proxy/0.log" Jul 09 14:41:33.471377 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.471347 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kbbm6_2a9e9d70-7a63-4573-974c-cc73d8bbcff7/init-textfile/0.log" Jul 09 14:41:33.501343 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.501296 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-rhllb_2039d3d2-8f20-44f2-9bc6-fce42b4fdc95/kube-rbac-proxy-main/0.log" Jul 09 14:41:33.526108 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.526067 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-rhllb_2039d3d2-8f20-44f2-9bc6-fce42b4fdc95/kube-rbac-proxy-self/0.log" Jul 09 14:41:33.549503 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.549476 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-rhllb_2039d3d2-8f20-44f2-9bc6-fce42b4fdc95/openshift-state-metrics/0.log" Jul 09 14:41:33.854300 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.854273 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85484984dd-wxk29_d8605daa-d39f-44c5-b4fc-17664f4f2930/telemeter-client/0.log" Jul 09 14:41:33.878111 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.878080 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85484984dd-wxk29_d8605daa-d39f-44c5-b4fc-17664f4f2930/reload/0.log" Jul 09 14:41:33.901221 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:33.901194 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-85484984dd-wxk29_d8605daa-d39f-44c5-b4fc-17664f4f2930/kube-rbac-proxy/0.log" Jul 09 14:41:35.751440 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:35.751393 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vphpl_ce1628fd-5991-4d14-b958-9f1d28e671be/console-operator/1.log" Jul 09 14:41:35.760858 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:35.760827 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-vphpl_ce1628fd-5991-4d14-b958-9f1d28e671be/console-operator/2.log" Jul 09 14:41:35.939122 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:35.939089 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d"] Jul 09 14:41:35.947688 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:35.947660 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:35.953411 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:35.953385 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d"] Jul 09 14:41:35.981552 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:35.981233 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-podres\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:35.981552 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:35.981295 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gz4mc\" (UniqueName: \"kubernetes.io/projected/6aaf1e31-4926-4652-84b9-07b70494702c-kube-api-access-gz4mc\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:35.981552 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:35.981414 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-sys\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:35.981552 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:35.981459 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-lib-modules\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:35.981552 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:35.981507 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-proc\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.082636 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.082544 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-sys\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.082636 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.082580 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-lib-modules\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.082636 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.082613 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-proc\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.082912 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.082655 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-podres\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.082912 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.082685 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gz4mc\" (UniqueName: \"kubernetes.io/projected/6aaf1e31-4926-4652-84b9-07b70494702c-kube-api-access-gz4mc\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.082912 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.082699 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-sys\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.082912 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.082782 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-lib-modules\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.082912 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.082826 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-podres\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.083181 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.082949 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6aaf1e31-4926-4652-84b9-07b70494702c-proc\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.092466 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.092422 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gz4mc\" (UniqueName: \"kubernetes.io/projected/6aaf1e31-4926-4652-84b9-07b70494702c-kube-api-access-gz4mc\") pod \"perf-node-gather-daemonset-vdq4d\" (UID: \"6aaf1e31-4926-4652-84b9-07b70494702c\") " pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.260904 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.260866 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.329386 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.329338 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7b575d98fc-ff2pk_f6aba061-e47b-45e2-9851-6c106ade860b/console/0.log" Jul 09 14:41:36.467047 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.467016 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d"] Jul 09 14:41:36.950881 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.950839 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" event={"ID":"6aaf1e31-4926-4652-84b9-07b70494702c","Type":"ContainerStarted","Data":"d5be822dc3a2a09b5858d564801f8046593c03859b672b71742b0c29a680086d"} Jul 09 14:41:36.951338 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.950910 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" event={"ID":"6aaf1e31-4926-4652-84b9-07b70494702c","Type":"ContainerStarted","Data":"a63a08930ba5a22407546013e80a26bb69c1189f0b2c190356a8a36f6760764b"} Jul 09 14:41:36.951596 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.951574 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:36.971896 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:36.971849 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" podStartSLOduration=1.9718296789999998 podStartE2EDuration="1.971829679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:41:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:41:36.97160286 +0000 UTC m=+577.173530027" watchObservedRunningTime="2026-07-09 14:41:36.971829679 +0000 UTC m=+577.173756838" Jul 09 14:41:38.194910 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:38.194882 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nl64z_a8a41997-1d04-466b-be20-b5c118b42b46/dns/0.log" Jul 09 14:41:38.217834 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:38.217804 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-nl64z_a8a41997-1d04-466b-be20-b5c118b42b46/kube-rbac-proxy/0.log" Jul 09 14:41:38.269768 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:38.269738 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nfh5q_3eecab63-82b5-4f23-a147-b1113057ad00/dns-node-resolver/0.log" Jul 09 14:41:38.816063 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:38.816032 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-755f7f4dcb-pnq46_47acb15f-51cb-45ae-ac7d-580226ce1d17/registry/0.log" Jul 09 14:41:38.883171 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:38.883142 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vlkd9_a346c634-df16-4e2d-af0b-7408c90d6735/node-ca/0.log" Jul 09 14:41:39.925236 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:39.925208 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f576c6fff-46kfj_6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c/kube-auth-proxy/0.log" Jul 09 14:41:39.979648 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:39.979616 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-spgl7_1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec/istio-proxy/0.log" Jul 09 14:41:40.639161 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:40.639132 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r5fq4_e288aaaa-06b4-45bd-a94b-b8e785e1e1fa/serve-healthcheck-canary/0.log" Jul 09 14:41:41.115971 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:41.115933 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-mlmrr_7d5894b9-5035-4464-8f52-42cf46cc95c4/insights-operator/1.log" Jul 09 14:41:41.117011 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:41.116983 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-mlmrr_7d5894b9-5035-4464-8f52-42cf46cc95c4/insights-operator/0.log" Jul 09 14:41:41.273594 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:41.273562 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xrzxn_e92e928a-74d2-4243-9828-224a2700397d/kube-rbac-proxy/0.log" Jul 09 14:41:41.295112 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:41.295071 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xrzxn_e92e928a-74d2-4243-9828-224a2700397d/exporter/0.log" Jul 09 14:41:41.317206 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:41.317178 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xrzxn_e92e928a-74d2-4243-9828-224a2700397d/extractor/0.log" Jul 09 14:41:43.467597 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:43.467566 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-7jkvd_ead04426-20a8-4e4b-8b18-0af3523a27d9/manager/0.log" Jul 09 14:41:43.492190 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:43.492166 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-xwkwg_85b52d60-844e-4614-81b7-219375a5b765/manager/0.log" Jul 09 14:41:43.514586 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:43.514554 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5lglm_67e6e606-8fdf-44dc-8760-5e2b20569333/server/0.log" Jul 09 14:41:43.583483 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:43.583445 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-2k5tz_42d3cfd0-af4d-4d99-b12d-e8a02c6e1670/manager/0.log" Jul 09 14:41:43.647593 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:43.647560 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9_777e35d7-a56e-4117-a49d-b5b5ee8aa470/manager/0.log" Jul 09 14:41:43.664795 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:43.664770 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7fdc9c95cd-4x9t9_777e35d7-a56e-4117-a49d-b5b5ee8aa470/copy-manifests/0.log" Jul 09 14:41:43.975405 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:43.975376 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-47plb/perf-node-gather-daemonset-vdq4d" Jul 09 14:41:46.433101 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:46.433023 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f576c6fff-46kfj_6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c/kube-auth-proxy/0.log" Jul 09 14:41:46.468431 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:46.468400 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-spgl7_1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec/istio-proxy/0.log" Jul 09 14:41:47.637123 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:47.637049 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7f576c6fff-46kfj_6a22bd20-ecf2-4b8f-b5d5-27ba32a38c7c/kube-auth-proxy/0.log" Jul 09 14:41:47.673578 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:47.673556 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-spgl7_1ea7d098-e4f0-4e3b-a0c9-b4e5a21152ec/istio-proxy/0.log" Jul 09 14:41:50.342850 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:50.342824 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-7pd6t_c2de977a-694e-4827-9bd1-593dc389ede6/migrator/0.log" Jul 09 14:41:50.365398 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:50.365369 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-7pd6t_c2de977a-694e-4827-9bd1-593dc389ede6/graceful-termination/0.log" Jul 09 14:41:50.932160 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:50.932100 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5mdwl_7ab965c9-a202-40cb-88a0-882ef334ed2e/konnectivity-agent/0.log" limit=1024 Jul 09 14:41:51.723421 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:51.723390 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9mn4p_0ee3219a-bd74-4a69-a9b8-66785fe4d4e4/kube-multus/0.log" Jul 09 14:41:51.909885 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:51.909858 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttbl4_e112330b-09d8-499a-9be7-21e0f525098c/kube-multus-additional-cni-plugins/0.log" Jul 09 14:41:51.930622 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:51.930592 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttbl4_e112330b-09d8-499a-9be7-21e0f525098c/egress-router-binary-copy/0.log" Jul 09 14:41:51.950269 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:51.950247 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttbl4_e112330b-09d8-499a-9be7-21e0f525098c/cni-plugins/0.log" Jul 09 14:41:51.973944 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:51.973880 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttbl4_e112330b-09d8-499a-9be7-21e0f525098c/bond-cni-plugin/0.log" Jul 09 14:41:51.996936 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:51.996916 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttbl4_e112330b-09d8-499a-9be7-21e0f525098c/routeoverride-cni/0.log" Jul 09 14:41:52.017549 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:52.017508 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttbl4_e112330b-09d8-499a-9be7-21e0f525098c/whereabouts-cni-bincopy/0.log" Jul 09 14:41:52.040715 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:52.040690 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ttbl4_e112330b-09d8-499a-9be7-21e0f525098c/whereabouts-cni/0.log" Jul 09 14:41:52.361353 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:52.361283 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cxzs4_ec8f4eb3-372d-4095-98fc-1fe2c8483150/network-metrics-daemon/0.log" Jul 09 14:41:52.379142 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:52.379116 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-cxzs4_ec8f4eb3-372d-4095-98fc-1fe2c8483150/kube-rbac-proxy/0.log" Jul 09 14:41:53.300495 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:53.300465 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vn2j9_0e2ccbba-82ab-40ec-ab03-121c974af538/ovn-controller/0.log" Jul 09 14:41:53.322996 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:53.322959 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vn2j9_0e2ccbba-82ab-40ec-ab03-121c974af538/ovn-acl-logging/1.log" Jul 09 14:41:53.322996 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:53.323009 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vn2j9_0e2ccbba-82ab-40ec-ab03-121c974af538/ovn-acl-logging/0.log" Jul 09 14:41:53.344619 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:53.344590 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vn2j9_0e2ccbba-82ab-40ec-ab03-121c974af538/kube-rbac-proxy-node/0.log" Jul 09 14:41:53.365205 ip-10-0-140-220 kubenswrapper[2570]: I0709 14:41:53.365179 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vn2j9_0e2ccbba-82ab-40ec-ab03-121c974af538/kube-rbac-proxy-ovn-metrics/0.log"